2023-07-07T18:01:49.708 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-07T18:01:49.709 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name rishabh-2023-07-07_17:52:00-fs-wip-rishabh-mdscaps-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-07_17:52:00-fs-wip-rishabh-mdscaps-testing-default-smithi/7328414 -- /home/teuthworker/archive/rishabh-2023-07-07_17:52:00-fs-wip-rishabh-mdscaps-testing-default-smithi/7328414/orig.config.yaml 2023-07-07T18:01:49.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T18:01:49.852 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-07_17:52:00-fs-wip-rishabh-mdscaps-testing-default-smithi/7328414 branch: wip-rishabh-mdscaps description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7328414' kernel: client: sha1: distro flavor: default kdb: true sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-07_17:52:00-fs-wip-rishabh-mdscaps-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-mdscaps ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 8e854f7d61ef670caec08861f0f82587a7320e12 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8e854f7d61ef670caec08861f0f82587a7320e12 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-mdscaps sha1: 8e854f7d61ef670caec08861f0f82587a7320e12 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 8e854f7d61ef670caec08861f0f82587a7320e12 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-mdscaps suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8e854f7d61ef670caec08861f0f82587a7320e12/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8e854f7d61ef670caec08861f0f82587a7320e12 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi160.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-07_17:52:00 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-07T18:01:49.852 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8e854f7d61ef670caec08861f0f82587a7320e12/qa; will attempt to use it 2023-07-07T18:01:49.853 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8e854f7d61ef670caec08861f0f82587a7320e12/qa/tasks 2023-07-07T18:01:49.853 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-07T18:01:49.855 INFO:teuthology.task.internal:Checking packages... 2023-07-07T18:01:49.883 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '8e854f7d61ef670caec08861f0f82587a7320e12' 2023-07-07T18:01:49.883 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-07T18:01:49.883 INFO:teuthology.packaging:ref: None 2023-07-07T18:01:49.884 INFO:teuthology.packaging:tag: None 2023-07-07T18:01:49.884 INFO:teuthology.packaging:branch: wip-rishabh-mdscaps 2023-07-07T18:01:49.884 INFO:teuthology.packaging:sha1: 8e854f7d61ef670caec08861f0f82587a7320e12 2023-07-07T18:01:49.884 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-mdscaps 2023-07-07T18:01:50.107 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4477.g8e854f7d 2023-07-07T18:01:50.107 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-07T18:01:50.114 INFO:teuthology.task.internal:no buildpackages task found 2023-07-07T18:01:50.114 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-07T18:01:50.134 INFO:teuthology.task.internal:Saving configuration 2023-07-07T18:01:50.150 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-07T18:01:50.156 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-07T18:01:50.183 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-07_17:52:00-fs-wip-rishabh-mdscaps-testing-default-smithi/7328414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-07 17:53:18.366879', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-07T18:01:50.206 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-07_17:52:00-fs-wip-rishabh-mdscaps-testing-default-smithi/7328414', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-07 17:53:18.368353', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-07T18:01:50.206 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-07T18:01:50.212 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-07T18:01:50.212 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-07T18:01:50.212 INFO:teuthology.run_tasks:Running task console_log... 2023-07-07T18:01:50.291 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6b5e55e280>, signals=[15]) 2023-07-07T18:01:50.292 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-07T18:01:50.298 INFO:teuthology.task.internal:Opening connections... 2023-07-07T18:01:50.299 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T18:01:50.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:01:50.370 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T18:01:50.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:01:50.437 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-07T18:01:50.444 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-07-07T18:01:50.465 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-07-07T18:01:50.465 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-07-07T18:01:50.524 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Red Hat Enterprise Linux" 2023-07-07T18:01:50.525 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8.6 (Ootpa)" 2023-07-07T18:01:50.525 INFO:teuthology.orchestra.run.smithi012.stdout:ID="rhel" 2023-07-07T18:01:50.525 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="fedora" 2023-07-07T18:01:50.525 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8.6" 2023-07-07T18:01:50.525 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-07-07T18:01:50.526 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-07T18:01:50.526 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-07-07T18:01:50.526 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-07T18:01:50.526 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.redhat.com/" 2023-07-07T18:01:50.526 INFO:teuthology.orchestra.run.smithi012.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-07T18:01:50.526 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-07T18:01:50.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:01:50.526 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-07T18:01:50.527 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-07T18:01:50.527 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-07T18:01:50.527 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-07T18:01:50.528 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-07-07T18:01:50.551 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-07-07T18:01:50.571 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-07-07T18:01:50.571 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-07-07T18:01:50.630 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2023-07-07T18:01:50.630 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)" 2023-07-07T18:01:50.630 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2023-07-07T18:01:50.630 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2023-07-07T18:01:50.630 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6" 2023-07-07T18:01:50.631 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-07-07T18:01:50.631 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-07T18:01:50.631 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-07-07T18:01:50.631 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-07T18:01:50.631 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2023-07-07T18:01:50.631 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-07T18:01:50.631 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-07T18:01:50.632 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:01:50.632 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-07T18:01:50.632 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-07T18:01:50.632 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-07T18:01:50.632 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-07T18:01:50.632 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-07-07T18:01:50.659 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-07T18:01:50.668 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-07T18:01:50.673 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-07T18:01:50.673 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2023-07-07T18:01:50.676 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2023-07-07T18:01:50.693 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-07T18:01:50.699 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-07T18:01:50.700 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2023-07-07T18:01:50.734 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2023-07-07T18:01:50.771 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-07T18:01:50.834 INFO:teuthology.run_tasks:Running task kernel... 2023-07-07T18:01:50.850 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'} 2023-07-07T18:01:50.851 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-07-07T18:01:50.851 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-07-07T18:01:50.851 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-07T18:01:50.852 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-07T18:01:50.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T18:01:50.870 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-07-07T18:01:50.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T18:01:50.872 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2023-07-07T18:01:50.931 INFO:teuthology.orchestra.run.smithi012.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-07T18:01:50.931 INFO:teuthology.task.kernel:Running kernel on smithi012: 4.18.0-372.9.1.el8.x86_64 2023-07-07T18:01:50.931 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y kernel 2023-07-07T18:01:50.932 INFO:teuthology.orchestra.run.smithi160.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-07T18:01:50.932 INFO:teuthology.task.kernel:Running kernel on smithi160: 4.18.0-372.9.1.el8.x86_64 2023-07-07T18:01:50.933 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum install -y kernel 2023-07-07T18:01:52.208 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-07-07T18:01:52.208 INFO:teuthology.orchestra.run.smithi012.stdout:Unable to read consumer identity 2023-07-07T18:01:52.217 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-07-07T18:01:52.218 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2023-07-07T18:01:56.960 INFO:teuthology.orchestra.run.smithi012.stdout:Copr repo for python3-asyncssh owned by ceph 1.0 kB/s | 3.5 kB 00:03 2023-07-07T18:01:56.965 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for python3-asyncssh owned by ceph 1.1 kB/s | 3.5 kB 00:03 2023-07-07T18:01:58.849 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 16 MB 00:01 2023-07-07T18:01:59.552 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 16 MB 00:02 2023-07-07T18:02:02.241 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 465 kB/s | 24 kB 00:00 2023-07-07T18:02:02.885 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-07T18:02:02.940 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2023-07-07T18:02:02.941 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2023-07-07T18:02:02.941 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2023-07-07T18:02:03.087 DEBUG:teuthology.orchestra.run.smithi160:> echo no | sudo yum reinstall kernel || true 2023-07-07T18:02:03.177 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 546 kB/s | 24 kB 00:00 2023-07-07T18:02:03.419 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-07-07T18:02:03.420 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2023-07-07T18:02:03.689 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:01 ago on Fri 07 Jul 2023 06:02:02 PM UTC. 2023-07-07T18:02:03.734 INFO:teuthology.orchestra.run.smithi160.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-07T18:02:03.772 INFO:teuthology.orchestra.run.smithi160.stderr:Error: No packages marked for reinstall. 2023-07-07T18:02:03.819 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum reinstall -y kernel || true 2023-07-07T18:02:03.888 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-07T18:02:03.943 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-07-07T18:02:03.945 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2023-07-07T18:02:03.945 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-07-07T18:02:04.075 DEBUG:teuthology.orchestra.run.smithi012:> echo no | sudo yum reinstall kernel || true 2023-07-07T18:02:04.152 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-07-07T18:02:04.153 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2023-07-07T18:02:04.409 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:00:02 ago on Fri 07 Jul 2023 06:02:02 PM UTC. 2023-07-07T18:02:04.451 INFO:teuthology.orchestra.run.smithi160.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-07T18:02:04.468 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-07-07T18:02:04.468 INFO:teuthology.orchestra.run.smithi012.stdout:Unable to read consumer identity 2023-07-07T18:02:04.494 INFO:teuthology.orchestra.run.smithi160.stderr:Error: No packages marked for reinstall. 2023-07-07T18:02:04.540 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2023-07-07T18:02:04.620 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-07T18:02:04.621 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-07T18:02:04.621 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-07T18:02:04.621 DEBUG:teuthology.parallel:result is None 2023-07-07T18:02:04.742 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:01 ago on Fri 07 Jul 2023 06:02:03 PM UTC. 2023-07-07T18:02:04.787 INFO:teuthology.orchestra.run.smithi012.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-07T18:02:04.844 INFO:teuthology.orchestra.run.smithi012.stderr:Error: No packages marked for reinstall. 2023-07-07T18:02:04.890 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum reinstall -y kernel || true 2023-07-07T18:02:05.239 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-07-07T18:02:05.239 INFO:teuthology.orchestra.run.smithi012.stdout:Unable to read consumer identity 2023-07-07T18:02:05.506 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:02 ago on Fri 07 Jul 2023 06:02:03 PM UTC. 2023-07-07T18:02:05.550 INFO:teuthology.orchestra.run.smithi012.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-07T18:02:05.597 INFO:teuthology.orchestra.run.smithi012.stderr:Error: No packages marked for reinstall. 2023-07-07T18:02:05.644 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2023-07-07T18:02:05.725 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-07T18:02:05.726 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-07T18:02:05.726 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-07T18:02:05.727 DEBUG:teuthology.parallel:result is None 2023-07-07T18:02:05.727 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-07T18:02:05.734 INFO:teuthology.task.internal:Creating test directory... 2023-07-07T18:02:05.734 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-07T18:02:05.736 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-07T18:02:05.756 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-07T18:02:05.762 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-07T18:02:05.768 INFO:teuthology.task.internal:Creating archive directory... 2023-07-07T18:02:05.768 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-07T18:02:05.793 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-07T18:02:05.820 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-07T18:02:05.827 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-07T18:02:05.827 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-07T18:02:05.854 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-07T18:02:05.881 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-07T18:02:05.893 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-07T18:02:05.915 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-07T18:02:05.929 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-07T18:02:05.931 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-07T18:02:05.937 INFO:teuthology.task.internal:Configuring sudo... 2023-07-07T18:02:05.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-07T18:02:05.939 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-07T18:02:05.968 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-07T18:02:05.976 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-07T18:02:05.977 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-07T18:02:06.007 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-07T18:02:06.026 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-07T18:02:06.105 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-07T18:02:06.153 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-07T18:02:06.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-07T18:02:06.279 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:02:06.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-07T18:02:06.346 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-07T18:02:06.393 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-07T18:02:06.458 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-07T18:02:06.502 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-07T18:02:06.546 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:02:06.547 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-07T18:02:06.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2023-07-07T18:02:06.621 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2023-07-07T18:02:06.676 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-07T18:02:06.718 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-07T18:02:07.067 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-07T18:02:07.077 INFO:teuthology.task.internal:Starting timer... 2023-07-07T18:02:07.077 INFO:teuthology.run_tasks:Running task pcp... 2023-07-07T18:02:07.096 INFO:teuthology.run_tasks:Running task selinux... 2023-07-07T18:02:07.105 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-07-07T18:02:07.106 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2023-07-07T18:02:07.166 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2023-07-07T18:02:07.167 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2023-07-07T18:02:07.245 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2023-07-07T18:02:07.247 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-07T18:02:07.247 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2023-07-07T18:02:07.272 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2023-07-07T18:02:07.273 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2023-07-07T18:02:07.291 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2023-07-07T18:02:07.291 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2023-07-07T18:02:07.291 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-07T18:02:07.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T18:02:07.340 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-07T18:02:07.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T18:02:07.368 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-07T18:02:07.368 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2023-07-07T18:02:07.407 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2023-07-07T18:02:07.434 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-07T18:02:07.519 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-07T18:02:07.652 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-07T18:02:10.138 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-07T18:02:12.903 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-07T18:02:12.937 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-07T18:11:14.794 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2023-07-07T18:11:14.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-07-07T18:11:14.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:11:14.869 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-07-07T18:11:14.939 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-07-07T18:11:14.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-07-07T18:11:14.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-07T18:11:15.008 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-07-07T18:11:15.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-07-07T18:11:15.079 INFO:teuthology.run_tasks:Running task clock... 2023-07-07T18:11:15.092 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-07T18:11:15.093 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-07T18:11:15.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-07T18:11:15.101 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-07T18:11:15.101 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-07T18:11:15.130 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-07T18:11:15.146 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-07T18:11:15.151 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-07T18:11:15.165 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-07T18:11:15.214 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2023-07-07T18:11:15.227 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2023-07-07T18:11:15.242 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2023-07-07T18:11:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-07T18:11:15.257 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2023-07-07T18:11:15.258 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-07T18:11:15.269 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-07T18:11:15.282 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-07T18:11:15.332 INFO:teuthology.orchestra.run.smithi012.stderr:bash: ntpq: command not found 2023-07-07T18:11:15.335 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-07T18:11:15.335 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2023-07-07T18:11:15.335 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T18:11:15.336 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T18:11:15.336 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T18:11:15.336 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T18:11:15.358 INFO:teuthology.orchestra.run.smithi160.stderr:bash: ntpq: command not found 2023-07-07T18:11:15.362 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-07T18:11:15.362 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2023-07-07T18:11:15.363 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T18:11:15.363 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T18:11:15.363 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T18:11:15.363 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T18:11:15.365 INFO:teuthology.run_tasks:Running task install... 2023-07-07T18:11:15.376 DEBUG:teuthology.task.install:project ceph 2023-07-07T18:11:15.376 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8e854f7d61ef670caec08861f0f82587a7320e12'}} 2023-07-07T18:11:15.377 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8e854f7d61ef670caec08861f0f82587a7320e12'} 2023-07-07T18:11:15.377 INFO:teuthology.task.install:Using flavor: default 2023-07-07T18:11:15.386 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-07T18:11:15.387 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-07T18:11:15.387 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8e854f7d61ef670caec08861f0f82587a7320e12', 'tag': None, 'wait_for_package': False} 2023-07-07T18:11:15.388 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e854f7d61ef670caec08861f0f82587a7320e12 2023-07-07T18:11:15.391 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8e854f7d61ef670caec08861f0f82587a7320e12', 'tag': None, 'wait_for_package': False} 2023-07-07T18:11:15.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e854f7d61ef670caec08861f0f82587a7320e12 2023-07-07T18:11:15.539 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-mdscaps/8e854f7d61ef670caec08861f0f82587a7320e12/centos/8/flavors/default/ 2023-07-07T18:11:15.539 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4477.g8e854f7d 2023-07-07T18:11:15.554 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-mdscaps/8e854f7d61ef670caec08861f0f82587a7320e12/centos/8/flavors/default/ 2023-07-07T18:11:15.554 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4477.g8e854f7d 2023-07-07T18:11:15.661 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-mdscaps/8e854f7d61ef670caec08861f0f82587a7320e12/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-mdscaps/8e854f7d61ef670caec08861f0f82587a7320e12/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-mdscaps/8e854f7d61ef670caec08861f0f82587a7320e12/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-07T18:11:15.661 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:11:15.661 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-07T18:11:15.690 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-07T18:11:15.690 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8e854f7d61ef670caec08861f0f82587a7320e12/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-07T18:11:15.724 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-mdscaps/8e854f7d61ef670caec08861f0f82587a7320e12/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-mdscaps/8e854f7d61ef670caec08861f0f82587a7320e12/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-mdscaps/8e854f7d61ef670caec08861f0f82587a7320e12/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-07T18:11:15.724 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:11:15.725 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-07T18:11:15.752 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-07T18:11:15.752 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8e854f7d61ef670caec08861f0f82587a7320e12/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-07T18:11:15.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-07T18:11:15.819 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-07T18:11:15.841 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-07T18:11:15.896 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-07T18:11:15.910 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2023-07-07T18:11:15.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2023-07-07T18:11:15.962 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2023-07-07T18:11:15.964 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2023-07-07T18:11:16.302 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-07-07T18:11:16.337 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-07-07T18:11:16.655 INFO:teuthology.orchestra.run.smithi012.stdout:44 files removed 2023-07-07T18:11:16.660 INFO:teuthology.orchestra.run.smithi160.stdout:44 files removed 2023-07-07T18:11:16.703 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-07T18:11:16.707 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-07T18:11:17.041 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-07-07T18:11:17.053 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-07-07T18:11:17.836 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 251 kB/s | 81 kB 00:00 2023-07-07T18:11:17.888 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 230 kB/s | 81 kB 00:00 2023-07-07T18:11:18.186 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-07-07T18:11:18.253 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 24 kB/s | 9.4 kB 00:00 2023-07-07T18:11:18.613 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2023-07-07T18:11:18.636 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 3.5 kB/s | 1.5 kB 00:00 2023-07-07T18:11:21.253 INFO:teuthology.orchestra.run.smithi012.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-07T18:11:21.313 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-07T18:11:22.305 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-07-07T18:11:25.730 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 413 kB/s | 24 kB 00:00 2023-07-07T18:11:26.447 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 16 MB 00:05 2023-07-07T18:11:26.682 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-07-07T18:11:30.161 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 469 kB/s | 24 kB 00:00 2023-07-07T18:11:31.121 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-07-07T18:11:34.791 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 56 MB/s | 53 MB 00:00 2023-07-07T18:11:39.571 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-07-07T18:11:45.872 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-07T18:11:45.873 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-07T18:11:45.886 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-07T18:11:45.887 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-07T18:11:45.888 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-07T18:11:45.889 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-07T18:11:45.891 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-07T18:11:45.894 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-07T18:11:45.896 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-07T18:11:46.025 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2023-07-07T18:11:46.037 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2023-07-07T18:11:46.037 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2023-07-07T18:11:46.038 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2023-07-07T18:11:46.038 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2023-07-07T18:11:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-07T18:11:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-07T18:11:46.038 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 6.4 k 2023-07-07T18:11:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 5.4 M 2023-07-07T18:11:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 847 k 2023-07-07T18:11:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 165 k 2023-07-07T18:11:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 1.5 M 2023-07-07T18:11:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 128 k 2023-07-07T18:11:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 1.7 M 2023-07-07T18:11:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 7.4 M 2023-07-07T18:11:46.039 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 47 k 2023-07-07T18:11:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 13 M 2023-07-07T18:11:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 48 M 2023-07-07T18:11:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 258 k 2023-07-07T18:11:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 164 k 2023-07-07T18:11:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 258 k 2023-07-07T18:11:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 18 k 2023-07-07T18:11:46.040 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-07T18:11:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-07T18:11:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-07T18:11:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 31 k 2023-07-07T18:11:46.041 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 771 k 2023-07-07T18:11:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 139 k 2023-07-07T18:11:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-07T18:11:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-07T18:11:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-07T18:11:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-07T18:11:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-07T18:11:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-07T18:11:46.042 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 198 k 2023-07-07T18:11:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 370 k 2023-07-07T18:11:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 364 k 2023-07-07T18:11:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 106 k 2023-07-07T18:11:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 94 k 2023-07-07T18:11:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 3.4 M 2023-07-07T18:11:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 179 k 2023-07-07T18:11:46.043 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-07T18:11:46.044 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2023-07-07T18:11:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-07T18:11:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 3.7 M 2023-07-07T18:11:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 3.6 M 2023-07-07T18:11:46.044 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2023-07-07T18:11:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-07T18:11:46.044 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 22 M 2023-07-07T18:11:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 23 k 2023-07-07T18:11:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 2.3 M 2023-07-07T18:11:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 240 k 2023-07-07T18:11:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 4.6 M 2023-07-07T18:11:46.045 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 18 M 2023-07-07T18:11:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 15 k 2023-07-07T18:11:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 24 k 2023-07-07T18:11:46.046 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-07T18:11:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-07T18:11:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-07T18:11:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-07T18:11:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-07T18:11:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 137 k 2023-07-07T18:11:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-07T18:11:46.047 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-07T18:11:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-07T18:11:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-07T18:11:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-07T18:11:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-07T18:11:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 473 k 2023-07-07T18:11:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-07T18:11:46.048 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 6.7 M 2023-07-07T18:11:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-07T18:11:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-07T18:11:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-07T18:11:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-07T18:11:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-07T18:11:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-07T18:11:46.049 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-07T18:11:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-07T18:11:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-07T18:11:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-07T18:11:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-07T18:11:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-07T18:11:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-07T18:11:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-07T18:11:46.050 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-07T18:11:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-07T18:11:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 45 k 2023-07-07T18:11:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 119 k 2023-07-07T18:11:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-07T18:11:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-07T18:11:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-07T18:11:46.051 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-07T18:11:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-07T18:11:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-07T18:11:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-07T18:11:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-07T18:11:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-07T18:11:46.052 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-07T18:11:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-07T18:11:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-07T18:11:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-07T18:11:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-07T18:11:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-07T18:11:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-07T18:11:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-07T18:11:46.053 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-07T18:11:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-07T18:11:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-07T18:11:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-07T18:11:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-07T18:11:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-07T18:11:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-07T18:11:46.054 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-07T18:11:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-07T18:11:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-07T18:11:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-07T18:11:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-07T18:11:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-07T18:11:46.055 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-07T18:11:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-07T18:11:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-07T18:11:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-07T18:11:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-07T18:11:46.056 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-07T18:11:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-07T18:11:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-07T18:11:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-07T18:11:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-07T18:11:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-07T18:11:46.057 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-07T18:11:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-07T18:11:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-07T18:11:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-07T18:11:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-07T18:11:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-07T18:11:46.058 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-07T18:11:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-07T18:11:46.059 INFO:teuthology.orchestra.run.smithi160.stdout:Enabling module streams: 2023-07-07T18:11:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql 10 2023-07-07T18:11:46.059 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:11:46.060 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2023-07-07T18:11:46.060 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2023-07-07T18:11:46.060 INFO:teuthology.orchestra.run.smithi160.stdout:Install 128 Packages 2023-07-07T18:11:46.061 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 3 Packages 2023-07-07T18:11:46.061 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:11:46.062 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 205 M 2023-07-07T18:11:46.062 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2023-07-07T18:11:46.341 INFO:teuthology.orchestra.run.smithi160.stdout:(1/131): ceph-18.0.0-4477.g8e854f7d.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2023-07-07T18:11:51.436 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-07T18:11:51.437 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-07T18:11:51.452 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-07T18:11:51.453 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-07T18:11:51.454 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-07T18:11:51.455 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-07T18:11:51.458 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-07T18:11:51.461 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-07T18:11:51.462 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-07T18:11:51.606 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-07-07T18:11:51.619 INFO:teuthology.orchestra.run.smithi012.stdout:=========================================================================================================================== 2023-07-07T18:11:51.620 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-07-07T18:11:51.620 INFO:teuthology.orchestra.run.smithi012.stdout:=========================================================================================================================== 2023-07-07T18:11:51.621 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2023-07-07T18:11:51.621 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-07T18:11:51.621 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-07T18:11:51.621 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 6.4 k 2023-07-07T18:11:51.622 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 5.4 M 2023-07-07T18:11:51.622 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 847 k 2023-07-07T18:11:51.622 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 165 k 2023-07-07T18:11:51.622 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 1.5 M 2023-07-07T18:11:51.623 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 128 k 2023-07-07T18:11:51.623 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 1.7 M 2023-07-07T18:11:51.623 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 7.4 M 2023-07-07T18:11:51.623 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 47 k 2023-07-07T18:11:51.624 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 13 M 2023-07-07T18:11:51.624 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 48 M 2023-07-07T18:11:51.624 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 258 k 2023-07-07T18:11:51.624 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 164 k 2023-07-07T18:11:51.625 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 258 k 2023-07-07T18:11:51.625 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 18 k 2023-07-07T18:11:51.625 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-07T18:11:51.625 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-07T18:11:51.625 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-07T18:11:51.626 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 31 k 2023-07-07T18:11:51.626 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 771 k 2023-07-07T18:11:51.626 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 139 k 2023-07-07T18:11:51.626 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-07T18:11:51.626 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-07T18:11:51.626 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-07T18:11:51.627 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-07T18:11:51.627 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-07T18:11:51.627 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-07T18:11:51.627 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 198 k 2023-07-07T18:11:51.628 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 370 k 2023-07-07T18:11:51.628 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 364 k 2023-07-07T18:11:51.628 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 106 k 2023-07-07T18:11:51.628 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 94 k 2023-07-07T18:11:51.628 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 3.4 M 2023-07-07T18:11:51.629 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 179 k 2023-07-07T18:11:51.629 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-07T18:11:51.629 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2023-07-07T18:11:51.629 INFO:teuthology.orchestra.run.smithi012.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-07T18:11:51.630 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 3.7 M 2023-07-07T18:11:51.630 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 3.6 M 2023-07-07T18:11:51.630 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2023-07-07T18:11:51.630 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-07T18:11:51.630 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 22 M 2023-07-07T18:11:51.631 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 23 k 2023-07-07T18:11:51.631 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 2.3 M 2023-07-07T18:11:51.631 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 240 k 2023-07-07T18:11:51.631 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 4.6 M 2023-07-07T18:11:51.632 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 18 M 2023-07-07T18:11:51.632 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4477.g8e854f7d.el8 ceph-noarch 15 k 2023-07-07T18:11:51.632 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 24 k 2023-07-07T18:11:51.632 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-07T18:11:51.632 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-07T18:11:51.633 INFO:teuthology.orchestra.run.smithi012.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-07T18:11:51.633 INFO:teuthology.orchestra.run.smithi012.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-07T18:11:51.633 INFO:teuthology.orchestra.run.smithi012.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-07T18:11:51.633 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 137 k 2023-07-07T18:11:51.633 INFO:teuthology.orchestra.run.smithi012.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-07T18:11:51.634 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-07T18:11:51.634 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-07T18:11:51.634 INFO:teuthology.orchestra.run.smithi012.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-07T18:11:51.634 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-07T18:11:51.635 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-07T18:11:51.635 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 473 k 2023-07-07T18:11:51.635 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-07T18:11:51.635 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 6.7 M 2023-07-07T18:11:51.636 INFO:teuthology.orchestra.run.smithi012.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-07T18:11:51.636 INFO:teuthology.orchestra.run.smithi012.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-07T18:11:51.636 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-07T18:11:51.636 INFO:teuthology.orchestra.run.smithi012.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-07T18:11:51.636 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-07T18:11:51.637 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-07T18:11:51.637 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-07T18:11:51.637 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-07T18:11:51.637 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-07T18:11:51.637 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-07T18:11:51.638 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-07T18:11:51.638 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-07T18:11:51.638 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-07T18:11:51.638 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-07T18:11:51.638 INFO:teuthology.orchestra.run.smithi012.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-07T18:11:51.638 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-07T18:11:51.638 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 45 k 2023-07-07T18:11:51.639 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:18.0.0-4477.g8e854f7d.el8 ceph 119 k 2023-07-07T18:11:51.639 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-07T18:11:51.639 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-07T18:11:51.639 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-07T18:11:51.639 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-07T18:11:51.639 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-07T18:11:51.640 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-07T18:11:51.640 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-07T18:11:51.641 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-07T18:11:51.641 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-07T18:11:51.641 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-07T18:11:51.641 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-07T18:11:51.641 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-07T18:11:51.642 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-07T18:11:51.642 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-07T18:11:51.642 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-07T18:11:51.642 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-07T18:11:51.642 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-07T18:11:51.642 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-07T18:11:51.643 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-07T18:11:51.643 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-07T18:11:51.643 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-07T18:11:51.643 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-07T18:11:51.644 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-07T18:11:51.644 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-07T18:11:51.644 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-07T18:11:51.645 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-07T18:11:51.645 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-07T18:11:51.645 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-07T18:11:51.645 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-07T18:11:51.646 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-07T18:11:51.646 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-07T18:11:51.646 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-07T18:11:51.647 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-07T18:11:51.647 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-07T18:11:51.647 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-07T18:11:51.648 INFO:teuthology.orchestra.run.smithi012.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-07T18:11:51.648 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-07T18:11:51.648 INFO:teuthology.orchestra.run.smithi012.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-07T18:11:51.648 INFO:teuthology.orchestra.run.smithi012.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-07T18:11:51.649 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-07T18:11:51.649 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-07T18:11:51.649 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-07T18:11:51.649 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-07T18:11:51.650 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-07T18:11:51.650 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-07T18:11:51.650 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-07T18:11:51.650 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-07T18:11:51.650 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-07T18:11:51.651 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-07T18:11:51.651 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling module streams: 2023-07-07T18:11:51.651 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql 10 2023-07-07T18:11:51.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:11:51.651 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-07-07T18:11:51.651 INFO:teuthology.orchestra.run.smithi012.stdout:=========================================================================================================================== 2023-07-07T18:11:51.651 INFO:teuthology.orchestra.run.smithi012.stdout:Install 128 Packages 2023-07-07T18:11:51.651 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 3 Packages 2023-07-07T18:11:51.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:11:51.652 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 205 M 2023-07-07T18:11:51.652 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-07-07T18:11:51.980 INFO:teuthology.orchestra.run.smithi012.stdout:(1/131): ceph-18.0.0-4477.g8e854f7d.el8.x86_64. 37 kB/s | 6.4 kB 00:00 2023-07-07T18:11:53.329 INFO:teuthology.orchestra.run.smithi012.stdout:(2/131): ceph-fuse-18.0.0-4477.g8e854f7d.el8.x8 628 kB/s | 847 kB 00:01 2023-07-07T18:11:53.357 INFO:teuthology.orchestra.run.smithi160.stdout:(2/131): ceph-fuse-18.0.0-4477.g8e854f7d.el8.x8 121 kB/s | 847 kB 00:07 2023-07-07T18:11:53.583 INFO:teuthology.orchestra.run.smithi160.stdout:(3/131): ceph-base-18.0.0-4477.g8e854f7d.el8.x8 735 kB/s | 5.4 MB 00:07 2023-07-07T18:11:53.604 INFO:teuthology.orchestra.run.smithi012.stdout:(3/131): ceph-base-18.0.0-4477.g8e854f7d.el8.x8 3.0 MB/s | 5.4 MB 00:01 2023-07-07T18:11:53.608 INFO:teuthology.orchestra.run.smithi160.stdout:(4/131): ceph-immutable-object-cache-18.0.0-447 661 kB/s | 165 kB 00:00 2023-07-07T18:11:53.630 INFO:teuthology.orchestra.run.smithi012.stdout:(4/131): ceph-immutable-object-cache-18.0.0-447 551 kB/s | 165 kB 00:00 2023-07-07T18:11:53.942 INFO:teuthology.orchestra.run.smithi160.stdout:(5/131): ceph-mds-18.0.0-4477.g8e854f7d.el8.x86 6.4 MB/s | 2.3 MB 00:00 2023-07-07T18:11:53.972 INFO:teuthology.orchestra.run.smithi012.stdout:(5/131): ceph-mds-18.0.0-4477.g8e854f7d.el8.x86 6.2 MB/s | 2.3 MB 00:00 2023-07-07T18:11:54.155 INFO:teuthology.orchestra.run.smithi012.stdout:(6/131): ceph-mgr-18.0.0-4477.g8e854f7d.el8.x86 2.9 MB/s | 1.5 MB 00:00 2023-07-07T18:11:54.184 INFO:teuthology.orchestra.run.smithi160.stdout:(6/131): ceph-mgr-18.0.0-4477.g8e854f7d.el8.x86 2.7 MB/s | 1.5 MB 00:00 2023-07-07T18:11:54.685 INFO:teuthology.orchestra.run.smithi160.stdout:(7/131): ceph-mon-18.0.0-4477.g8e854f7d.el8.x86 6.2 MB/s | 4.6 MB 00:00 2023-07-07T18:11:54.706 INFO:teuthology.orchestra.run.smithi012.stdout:(7/131): ceph-mon-18.0.0-4477.g8e854f7d.el8.x86 6.3 MB/s | 4.6 MB 00:00 2023-07-07T18:11:56.792 INFO:teuthology.orchestra.run.smithi160.stdout:(8/131): ceph-radosgw-18.0.0-4477.g8e854f7d.el8 6.4 MB/s | 13 MB 00:02 2023-07-07T18:11:56.859 INFO:teuthology.orchestra.run.smithi160.stdout:(9/131): ceph-selinux-18.0.0-4477.g8e854f7d.el8 367 kB/s | 24 kB 00:00 2023-07-07T18:11:57.085 INFO:teuthology.orchestra.run.smithi160.stdout:(10/131): ceph-common-18.0.0-4477.g8e854f7d.el8 2.0 MB/s | 22 MB 00:11 2023-07-07T18:11:57.277 INFO:teuthology.orchestra.run.smithi160.stdout:(11/131): cephfs-mirror-18.0.0-4477.g8e854f7d.e 1.3 MB/s | 258 kB 00:00 2023-07-07T18:11:57.395 INFO:teuthology.orchestra.run.smithi160.stdout:(12/131): libcephfs-devel-18.0.0-4477.g8e854f7d 266 kB/s | 31 kB 00:00 2023-07-07T18:11:57.506 INFO:teuthology.orchestra.run.smithi012.stdout:(8/131): ceph-radosgw-18.0.0-4477.g8e854f7d.el8 4.8 MB/s | 13 MB 00:02 2023-07-07T18:11:57.571 INFO:teuthology.orchestra.run.smithi160.stdout:(13/131): libcephfs2-18.0.0-4477.g8e854f7d.el8. 4.2 MB/s | 771 kB 00:00 2023-07-07T18:11:57.644 INFO:teuthology.orchestra.run.smithi160.stdout:(14/131): libcephsqlite-18.0.0-4477.g8e854f7d.e 1.9 MB/s | 137 kB 00:00 2023-07-07T18:11:57.681 INFO:teuthology.orchestra.run.smithi012.stdout:(9/131): ceph-osd-18.0.0-4477.g8e854f7d.el8.x86 5.0 MB/s | 18 MB 00:03 2023-07-07T18:11:57.706 INFO:teuthology.orchestra.run.smithi012.stdout:(10/131): ceph-selinux-18.0.0-4477.g8e854f7d.el 121 kB/s | 24 kB 00:00 2023-07-07T18:11:57.727 INFO:teuthology.orchestra.run.smithi160.stdout:(15/131): librados-devel-18.0.0-4477.g8e854f7d. 1.6 MB/s | 139 kB 00:00 2023-07-07T18:11:57.773 INFO:teuthology.orchestra.run.smithi012.stdout:(11/131): cephfs-mirror-18.0.0-4477.g8e854f7d.e 3.8 MB/s | 258 kB 00:00 2023-07-07T18:11:57.856 INFO:teuthology.orchestra.run.smithi012.stdout:(12/131): libcephfs-devel-18.0.0-4477.g8e854f7d 373 kB/s | 31 kB 00:00 2023-07-07T18:11:57.899 INFO:teuthology.orchestra.run.smithi160.stdout:(16/131): libradosstriper1-18.0.0-4477.g8e854f7 2.7 MB/s | 473 kB 00:00 2023-07-07T18:11:57.982 INFO:teuthology.orchestra.run.smithi012.stdout:(13/131): libcephfs2-18.0.0-4477.g8e854f7d.el8. 6.0 MB/s | 771 kB 00:00 2023-07-07T18:11:58.057 INFO:teuthology.orchestra.run.smithi012.stdout:(14/131): libcephsqlite-18.0.0-4477.g8e854f7d.e 1.8 MB/s | 137 kB 00:00 2023-07-07T18:11:58.141 INFO:teuthology.orchestra.run.smithi012.stdout:(15/131): librados-devel-18.0.0-4477.g8e854f7d. 1.6 MB/s | 139 kB 00:00 2023-07-07T18:11:58.241 INFO:teuthology.orchestra.run.smithi012.stdout:(16/131): libradosstriper1-18.0.0-4477.g8e854f7 4.6 MB/s | 473 kB 00:00 2023-07-07T18:11:59.418 INFO:teuthology.orchestra.run.smithi012.stdout:(17/131): ceph-common-18.0.0-4477.g8e854f7d.el8 2.9 MB/s | 22 MB 00:07 2023-07-07T18:11:59.575 INFO:teuthology.orchestra.run.smithi012.stdout:(18/131): python3-ceph-argparse-18.0.0-4477.g8e 283 kB/s | 45 kB 00:00 2023-07-07T18:11:59.582 INFO:teuthology.orchestra.run.smithi160.stdout:(17/131): librgw2-18.0.0-4477.g8e854f7d.el8.x86 4.0 MB/s | 6.7 MB 00:01 2023-07-07T18:11:59.695 INFO:teuthology.orchestra.run.smithi160.stdout:(18/131): python3-ceph-argparse-18.0.0-4477.g8e 397 kB/s | 45 kB 00:00 2023-07-07T18:11:59.725 INFO:teuthology.orchestra.run.smithi012.stdout:(19/131): librgw2-18.0.0-4477.g8e854f7d.el8.x86 4.5 MB/s | 6.7 MB 00:01 2023-07-07T18:11:59.754 INFO:teuthology.orchestra.run.smithi160.stdout:(19/131): python3-ceph-common-18.0.0-4477.g8e85 2.0 MB/s | 119 kB 00:00 2023-07-07T18:11:59.809 INFO:teuthology.orchestra.run.smithi012.stdout:(20/131): python3-cephfs-18.0.0-4477.g8e854f7d. 2.3 MB/s | 198 kB 00:00 2023-07-07T18:11:59.825 INFO:teuthology.orchestra.run.smithi012.stdout:(21/131): python3-ceph-common-18.0.0-4477.g8e85 474 kB/s | 119 kB 00:00 2023-07-07T18:11:59.854 INFO:teuthology.orchestra.run.smithi160.stdout:(20/131): python3-cephfs-18.0.0-4477.g8e854f7d. 1.9 MB/s | 198 kB 00:00 2023-07-07T18:11:59.942 INFO:teuthology.orchestra.run.smithi012.stdout:(22/131): python3-rados-18.0.0-4477.g8e854f7d.e 2.7 MB/s | 370 kB 00:00 2023-07-07T18:11:59.987 INFO:teuthology.orchestra.run.smithi160.stdout:(21/131): python3-rados-18.0.0-4477.g8e854f7d.e 2.7 MB/s | 370 kB 00:00 2023-07-07T18:12:00.113 INFO:teuthology.orchestra.run.smithi160.stdout:(22/131): python3-rbd-18.0.0-4477.g8e854f7d.el8 2.8 MB/s | 364 kB 00:00 2023-07-07T18:12:00.188 INFO:teuthology.orchestra.run.smithi160.stdout:(23/131): python3-rgw-18.0.0-4477.g8e854f7d.el8 1.4 MB/s | 106 kB 00:00 2023-07-07T18:12:00.210 INFO:teuthology.orchestra.run.smithi012.stdout:(23/131): python3-rgw-18.0.0-4477.g8e854f7d.el8 399 kB/s | 106 kB 00:00 2023-07-07T18:12:00.272 INFO:teuthology.orchestra.run.smithi160.stdout:(24/131): rbd-fuse-18.0.0-4477.g8e854f7d.el8.x8 1.1 MB/s | 94 kB 00:00 2023-07-07T18:12:00.285 INFO:teuthology.orchestra.run.smithi012.stdout:(24/131): rbd-fuse-18.0.0-4477.g8e854f7d.el8.x8 1.2 MB/s | 94 kB 00:00 2023-07-07T18:12:00.310 INFO:teuthology.orchestra.run.smithi012.stdout:(25/131): python3-rbd-18.0.0-4477.g8e854f7d.el8 752 kB/s | 364 kB 00:00 2023-07-07T18:12:00.594 INFO:teuthology.orchestra.run.smithi012.stdout:(26/131): rbd-nbd-18.0.0-4477.g8e854f7d.el8.x86 633 kB/s | 179 kB 00:00 2023-07-07T18:12:00.736 INFO:teuthology.orchestra.run.smithi012.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4477.g 163 kB/s | 23 kB 00:00 2023-07-07T18:12:00.872 INFO:teuthology.orchestra.run.smithi160.stdout:(25/131): ceph-osd-18.0.0-4477.g8e854f7d.el8.x8 2.6 MB/s | 18 MB 00:06 2023-07-07T18:12:00.927 INFO:teuthology.orchestra.run.smithi012.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4477.g8e854f7 667 kB/s | 128 kB 00:00 2023-07-07T18:12:01.078 INFO:teuthology.orchestra.run.smithi012.stdout:(29/131): rbd-mirror-18.0.0-4477.g8e854f7d.el8. 4.4 MB/s | 3.4 MB 00:00 2023-07-07T18:12:01.081 INFO:teuthology.orchestra.run.smithi160.stdout:(26/131): rbd-mirror-18.0.0-4477.g8e854f7d.el8. 4.3 MB/s | 3.4 MB 00:00 2023-07-07T18:12:01.106 INFO:teuthology.orchestra.run.smithi160.stdout:(27/131): rbd-nbd-18.0.0-4477.g8e854f7d.el8.x86 768 kB/s | 179 kB 00:00 2023-07-07T18:12:01.162 INFO:teuthology.orchestra.run.smithi160.stdout:(28/131): ceph-grafana-dashboards-18.0.0-4477.g 286 kB/s | 23 kB 00:00 2023-07-07T18:12:01.190 INFO:teuthology.orchestra.run.smithi160.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4477.g8e854f7 1.5 MB/s | 128 kB 00:00 2023-07-07T18:12:01.607 INFO:teuthology.orchestra.run.smithi160.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4477.g8e854 3.8 MB/s | 1.7 MB 00:00 2023-07-07T18:12:01.757 INFO:teuthology.orchestra.run.smithi160.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4477.g8e 1.6 MB/s | 240 kB 00:00 2023-07-07T18:12:01.857 INFO:teuthology.orchestra.run.smithi160.stdout:(32/131): ceph-mgr-rook-18.0.0-4477.g8e854f7d.e 474 kB/s | 47 kB 00:00 2023-07-07T18:12:01.932 INFO:teuthology.orchestra.run.smithi160.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4477.g8 194 kB/s | 15 kB 00:00 2023-07-07T18:12:02.050 INFO:teuthology.orchestra.run.smithi160.stdout:(34/131): ceph-volume-18.0.0-4477.g8e854f7d.el8 2.2 MB/s | 258 kB 00:00 2023-07-07T18:12:02.150 INFO:teuthology.orchestra.run.smithi160.stdout:(35/131): cephadm-18.0.0-4477.g8e854f7d.el8.noa 1.6 MB/s | 164 kB 00:00 2023-07-07T18:12:02.200 INFO:teuthology.orchestra.run.smithi160.stdout:(36/131): cephfs-top-18.0.0-4477.g8e854f7d.el8. 360 kB/s | 18 kB 00:00 2023-07-07T18:12:02.440 INFO:teuthology.orchestra.run.smithi160.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-07-07T18:12:02.509 INFO:teuthology.orchestra.run.smithi160.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 855 kB/s | 59 kB 00:00 2023-07-07T18:12:02.567 INFO:teuthology.orchestra.run.smithi160.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-07-07T18:12:02.578 INFO:teuthology.orchestra.run.smithi012.stdout:(30/131): ceph-test-18.0.0-4477.g8e854f7d.el8.x 9.7 MB/s | 48 MB 00:04 2023-07-07T18:12:02.620 INFO:teuthology.orchestra.run.smithi012.stdout:(31/131): ceph-mgr-dashboard-18.0.0-4477.g8e854 1.0 MB/s | 1.7 MB 00:01 2023-07-07T18:12:02.676 INFO:teuthology.orchestra.run.smithi160.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-07-07T18:12:02.726 INFO:teuthology.orchestra.run.smithi160.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 877 kB/s | 44 kB 00:00 2023-07-07T18:12:02.728 INFO:teuthology.orchestra.run.smithi012.stdout:(32/131): ceph-mgr-diskprediction-local-18.0.0- 4.5 MB/s | 7.4 MB 00:01 2023-07-07T18:12:02.754 INFO:teuthology.orchestra.run.smithi012.stdout:(33/131): ceph-mgr-rook-18.0.0-4477.g8e854f7d.e 354 kB/s | 47 kB 00:00 2023-07-07T18:12:02.779 INFO:teuthology.orchestra.run.smithi012.stdout:(34/131): ceph-mgr-modules-core-18.0.0-4477.g8e 1.2 MB/s | 240 kB 00:00 2023-07-07T18:12:02.785 INFO:teuthology.orchestra.run.smithi160.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2023-07-07T18:12:02.805 INFO:teuthology.orchestra.run.smithi012.stdout:(35/131): ceph-prometheus-alerts-18.0.0-4477.g8 192 kB/s | 15 kB 00:00 2023-07-07T18:12:02.838 INFO:teuthology.orchestra.run.smithi012.stdout:(36/131): cephadm-18.0.0-4477.g8e854f7d.el8.noa 2.7 MB/s | 164 kB 00:00 2023-07-07T18:12:02.843 INFO:teuthology.orchestra.run.smithi160.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 568 kB/s | 33 kB 00:00 2023-07-07T18:12:02.863 INFO:teuthology.orchestra.run.smithi012.stdout:(37/131): cephfs-top-18.0.0-4477.g8e854f7d.el8. 308 kB/s | 18 kB 00:00 2023-07-07T18:12:02.924 INFO:teuthology.orchestra.run.smithi012.stdout:(38/131): ceph-volume-18.0.0-4477.g8e854f7d.el8 1.5 MB/s | 258 kB 00:00 2023-07-07T18:12:02.997 INFO:teuthology.orchestra.run.smithi012.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 441 kB/s | 59 kB 00:00 2023-07-07T18:12:03.081 INFO:teuthology.orchestra.run.smithi012.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-07-07T18:12:03.106 INFO:teuthology.orchestra.run.smithi012.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 408 kB/s | 75 kB 00:00 2023-07-07T18:12:03.131 INFO:teuthology.orchestra.run.smithi012.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 867 kB/s | 44 kB 00:00 2023-07-07T18:12:03.181 INFO:teuthology.orchestra.run.smithi012.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 663 kB/s | 33 kB 00:00 2023-07-07T18:12:03.207 INFO:teuthology.orchestra.run.smithi012.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2023-07-07T18:12:03.232 INFO:teuthology.orchestra.run.smithi012.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-07-07T18:12:03.259 INFO:teuthology.orchestra.run.smithi012.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-07-07T18:12:03.283 INFO:teuthology.orchestra.run.smithi012.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-07-07T18:12:03.294 INFO:teuthology.orchestra.run.smithi160.stdout:(44/131): ceph-test-18.0.0-4477.g8e854f7d.el8.x 7.4 MB/s | 48 MB 00:06 2023-07-07T18:12:03.316 INFO:teuthology.orchestra.run.smithi012.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-07-07T18:12:03.319 INFO:teuthology.orchestra.run.smithi160.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 34 kB/s | 16 kB 00:00 2023-07-07T18:12:03.341 INFO:teuthology.orchestra.run.smithi012.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-07-07T18:12:03.367 INFO:teuthology.orchestra.run.smithi012.stdout:(50/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.4 MB/s | 384 kB 00:00 2023-07-07T18:12:03.378 INFO:teuthology.orchestra.run.smithi160.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 6.4 MB/s | 384 kB 00:00 2023-07-07T18:12:03.384 INFO:teuthology.orchestra.run.smithi012.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 262 kB/s | 18 kB 00:00 2023-07-07T18:12:03.417 INFO:teuthology.orchestra.run.smithi012.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 972 kB/s | 49 kB 00:00 2023-07-07T18:12:03.428 INFO:teuthology.orchestra.run.smithi160.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-07-07T18:12:03.443 INFO:teuthology.orchestra.run.smithi012.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-07-07T18:12:03.459 INFO:teuthology.orchestra.run.smithi012.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-07-07T18:12:03.470 INFO:teuthology.orchestra.run.smithi160.stdout:(48/131): python3-cheroot-8.5.2-1.el8.noarch.rp 984 kB/s | 173 kB 00:00 2023-07-07T18:12:03.493 INFO:teuthology.orchestra.run.smithi012.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 7.7 MB/s | 1.2 MB 00:00 2023-07-07T18:12:03.495 INFO:teuthology.orchestra.run.smithi160.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-07-07T18:12:03.521 INFO:teuthology.orchestra.run.smithi160.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2023-07-07T18:12:03.544 INFO:teuthology.orchestra.run.smithi012.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2023-07-07T18:12:03.560 INFO:teuthology.orchestra.run.smithi012.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 503 kB/s | 34 kB 00:00 2023-07-07T18:12:03.586 INFO:teuthology.orchestra.run.smithi012.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.9 MB/s | 283 kB 00:00 2023-07-07T18:12:03.602 INFO:teuthology.orchestra.run.smithi012.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.4 MB/s | 61 kB 00:00 2023-07-07T18:12:03.604 INFO:teuthology.orchestra.run.smithi160.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 584 kB/s | 49 kB 00:00 2023-07-07T18:12:03.628 INFO:teuthology.orchestra.run.smithi012.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2023-07-07T18:12:03.645 INFO:teuthology.orchestra.run.smithi012.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 319 kB/s | 19 kB 00:00 2023-07-07T18:12:03.655 INFO:teuthology.orchestra.run.smithi160.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-07-07T18:12:03.662 INFO:teuthology.orchestra.run.smithi012.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 407 kB/s | 24 kB 00:00 2023-07-07T18:12:03.679 INFO:teuthology.orchestra.run.smithi012.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 581 kB/s | 29 kB 00:00 2023-07-07T18:12:03.688 INFO:teuthology.orchestra.run.smithi160.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2023-07-07T18:12:03.713 INFO:teuthology.orchestra.run.smithi012.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 546 kB/s | 27 kB 00:00 2023-07-07T18:12:03.714 INFO:teuthology.orchestra.run.smithi160.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-07-07T18:12:03.738 INFO:teuthology.orchestra.run.smithi012.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-07-07T18:12:03.764 INFO:teuthology.orchestra.run.smithi012.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-07-07T18:12:03.788 INFO:teuthology.orchestra.run.smithi012.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 813 kB/s | 61 kB 00:00 2023-07-07T18:12:03.797 INFO:teuthology.orchestra.run.smithi160.stdout:(55/131): ceph-mgr-diskprediction-local-18.0.0- 2.8 MB/s | 7.4 MB 00:02 2023-07-07T18:12:03.813 INFO:teuthology.orchestra.run.smithi012.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-07-07T18:12:03.822 INFO:teuthology.orchestra.run.smithi160.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-07-07T18:12:03.839 INFO:teuthology.orchestra.run.smithi012.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-07-07T18:12:03.848 INFO:teuthology.orchestra.run.smithi160.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-07-07T18:12:03.880 INFO:teuthology.orchestra.run.smithi012.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 70 kB 00:00 2023-07-07T18:12:03.893 INFO:teuthology.orchestra.run.smithi160.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 353 kB/s | 34 kB 00:00 2023-07-07T18:12:03.922 INFO:teuthology.orchestra.run.smithi012.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-07-07T18:12:03.923 INFO:teuthology.orchestra.run.smithi160.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 817 kB/s | 61 kB 00:00 2023-07-07T18:12:03.949 INFO:teuthology.orchestra.run.smithi160.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 339 kB/s | 19 kB 00:00 2023-07-07T18:12:03.974 INFO:teuthology.orchestra.run.smithi160.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 478 kB/s | 24 kB 00:00 2023-07-07T18:12:03.999 INFO:teuthology.orchestra.run.smithi160.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2023-07-07T18:12:04.024 INFO:teuthology.orchestra.run.smithi160.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 549 kB/s | 27 kB 00:00 2023-07-07T18:12:04.050 INFO:teuthology.orchestra.run.smithi160.stdout:(64/131): python3-routes-2.4.1-12.el8.noarch.rp 866 kB/s | 196 kB 00:00 2023-07-07T18:12:04.075 INFO:teuthology.orchestra.run.smithi160.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-07-07T18:12:04.100 INFO:teuthology.orchestra.run.smithi160.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2023-07-07T18:12:04.126 INFO:teuthology.orchestra.run.smithi160.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 814 kB/s | 61 kB 00:00 2023-07-07T18:12:04.143 INFO:teuthology.orchestra.run.smithi160.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-07-07T18:12:04.167 INFO:teuthology.orchestra.run.smithi160.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 344 kB/s | 23 kB 00:00 2023-07-07T18:12:04.181 INFO:teuthology.orchestra.run.smithi012.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 217 kB/s | 54 kB 00:00 2023-07-07T18:12:04.213 INFO:teuthology.orchestra.run.smithi160.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.5 MB/s | 70 kB 00:00 2023-07-07T18:12:04.281 INFO:teuthology.orchestra.run.smithi012.stdout:(73/131): python3-pyasn1-modules-0.3.7-6.el8.no 275 kB/s | 110 kB 00:00 2023-07-07T18:12:04.326 INFO:teuthology.orchestra.run.smithi160.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 8.6 MB/s | 1.7 MB 00:00 2023-07-07T18:12:04.485 INFO:teuthology.orchestra.run.smithi160.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 413 kB/s | 110 kB 00:00 2023-07-07T18:12:04.549 INFO:teuthology.orchestra.run.smithi012.stdout:(74/131): python3-scipy-1.0.0-21.module+el8.5.0 19 MB/s | 14 MB 00:00 2023-07-07T18:12:04.574 INFO:teuthology.orchestra.run.smithi012.stdout:(75/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 661 kB/s | 259 kB 00:00 2023-07-07T18:12:04.600 INFO:teuthology.orchestra.run.smithi012.stdout:(76/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.0 MB/s | 323 kB 00:00 2023-07-07T18:12:04.644 INFO:teuthology.orchestra.run.smithi160.stdout:(73/131): python3-scipy-1.0.0-21.module+el8.5.0 29 MB/s | 14 MB 00:00 2023-07-07T18:12:04.669 INFO:teuthology.orchestra.run.smithi160.stdout:(74/131): python3-pytz-2017.2-9.el8.noarch.rpm 158 kB/s | 54 kB 00:00 2023-07-07T18:12:04.694 INFO:teuthology.orchestra.run.smithi160.stdout:(75/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.2 MB/s | 259 kB 00:00 2023-07-07T18:12:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:(77/131): python3-markupsafe-0.23-19.el8.x86_64 194 kB/s | 39 kB 00:00 2023-07-07T18:12:04.811 INFO:teuthology.orchestra.run.smithi160.stdout:(76/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2023-07-07T18:12:04.849 INFO:teuthology.orchestra.run.smithi012.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 2.4 MB/s | 688 kB 00:00 2023-07-07T18:12:04.861 INFO:teuthology.orchestra.run.smithi160.stdout:(77/131): python3-markupsafe-0.23-19.el8.x86_64 202 kB/s | 39 kB 00:00 2023-07-07T18:12:04.874 INFO:teuthology.orchestra.run.smithi012.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-07-07T18:12:04.903 INFO:teuthology.orchestra.run.smithi160.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 5.7 MB/s | 538 kB 00:00 2023-07-07T18:12:04.908 INFO:teuthology.orchestra.run.smithi012.stdout:(80/131): python3-jinja2-2.10.1-3.el8.noarch.rp 1.7 MB/s | 538 kB 00:00 2023-07-07T18:12:04.929 INFO:teuthology.orchestra.run.smithi160.stdout:(79/131): bison-3.0.4-10.el8.x86_64.rpm 2.9 MB/s | 688 kB 00:00 2023-07-07T18:12:04.987 INFO:teuthology.orchestra.run.smithi160.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-07-07T18:12:05.038 INFO:teuthology.orchestra.run.smithi160.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 6.4 MB/s | 713 kB 00:00 2023-07-07T18:12:05.042 INFO:teuthology.orchestra.run.smithi012.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 976 kB/s | 187 kB 00:00 2023-07-07T18:12:05.063 INFO:teuthology.orchestra.run.smithi160.stdout:(82/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2023-07-07T18:12:05.117 INFO:teuthology.orchestra.run.smithi012.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 354 kB/s | 27 kB 00:00 2023-07-07T18:12:05.150 INFO:teuthology.orchestra.run.smithi012.stdout:(83/131): automake-1.16.1-7.el8.noarch.rpm 2.5 MB/s | 713 kB 00:00 2023-07-07T18:12:05.196 INFO:teuthology.orchestra.run.smithi160.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 167 kB/s | 27 kB 00:00 2023-07-07T18:12:05.234 INFO:teuthology.orchestra.run.smithi012.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-07-07T18:12:05.259 INFO:teuthology.orchestra.run.smithi012.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 405 kB/s | 44 kB 00:00 2023-07-07T18:12:05.286 INFO:teuthology.orchestra.run.smithi012.stdout:(86/131): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2023-07-07T18:12:05.335 INFO:teuthology.orchestra.run.smithi012.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 5.9 MB/s | 457 kB 00:00 2023-07-07T18:12:05.369 INFO:teuthology.orchestra.run.smithi012.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.6 MB/s | 225 kB 00:00 2023-07-07T18:12:05.403 INFO:teuthology.orchestra.run.smithi012.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 959 kB/s | 64 kB 00:00 2023-07-07T18:12:05.427 INFO:teuthology.orchestra.run.smithi012.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-07-07T18:12:05.447 INFO:teuthology.orchestra.run.smithi160.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 833 kB/s | 320 kB 00:00 2023-07-07T18:12:05.472 INFO:teuthology.orchestra.run.smithi160.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 182 kB/s | 44 kB 00:00 2023-07-07T18:12:05.486 INFO:teuthology.orchestra.run.smithi012.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 239 kB/s | 20 kB 00:00 2023-07-07T18:12:05.545 INFO:teuthology.orchestra.run.smithi012.stdout:(92/131): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-07-07T18:12:05.570 INFO:teuthology.orchestra.run.smithi012.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 728 kB/s | 103 kB 00:00 2023-07-07T18:12:05.597 INFO:teuthology.orchestra.run.smithi160.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 7.8 MB/s | 4.8 MB 00:00 2023-07-07T18:12:05.604 INFO:teuthology.orchestra.run.smithi012.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2023-07-07T18:12:05.664 INFO:teuthology.orchestra.run.smithi160.stdout:(87/131): python3-numpy-1.14.3-10.el8.x86_64.rp 17 MB/s | 3.7 MB 00:00 2023-07-07T18:12:05.679 INFO:teuthology.orchestra.run.smithi012.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2023-07-07T18:12:05.690 INFO:teuthology.orchestra.run.smithi160.stdout:(88/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.1 MB/s | 457 kB 00:00 2023-07-07T18:12:05.715 INFO:teuthology.orchestra.run.smithi160.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-07-07T18:12:05.732 INFO:teuthology.orchestra.run.smithi160.stdout:(90/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-07-07T18:12:05.756 INFO:teuthology.orchestra.run.smithi012.stdout:(96/131): openblas-threads-0.3.15-3.el8.x86_64. 23 MB/s | 4.9 MB 00:00 2023-07-07T18:12:05.774 INFO:teuthology.orchestra.run.smithi160.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 341 kB/s | 20 kB 00:00 2023-07-07T18:12:05.799 INFO:teuthology.orchestra.run.smithi160.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-07-07T18:12:05.805 INFO:teuthology.orchestra.run.smithi012.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2023-07-07T18:12:05.841 INFO:teuthology.orchestra.run.smithi160.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 952 kB/s | 103 kB 00:00 2023-07-07T18:12:05.888 INFO:teuthology.orchestra.run.smithi012.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-07-07T18:12:05.891 INFO:teuthology.orchestra.run.smithi160.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2023-07-07T18:12:05.916 INFO:teuthology.orchestra.run.smithi160.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2023-07-07T18:12:05.955 INFO:teuthology.orchestra.run.smithi012.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-07-07T18:12:05.975 INFO:teuthology.orchestra.run.smithi160.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-07-07T18:12:06.005 INFO:teuthology.orchestra.run.smithi012.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-07-07T18:12:06.025 INFO:teuthology.orchestra.run.smithi160.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-07-07T18:12:06.064 INFO:teuthology.orchestra.run.smithi012.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-07-07T18:12:06.090 INFO:teuthology.orchestra.run.smithi012.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 559 kB/s | 47 kB 00:00 2023-07-07T18:12:06.102 INFO:teuthology.orchestra.run.smithi160.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-07-07T18:12:06.123 INFO:teuthology.orchestra.run.smithi012.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.3 MB/s | 200 kB 00:00 2023-07-07T18:12:06.156 INFO:teuthology.orchestra.run.smithi012.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 638 kB/s | 43 kB 00:00 2023-07-07T18:12:06.182 INFO:teuthology.orchestra.run.smithi012.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-07-07T18:12:06.209 INFO:teuthology.orchestra.run.smithi160.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-07-07T18:12:06.249 INFO:teuthology.orchestra.run.smithi012.stdout:(106/131): postgresql-server-10.21-2.module+el8 11 MB/s | 5.1 MB 00:00 2023-07-07T18:12:06.251 INFO:teuthology.orchestra.run.smithi160.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.3 MB/s | 808 kB 00:00 2023-07-07T18:12:06.274 INFO:teuthology.orchestra.run.smithi012.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 410 kB/s | 48 kB 00:00 2023-07-07T18:12:06.299 INFO:teuthology.orchestra.run.smithi012.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 741 kB/s | 87 kB 00:00 2023-07-07T18:12:06.301 INFO:teuthology.orchestra.run.smithi160.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-07-07T18:12:06.325 INFO:teuthology.orchestra.run.smithi012.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 565 kB/s | 43 kB 00:00 2023-07-07T18:12:06.327 INFO:teuthology.orchestra.run.smithi160.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 623 kB/s | 47 kB 00:00 2023-07-07T18:12:06.391 INFO:teuthology.orchestra.run.smithi012.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 933 kB/s | 109 kB 00:00 2023-07-07T18:12:06.410 INFO:teuthology.orchestra.run.smithi160.stdout:(103/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-07-07T18:12:06.435 INFO:teuthology.orchestra.run.smithi160.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 392 kB/s | 43 kB 00:00 2023-07-07T18:12:06.442 INFO:teuthology.orchestra.run.smithi012.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-07-07T18:12:06.461 INFO:teuthology.orchestra.run.smithi160.stdout:(105/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.2 MB/s | 200 kB 00:00 2023-07-07T18:12:06.467 INFO:teuthology.orchestra.run.smithi012.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 248 kB/s | 19 kB 00:00 2023-07-07T18:12:06.492 INFO:teuthology.orchestra.run.smithi012.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-07-07T18:12:06.519 INFO:teuthology.orchestra.run.smithi160.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-07-07T18:12:06.526 INFO:teuthology.orchestra.run.smithi012.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.8 MB/s | 155 kB 00:00 2023-07-07T18:12:06.545 INFO:teuthology.orchestra.run.smithi160.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 441 kB/s | 48 kB 00:00 2023-07-07T18:12:06.568 INFO:teuthology.orchestra.run.smithi012.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 5.4 MB/s | 559 kB 00:00 2023-07-07T18:12:06.570 INFO:teuthology.orchestra.run.smithi160.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 800 kB/s | 87 kB 00:00 2023-07-07T18:12:06.587 INFO:teuthology.orchestra.run.smithi160.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 635 kB/s | 43 kB 00:00 2023-07-07T18:12:06.593 INFO:teuthology.orchestra.run.smithi012.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 178 kB/s | 18 kB 00:00 2023-07-07T18:12:06.612 INFO:teuthology.orchestra.run.smithi160.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.6 MB/s | 109 kB 00:00 2023-07-07T18:12:06.627 INFO:teuthology.orchestra.run.smithi012.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-07-07T18:12:06.638 INFO:teuthology.orchestra.run.smithi160.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2023-07-07T18:12:06.661 INFO:teuthology.orchestra.run.smithi012.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-07-07T18:12:06.671 INFO:teuthology.orchestra.run.smithi160.stdout:(112/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.5 MB/s | 560 kB 00:00 2023-07-07T18:12:06.688 INFO:teuthology.orchestra.run.smithi160.stdout:(113/131): libaio-devel-0.3.112-1.el8.x86_64.rp 247 kB/s | 19 kB 00:00 2023-07-07T18:12:06.714 INFO:teuthology.orchestra.run.smithi160.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.0 MB/s | 155 kB 00:00 2023-07-07T18:12:06.727 INFO:teuthology.orchestra.run.smithi012.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 17 MB/s | 2.3 MB 00:00 2023-07-07T18:12:06.730 INFO:teuthology.orchestra.run.smithi160.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 429 kB/s | 18 kB 00:00 2023-07-07T18:12:06.753 INFO:teuthology.orchestra.run.smithi012.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 576 kB/s | 72 kB 00:00 2023-07-07T18:12:06.764 INFO:teuthology.orchestra.run.smithi160.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 5.9 MB/s | 559 kB 00:00 2023-07-07T18:12:06.778 INFO:teuthology.orchestra.run.smithi012.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 707 kB/s | 83 kB 00:00 2023-07-07T18:12:06.798 INFO:teuthology.orchestra.run.smithi160.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.1 MB/s | 605 kB 00:00 2023-07-07T18:12:06.812 INFO:teuthology.orchestra.run.smithi012.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 715 kB/s | 60 kB 00:00 2023-07-07T18:12:06.839 INFO:teuthology.orchestra.run.smithi160.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.1 MB/s | 238 kB 00:00 2023-07-07T18:12:06.912 INFO:teuthology.orchestra.run.smithi012.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 432 kB/s | 58 kB 00:00 2023-07-07T18:12:06.915 INFO:teuthology.orchestra.run.smithi160.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 15 MB/s | 2.3 MB 00:00 2023-07-07T18:12:06.940 INFO:teuthology.orchestra.run.smithi160.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 509 kB/s | 72 kB 00:00 2023-07-07T18:12:06.946 INFO:teuthology.orchestra.run.smithi012.stdout:(124/131): libuuid-devel-2.32.1-35.el8.x86_64.r 509 kB/s | 98 kB 00:00 2023-07-07T18:12:06.966 INFO:teuthology.orchestra.run.smithi160.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-07-07T18:12:06.971 INFO:teuthology.orchestra.run.smithi012.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 242 kB/s | 39 kB 00:00 2023-07-07T18:12:06.991 INFO:teuthology.orchestra.run.smithi160.stdout:(122/131): fuse-2.9.7-15.el8.x86_64.rpm 549 kB/s | 83 kB 00:00 2023-07-07T18:12:07.016 INFO:teuthology.orchestra.run.smithi160.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.3 MB/s | 98 kB 00:00 2023-07-07T18:12:07.021 INFO:teuthology.orchestra.run.smithi012.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.2 MB/s | 171 kB 00:00 2023-07-07T18:12:07.041 INFO:teuthology.orchestra.run.smithi160.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 767 kB/s | 58 kB 00:00 2023-07-07T18:12:07.055 INFO:teuthology.orchestra.run.smithi012.stdout:(127/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.4 MB/s | 644 kB 00:00 2023-07-07T18:12:07.066 INFO:teuthology.orchestra.run.smithi160.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 511 kB/s | 39 kB 00:00 2023-07-07T18:12:07.100 INFO:teuthology.orchestra.run.smithi160.stdout:(126/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 7.5 MB/s | 644 kB 00:00 2023-07-07T18:12:07.163 INFO:teuthology.orchestra.run.smithi012.stdout:(128/131): NetworkManager-initscripts-updown-1. 717 kB/s | 138 kB 00:00 2023-07-07T18:12:07.175 INFO:teuthology.orchestra.run.smithi160.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.2 MB/s | 138 kB 00:00 2023-07-07T18:12:07.201 INFO:teuthology.orchestra.run.smithi160.stdout:(128/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.0 MB/s | 171 kB 00:00 2023-07-07T18:12:07.522 INFO:teuthology.orchestra.run.smithi012.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 2.2 MB/s | 798 kB 00:00 2023-07-07T18:12:07.589 INFO:teuthology.orchestra.run.smithi012.stdout:(130/131): librados2-18.0.0-4477.g8e854f7d.el8. 6.4 MB/s | 3.7 MB 00:00 2023-07-07T18:12:07.626 INFO:teuthology.orchestra.run.smithi160.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 1.8 MB/s | 798 kB 00:00 2023-07-07T18:12:07.676 INFO:teuthology.orchestra.run.smithi160.stdout:(130/131): librbd1-18.0.0-4477.g8e854f7d.el8.x8 7.1 MB/s | 3.6 MB 00:00 2023-07-07T18:12:07.739 INFO:teuthology.orchestra.run.smithi012.stdout:(131/131): librbd1-18.0.0-4477.g8e854f7d.el8.x8 5.2 MB/s | 3.6 MB 00:00 2023-07-07T18:12:07.742 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-07-07T18:12:07.742 INFO:teuthology.orchestra.run.smithi012.stdout:Total 13 MB/s | 205 MB 00:16 2023-07-07T18:12:08.113 INFO:teuthology.orchestra.run.smithi160.stdout:(131/131): librados2-18.0.0-4477.g8e854f7d.el8. 3.6 MB/s | 3.7 MB 00:01 2023-07-07T18:12:08.115 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2023-07-07T18:12:08.115 INFO:teuthology.orchestra.run.smithi160.stdout:Total 9.3 MB/s | 205 MB 00:22 2023-07-07T18:12:08.609 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-07-07T18:12:08.741 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-07-07T18:12:08.741 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-07-07T18:12:08.948 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2023-07-07T18:12:09.068 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2023-07-07T18:12:09.068 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2023-07-07T18:12:09.930 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-07-07T18:12:09.934 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-07-07T18:12:10.206 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2023-07-07T18:12:10.210 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2023-07-07T18:12:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-07-07T18:12:15.300 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-07T18:12:15.439 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2023-07-07T18:12:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-07T18:12:15.622 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-07T18:12:15.702 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-07T18:12:15.783 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-07T18:12:15.868 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-07T18:12:16.026 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-07T18:12:16.235 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-07T18:12:16.249 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-07T18:12:16.425 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-07T18:12:16.597 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-07T18:12:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-07T18:12:16.791 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-07T18:12:16.993 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:18.0.0-4477.g8e854f7d.el8.x86_64 6/134 2023-07-07T18:12:17.208 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-07T18:12:17.399 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:18.0.0-4477.g8e854f7d.el8.x86_64 6/134 2023-07-07T18:12:17.413 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:18.0.0-4477.g8e854f7d.el8.x86_64 6/134 2023-07-07T18:12:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:18.0.0-4477.g8e854f7d.el8.x86_64 7/134 2023-07-07T18:12:17.762 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:18.0.0-4477.g8e854f7d.el8.x86_64 7/134 2023-07-07T18:12:17.819 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:18.0.0-4477.g8e854f7d.el8.x86_64 6/134 2023-07-07T18:12:18.007 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:18.0.0-4477.g8e854f7d.el8.x86_64 7/134 2023-07-07T18:12:18.117 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:18.0.0-4477.g8e854f7d.el8.x86_64 7/134 2023-07-07T18:12:18.307 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:18.0.0-4477.g8e854f7d.el8.x86_64 8/134 2023-07-07T18:12:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:18.0.0-4477.g8e854f7d.el8.x86_64 8/134 2023-07-07T18:12:18.405 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:18.0.0-4477.g8e854f7d.el8.x86_64 8/134 2023-07-07T18:12:18.417 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:18.0.0-4477.g8e854f7d.el8.x86_64 8/134 2023-07-07T18:12:18.621 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:18.0.0-4477.g8e854f7d.el8.x86_64 9/134 2023-07-07T18:12:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:18.0.0-4477.g8e854f7d.el8.x86_64 9/134 2023-07-07T18:12:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-07T18:12:18.886 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-07T18:12:19.093 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-07T18:12:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-07T18:12:19.526 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-07T18:12:19.534 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-07T18:12:19.769 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-07T18:12:19.802 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-07T18:12:19.948 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:18.0.0-4477.g8e854f7d.el8.x86_64 14/134 2023-07-07T18:12:19.984 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:18.0.0-4477.g8e854f7d.el8.x86_64 14/134 2023-07-07T18:12:20.053 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4477.g8e854f7d.el8.x86_64 14/134 2023-07-07T18:12:20.089 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4477.g8e854f7d.el8.x86_64 14/134 2023-07-07T18:12:20.240 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:18.0.0-4477.g8e854f7d.el8.x86 15/134 2023-07-07T18:12:20.259 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:18.0.0-4477.g8e854f7d.el8.x86 15/134 2023-07-07T18:12:20.302 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4477.g8e854f7d.el8.x86 15/134 2023-07-07T18:12:20.388 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4477.g8e854f7d.el8.x86 15/134 2023-07-07T18:12:20.440 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-07T18:12:20.517 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-07T18:12:20.581 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-07T18:12:20.662 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-07T18:12:20.726 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-07T18:12:20.825 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-07T18:12:21.342 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-07T18:12:21.464 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-07T18:12:21.548 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-07T18:12:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-07T18:12:22.134 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-07T18:12:22.270 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-07T18:12:22.289 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-07T18:12:22.458 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-07T18:12:23.033 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-07T18:12:23.221 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-07T18:12:23.338 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-07T18:12:23.498 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-07T18:12:23.567 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-07T18:12:23.794 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-07T18:12:23.996 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-07T18:12:24.056 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-07T18:12:24.197 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-07T18:12:24.347 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-07T18:12:24.433 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-07T18:12:24.526 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-07T18:12:24.629 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:18.0.0-4477.g8e854f7d.el8. 26/134 2023-07-07T18:12:24.750 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:18.0.0-4477.g8e854f7d.el 27/134 2023-07-07T18:12:24.767 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-07T18:12:25.000 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-07T18:12:25.190 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:18.0.0-4477.g8e854f7d.el8. 26/134 2023-07-07T18:12:25.304 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:18.0.0-4477.g8e854f7d.el 27/134 2023-07-07T18:12:25.668 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:18.0.0-4477.g8e854f7d.el8.x86_6 28/134 2023-07-07T18:12:25.947 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-07T18:12:26.217 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-07T18:12:26.264 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:18.0.0-4477.g8e854f7d.el8.x86_6 28/134 2023-07-07T18:12:26.466 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-07T18:12:26.589 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-07T18:12:26.691 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-07T18:12:26.872 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-07T18:12:27.178 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-07T18:12:27.415 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-07T18:12:28.453 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-07T18:12:28.768 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-07T18:12:28.968 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-07T18:12:29.183 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-07T18:12:29.280 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-07T18:12:29.344 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 36/134 2023-07-07T18:12:29.509 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:18.0.0-4477.g8e854f7d.el8.x86_6 37/134 2023-07-07T18:12:29.619 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-07T18:12:29.641 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-07T18:12:29.829 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-07T18:12:29.871 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-07T18:12:30.024 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-07T18:12:30.044 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-07T18:12:30.192 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-07T18:12:30.213 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 36/134 2023-07-07T18:12:30.364 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-07T18:12:30.419 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:18.0.0-4477.g8e854f7d.el8.x86_6 37/134 2023-07-07T18:12:30.568 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-07T18:12:30.577 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-07T18:12:30.762 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-07T18:12:30.943 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-07T18:12:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-07T18:12:31.103 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-07T18:12:31.217 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-07T18:12:31.341 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-07T18:12:31.424 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-07T18:12:31.550 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-07T18:12:31.619 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-07T18:12:31.877 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-07T18:12:31.909 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-07T18:12:32.203 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-07T18:12:32.225 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-07T18:12:32.418 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-07T18:12:32.496 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-07T18:12:32.644 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-07T18:12:32.736 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-07T18:12:32.896 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-07T18:12:32.952 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-07T18:12:33.167 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-07T18:12:33.216 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-07T18:12:33.300 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-07T18:12:33.473 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-07T18:12:33.688 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-07T18:12:33.701 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-07T18:12:33.918 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-07T18:12:33.924 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-07T18:12:34.103 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-07T18:12:34.168 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-07T18:12:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-07T18:12:34.403 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-07T18:12:34.587 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-07T18:12:34.598 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-07T18:12:34.756 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-07T18:12:34.861 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-07T18:12:34.929 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-07T18:12:35.023 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-07T18:12:35.148 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-07T18:12:35.227 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-07T18:12:35.379 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-07T18:12:35.424 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-07T18:12:35.588 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-07T18:12:35.589 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-07T18:12:35.693 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-07T18:12:35.742 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-07T18:12:35.908 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-07T18:12:35.913 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-07T18:12:35.975 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-07T18:12:36.105 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-07T18:12:36.256 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-07T18:12:36.304 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-07T18:12:36.482 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-07T18:12:36.498 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-07T18:12:36.663 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-07T18:12:36.738 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-07T18:12:36.783 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-07T18:12:36.964 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-07T18:12:37.028 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-07T18:12:37.157 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-07T18:12:37.192 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-07T18:12:37.331 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-07T18:12:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-07T18:12:37.537 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-07T18:12:37.556 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-07T18:12:37.785 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-07T18:12:37.817 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-07T18:12:37.983 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-07T18:12:38.046 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-07T18:12:38.124 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-07T18:12:38.185 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-07T18:12:38.294 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-07T18:12:38.317 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-07T18:12:38.486 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-07T18:12:38.560 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-07T18:12:38.708 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-07T18:12:38.778 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-07T18:12:38.935 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-07T18:12:39.002 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-07T18:12:39.158 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-07T18:12:39.195 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-07T18:12:39.311 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-07T18:12:39.445 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-07T18:12:39.597 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-07T18:12:39.645 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-07T18:12:39.809 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-07T18:12:39.894 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-07T18:12:40.027 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-07T18:12:40.266 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-07T18:12:40.538 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-07T18:12:40.706 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-07T18:12:40.964 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-07T18:12:40.979 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-07T18:12:41.249 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-07T18:12:41.512 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-07T18:12:41.799 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-07T18:12:42.131 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-07T18:12:42.136 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-07T18:12:42.321 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-07T18:12:42.552 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-07T18:12:42.839 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-07T18:12:43.125 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-07T18:12:43.133 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-07T18:12:43.278 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:18.0.0-4477.g8e854f7d.el8.x86_64 92/134 2023-07-07T18:12:43.352 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:18.0.0-4477.g8e854f7d.el8.x86_64 92/134 2023-07-07T18:12:43.427 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-07T18:12:43.557 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 93/134 2023-07-07T18:12:43.621 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-07T18:12:44.487 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-07T18:12:44.720 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:18.0.0-4477.g8e854f7d.el8.x86_64 92/134 2023-07-07T18:12:44.798 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:18.0.0-4477.g8e854f7d.el8.x86_64 92/134 2023-07-07T18:12:44.970 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 93/134 2023-07-07T18:12:47.263 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 94/134 2023-07-07T18:12:47.886 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 94/134 2023-07-07T18:12:48.498 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 94/134 2023-07-07T18:12:48.771 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 94/134 2023-07-07T18:12:48.816 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:18.0.0-4477.g8e854f7d.el8.x86_64 95/134 2023-07-07T18:12:48.894 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:18.0.0-4477.g8e854f7d.el8.x86_64 95/134 2023-07-07T18:12:48.969 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 94/134 2023-07-07T18:12:49.053 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:18.0.0-4477.g8e854f7d.el8.x86_64 96/134 2023-07-07T18:12:49.589 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 94/134 2023-07-07T18:12:50.639 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:18.0.0-4477.g8e854f7d.el8.x86_64 95/134 2023-07-07T18:12:50.729 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:18.0.0-4477.g8e854f7d.el8.x86_64 95/134 2023-07-07T18:12:50.860 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:18.0.0-4477.g8e854f7d.el8.x86_64 96/134 2023-07-07T18:13:07.990 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4477.g8e854f7d.el8.x86_64 96/134 2023-07-07T18:13:07.990 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2023-07-07T18:13:07.990 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2023-07-07T18:13:07.991 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2023-07-07T18:13:07.991 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /run 2023-07-07T18:13:07.991 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2023-07-07T18:13:07.991 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2023-07-07T18:13:07.991 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2023-07-07T18:13:07.991 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2023-07-07T18:13:07.991 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2023-07-07T18:13:07.992 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:08.316 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:18.0.0-4477.g8e854f7d.el8.noarch 97/134 2023-07-07T18:13:09.888 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:18.0.0-4477.g8e854f7d.el8.noarch 97/134 2023-07-07T18:13:10.088 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:18.0.0-4477.g8e854f7d.el8.x86_64 98/134 2023-07-07T18:13:10.306 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:18.0.0-4477.g8e854f7d.el8.x86_64 98/134 2023-07-07T18:13:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4477.g8e854f7d.el8.x86_64 96/134 2023-07-07T18:13:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2023-07-07T18:13:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2023-07-07T18:13:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /dev 2023-07-07T18:13:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /run 2023-07-07T18:13:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2023-07-07T18:13:10.399 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2023-07-07T18:13:10.399 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2023-07-07T18:13:10.399 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2023-07-07T18:13:10.399 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /dev 2023-07-07T18:13:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:10.474 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:18.0.0-4477.g8e854f7d.el8.x86_64 99/134 2023-07-07T18:13:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:18.0.0-4477.g8e854f7d.el8.noarch 97/134 2023-07-07T18:13:10.924 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:18.0.0-4477.g8e854f7d.el8.x86_64 99/134 2023-07-07T18:13:11.142 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:18.0.0-4477.g8e854f7d.el8.x86_64 100/134 2023-07-07T18:13:11.158 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:18.0.0-4477.g8e854f7d.el8.x86_64 100/134 2023-07-07T18:13:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:18.0.0-4477.g8e854f7d.el8.noarch 97/134 2023-07-07T18:13:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:18.0.0-4477.g8e854f7d.el8.x86_64 98/134 2023-07-07T18:13:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:18.0.0-4477.g8e854f7d.el8.x86_64 98/134 2023-07-07T18:13:12.848 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 101/134 2023-07-07T18:13:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:18.0.0-4477.g8e854f7d.el8.x86_64 99/134 2023-07-07T18:13:13.073 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 101/134 2023-07-07T18:13:13.196 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4477.g8e854f7d.e 102/134 2023-07-07T18:13:13.405 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4477.g8e854f7d. 103/134 2023-07-07T18:13:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:18.0.0-4477.g8e854f7d.el8.x86_64 99/134 2023-07-07T18:13:13.632 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4477.g8e854f7d.el8.noa 104/134 2023-07-07T18:13:13.664 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:18.0.0-4477.g8e854f7d.el8.x86_64 100/134 2023-07-07T18:13:13.682 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:18.0.0-4477.g8e854f7d.el8.x86_64 100/134 2023-07-07T18:13:13.848 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4477.g8e854f7d.el8.noa 104/134 2023-07-07T18:13:14.129 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4477.g8e854f7d.el8.n 105/134 2023-07-07T18:13:15.090 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4477.g8e854f7d.el8.n 105/134 2023-07-07T18:13:15.256 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4477.g8e8 106/134 2023-07-07T18:13:15.347 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4477.g8e8 106/134 2023-07-07T18:13:15.466 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 101/134 2023-07-07T18:13:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 101/134 2023-07-07T18:13:15.766 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4477.g8e854f7d.el 107/134 2023-07-07T18:13:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4477.g8e854f7d.e 102/134 2023-07-07T18:13:15.971 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:18.0.0-4477.g8e854f7d.el8.x86_64 108/134 2023-07-07T18:13:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4477.g8e854f7d. 103/134 2023-07-07T18:13:16.006 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4477.g8e854f7d.el8.x86_64 108/134 2023-07-07T18:13:16.204 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4477.g8e854f7d.el8.noa 104/134 2023-07-07T18:13:16.231 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:18.0.0-4477.g8e854f7d.el8.noarch 109/134 2023-07-07T18:13:16.243 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4477.g8e854f7d.el8.noarch 109/134 2023-07-07T18:13:16.427 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4477.g8e854f7d.el8.noa 104/134 2023-07-07T18:13:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4477.g8e854f7d.el8.n 105/134 2023-07-07T18:13:17.538 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:18.0.0-4477.g8e854f7d.el8.x86_64 110/134 2023-07-07T18:13:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4477.g8e854f7d.el8.n 105/134 2023-07-07T18:13:17.822 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 111/134 2023-07-07T18:13:17.863 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 111/134 2023-07-07T18:13:17.962 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4477.g8e8 106/134 2023-07-07T18:13:18.023 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4477.g8e854 112/134 2023-07-07T18:13:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4477.g8e8 106/134 2023-07-07T18:13:18.065 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4477.g8e854 112/134 2023-07-07T18:13:18.248 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 113/134 2023-07-07T18:13:18.445 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4477.g8e854f7d.el 107/134 2023-07-07T18:13:18.592 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 113/134 2023-07-07T18:13:18.649 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:18.0.0-4477.g8e854f7d.el8.x86_64 108/134 2023-07-07T18:13:18.686 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4477.g8e854f7d.el8.x86_64 108/134 2023-07-07T18:13:18.790 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 114/134 2023-07-07T18:13:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:18.0.0-4477.g8e854f7d.el8.noarch 109/134 2023-07-07T18:13:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4477.g8e854f7d.el8.noarch 109/134 2023-07-07T18:13:20.310 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:18.0.0-4477.g8e854f7d.el8.x86_64 110/134 2023-07-07T18:13:20.533 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 111/134 2023-07-07T18:13:20.573 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 111/134 2023-07-07T18:13:20.879 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4477.g8e854 112/134 2023-07-07T18:13:20.928 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4477.g8e854 112/134 2023-07-07T18:13:21.062 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 113/134 2023-07-07T18:13:21.429 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 113/134 2023-07-07T18:13:21.695 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 114/134 2023-07-07T18:13:23.312 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 114/134 2023-07-07T18:13:23.587 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:18.0.0-4477.g8e854f7d.el8.x86_64 115/134 2023-07-07T18:13:23.747 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-07T18:13:23.938 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-07T18:13:24.822 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-07T18:13:25.144 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-07T18:13:25.317 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 119/134 2023-07-07T18:13:25.517 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-07T18:13:25.676 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:18.0.0-4477.g8e854f7d.el8.x86_ 121/134 2023-07-07T18:13:25.848 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-07T18:13:26.541 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 114/134 2023-07-07T18:13:26.816 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:18.0.0-4477.g8e854f7d.el8.x86_64 115/134 2023-07-07T18:13:27.127 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-07T18:13:27.333 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-07T18:13:28.028 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-07T18:13:28.280 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-07T18:13:28.298 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-07T18:13:28.311 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-07T18:13:28.488 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:18.0.0-4477.g8e854f7d.el8.noarch 124/134 2023-07-07T18:13:28.780 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-07T18:13:28.787 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 125/134 2023-07-07T18:13:28.939 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 119/134 2023-07-07T18:13:29.065 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 126/134 2023-07-07T18:13:29.164 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-07T18:13:29.348 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:18.0.0-4477.g8e854f7d.el8.x86_ 121/134 2023-07-07T18:13:29.439 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-07T18:13:29.527 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-07T18:13:29.579 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-07T18:13:29.590 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-07T18:13:29.782 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-07T18:13:29.937 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-07T18:13:30.026 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-07T18:13:30.221 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-07T18:13:30.233 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-07T18:13:30.234 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-07T18:13:30.465 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-07T18:13:30.466 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-07T18:13:30.749 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-07T18:13:30.936 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-07T18:13:31.473 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-07T18:13:31.473 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:18.0.0-4477.g8e854f7d.el8.x86_64 1/134 2023-07-07T18:13:31.473 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:18.0.0-4477.g8e854f7d.el8.x86_64 2/134 2023-07-07T18:13:31.473 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 3/134 2023-07-07T18:13:31.474 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 4/134 2023-07-07T18:13:31.474 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4477.g8e854 5/134 2023-07-07T18:13:31.474 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:18.0.0-4477.g8e854f7d.el8.x86_64 6/134 2023-07-07T18:13:31.474 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:18.0.0-4477.g8e854f7d.el8.x86_64 7/134 2023-07-07T18:13:31.474 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:18.0.0-4477.g8e854f7d.el8.x86_64 8/134 2023-07-07T18:13:31.474 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:18.0.0-4477.g8e854f7d.el8.x86_64 9/134 2023-07-07T18:13:31.474 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 10/134 2023-07-07T18:13:31.474 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:18.0.0-4477.g8e854f7d.el8.x86_64 11/134 2023-07-07T18:13:31.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:18.0.0-4477.g8e854f7d.el8.x86_64 12/134 2023-07-07T18:13:31.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 13/134 2023-07-07T18:13:31.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:18.0.0-4477.g8e854f7d.el8.x86_ 14/134 2023-07-07T18:13:31.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:18.0.0-4477.g8e854f7d.el8.x86_64 15/134 2023-07-07T18:13:31.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:18.0.0-4477.g8e854f7d.el8.x86_64 16/134 2023-07-07T18:13:31.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:18.0.0-4477.g8e854f7d.el8.x86_6 17/134 2023-07-07T18:13:31.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:18.0.0-4477.g8e854f7d.el8.x86 18/134 2023-07-07T18:13:31.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:18.0.0-4477.g8e854f7d.el8.x86_64 19/134 2023-07-07T18:13:31.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4477.g8e854f7d.el 20/134 2023-07-07T18:13:31.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:18.0.0-4477.g8e854f7d.el8. 21/134 2023-07-07T18:13:31.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:18.0.0-4477.g8e854f7d.el8.x86_6 22/134 2023-07-07T18:13:31.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:18.0.0-4477.g8e854f7d.el8.x86_64 23/134 2023-07-07T18:13:31.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 24/134 2023-07-07T18:13:31.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 25/134 2023-07-07T18:13:31.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 26/134 2023-07-07T18:13:31.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 27/134 2023-07-07T18:13:31.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 28/134 2023-07-07T18:13:31.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4477.g8e854f7d. 29/134 2023-07-07T18:13:31.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4477.g8e854f7d.el8.noa 30/134 2023-07-07T18:13:31.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4477.g8e854f7d.el8.n 31/134 2023-07-07T18:13:31.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4477.g8e8 32/134 2023-07-07T18:13:31.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4477.g8e854f7d.el 33/134 2023-07-07T18:13:31.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4477.g8e854f7d.el8.noarch 34/134 2023-07-07T18:13:31.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4477.g8e854f7d.e 35/134 2023-07-07T18:13:31.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:18.0.0-4477.g8e854f7d.el8.noarch 36/134 2023-07-07T18:13:31.486 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 37/134 2023-07-07T18:13:31.486 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:18.0.0-4477.g8e854f7d.el8.noarch 38/134 2023-07-07T18:13:31.486 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-07T18:13:31.486 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-07T18:13:31.486 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-07T18:13:31.486 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-07T18:13:31.486 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-07T18:13:31.487 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-07T18:13:31.487 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-07T18:13:31.487 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-07T18:13:31.487 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-07T18:13:31.487 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-07T18:13:31.487 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-07T18:13:31.487 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-07T18:13:31.488 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-07T18:13:31.488 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-07T18:13:31.488 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-07T18:13:31.488 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-07T18:13:31.488 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-07T18:13:31.488 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-07T18:13:31.488 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-07T18:13:31.488 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-07T18:13:31.489 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-07T18:13:31.489 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-07T18:13:31.489 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-07T18:13:31.489 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-07T18:13:31.490 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-07T18:13:31.490 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-07T18:13:31.490 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-07T18:13:31.490 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-07T18:13:31.491 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-07T18:13:31.491 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-07T18:13:31.491 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-07T18:13:31.492 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-07T18:13:31.492 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-07T18:13:31.492 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-07T18:13:31.492 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-07T18:13:31.493 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-07T18:13:31.493 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-07T18:13:31.493 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-07T18:13:31.494 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-07T18:13:31.494 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-07T18:13:31.494 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-07T18:13:31.494 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-07T18:13:31.495 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-07T18:13:31.495 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-07T18:13:31.495 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-07T18:13:31.496 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-07T18:13:31.496 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-07T18:13:31.496 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-07T18:13:31.496 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-07T18:13:31.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-07T18:13:31.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-07T18:13:31.497 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-07T18:13:31.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-07T18:13:31.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-07T18:13:31.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-07T18:13:31.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-07T18:13:31.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-07T18:13:31.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-07T18:13:31.498 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-07T18:13:31.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-07T18:13:31.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-07T18:13:31.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-07T18:13:31.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-07T18:13:31.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-07T18:13:31.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-07T18:13:31.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-07T18:13:31.499 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-07T18:13:31.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-07T18:13:31.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-07T18:13:31.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-07T18:13:31.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-07T18:13:31.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-07T18:13:31.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-07T18:13:31.500 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-07T18:13:31.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-07T18:13:31.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-07T18:13:31.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-07T18:13:31.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-07T18:13:31.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-07T18:13:31.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-07T18:13:31.501 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-07T18:13:31.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-07T18:13:31.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-07T18:13:31.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-07T18:13:31.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-07T18:13:31.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-07T18:13:31.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-07T18:13:31.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-07T18:13:31.502 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-07T18:13:31.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-07T18:13:31.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:18.0.0-4477.g8e854f7d.el8.x86_64 129/134 2023-07-07T18:13:31.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-07T18:13:31.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:18.0.0-4477.g8e854f7d.el8.x86_64 131/134 2023-07-07T18:13:31.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-07T18:13:31.503 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-07T18:13:31.877 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-07T18:13:32.118 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-07T18:13:32.138 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-07T18:13:32.301 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:18.0.0-4477.g8e854f7d.el8.noarch 124/134 2023-07-07T18:13:32.743 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 125/134 2023-07-07T18:13:33.092 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 126/134 2023-07-07T18:13:33.428 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-07T18:13:33.559 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-07T18:13:33.569 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-07T18:13:33.735 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-07T18:13:33.934 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-07T18:13:34.025 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-07T18:13:34.242 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-07T18:13:34.257 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-07T18:13:34.258 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-07T18:13:34.387 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-07T18:13:34.388 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:02:00 ago on Fri 07 Jul 2023 06:11:34 PM UTC. 2023-07-07T18:13:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-07T18:13:34.496 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-07T18:13:34.758 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-07T18:13:34.959 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-07T18:13:35.493 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-07T18:13:35.494 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:18.0.0-4477.g8e854f7d.el8.x86_64 1/134 2023-07-07T18:13:35.494 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:18.0.0-4477.g8e854f7d.el8.x86_64 2/134 2023-07-07T18:13:35.494 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 3/134 2023-07-07T18:13:35.498 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 4/134 2023-07-07T18:13:35.498 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4477.g8e854 5/134 2023-07-07T18:13:35.498 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:18.0.0-4477.g8e854f7d.el8.x86_64 6/134 2023-07-07T18:13:35.498 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:18.0.0-4477.g8e854f7d.el8.x86_64 7/134 2023-07-07T18:13:35.498 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:18.0.0-4477.g8e854f7d.el8.x86_64 8/134 2023-07-07T18:13:35.498 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:18.0.0-4477.g8e854f7d.el8.x86_64 9/134 2023-07-07T18:13:35.499 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 10/134 2023-07-07T18:13:35.499 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:18.0.0-4477.g8e854f7d.el8.x86_64 11/134 2023-07-07T18:13:35.499 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:18.0.0-4477.g8e854f7d.el8.x86_64 12/134 2023-07-07T18:13:35.499 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 13/134 2023-07-07T18:13:35.499 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:18.0.0-4477.g8e854f7d.el8.x86_ 14/134 2023-07-07T18:13:35.499 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:18.0.0-4477.g8e854f7d.el8.x86_64 15/134 2023-07-07T18:13:35.499 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:18.0.0-4477.g8e854f7d.el8.x86_64 16/134 2023-07-07T18:13:35.500 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:18.0.0-4477.g8e854f7d.el8.x86_6 17/134 2023-07-07T18:13:35.500 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:18.0.0-4477.g8e854f7d.el8.x86 18/134 2023-07-07T18:13:35.500 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:18.0.0-4477.g8e854f7d.el8.x86_64 19/134 2023-07-07T18:13:35.500 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4477.g8e854f7d.el 20/134 2023-07-07T18:13:35.500 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:18.0.0-4477.g8e854f7d.el8. 21/134 2023-07-07T18:13:35.500 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:18.0.0-4477.g8e854f7d.el8.x86_6 22/134 2023-07-07T18:13:35.500 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:18.0.0-4477.g8e854f7d.el8.x86_64 23/134 2023-07-07T18:13:35.501 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 24/134 2023-07-07T18:13:35.501 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 25/134 2023-07-07T18:13:35.501 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 26/134 2023-07-07T18:13:35.501 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 27/134 2023-07-07T18:13:35.501 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 28/134 2023-07-07T18:13:35.501 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4477.g8e854f7d. 29/134 2023-07-07T18:13:35.501 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4477.g8e854f7d.el8.noa 30/134 2023-07-07T18:13:35.502 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4477.g8e854f7d.el8.n 31/134 2023-07-07T18:13:35.502 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4477.g8e8 32/134 2023-07-07T18:13:35.502 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4477.g8e854f7d.el 33/134 2023-07-07T18:13:35.502 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4477.g8e854f7d.el8.noarch 34/134 2023-07-07T18:13:35.502 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4477.g8e854f7d.e 35/134 2023-07-07T18:13:35.502 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:18.0.0-4477.g8e854f7d.el8.noarch 36/134 2023-07-07T18:13:35.502 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 37/134 2023-07-07T18:13:35.503 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:18.0.0-4477.g8e854f7d.el8.noarch 38/134 2023-07-07T18:13:35.503 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-07T18:13:35.503 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-07T18:13:35.503 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-07T18:13:35.503 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-07T18:13:35.503 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-07T18:13:35.503 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-07T18:13:35.503 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-07T18:13:35.504 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-07T18:13:35.504 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-07T18:13:35.504 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-07T18:13:35.504 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-07T18:13:35.504 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-07T18:13:35.504 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-07T18:13:35.504 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-07T18:13:35.510 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-07T18:13:35.510 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-07T18:13:35.510 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-07T18:13:35.510 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-07T18:13:35.511 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-07T18:13:35.511 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-07T18:13:35.511 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-07T18:13:35.511 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-07T18:13:35.511 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-07T18:13:35.511 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-07T18:13:35.511 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-07T18:13:35.512 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-07T18:13:35.512 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-07T18:13:35.512 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-07T18:13:35.512 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-07T18:13:35.512 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-07T18:13:35.512 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-07T18:13:35.512 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-07T18:13:35.512 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-07T18:13:35.513 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-07T18:13:35.513 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-07T18:13:35.513 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-07T18:13:35.513 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-07T18:13:35.513 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-07T18:13:35.513 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-07T18:13:35.513 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-07T18:13:35.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-07T18:13:35.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-07T18:13:35.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-07T18:13:35.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-07T18:13:35.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-07T18:13:35.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-07T18:13:35.514 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-07T18:13:35.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-07T18:13:35.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-07T18:13:35.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-07T18:13:35.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-07T18:13:35.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-07T18:13:35.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-07T18:13:35.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-07T18:13:35.515 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-07T18:13:35.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-07T18:13:35.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-07T18:13:35.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-07T18:13:35.516 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-07T18:13:35.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-07T18:13:35.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-07T18:13:35.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-07T18:13:35.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-07T18:13:35.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-07T18:13:35.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-07T18:13:35.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-07T18:13:35.517 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-07T18:13:35.518 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-07T18:13:35.518 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-07T18:13:35.518 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-07T18:13:35.518 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-07T18:13:35.518 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-07T18:13:35.518 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-07T18:13:35.518 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-07T18:13:35.519 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-07T18:13:35.519 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-07T18:13:35.519 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-07T18:13:35.519 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-07T18:13:35.519 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-07T18:13:35.519 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-07T18:13:35.519 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-07T18:13:35.519 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-07T18:13:35.520 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-07T18:13:35.520 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-07T18:13:35.520 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-07T18:13:35.520 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-07T18:13:35.520 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-07T18:13:35.520 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-07T18:13:35.520 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-07T18:13:35.520 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-07T18:13:35.521 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:18.0.0-4477.g8e854f7d.el8.x86_64 129/134 2023-07-07T18:13:35.521 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-07T18:13:35.521 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:18.0.0-4477.g8e854f7d.el8.x86_64 131/134 2023-07-07T18:13:35.521 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-07T18:13:35.521 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-07T18:13:37.145 INFO:teuthology.orchestra.run.smithi160.stdout:Installed products updated. 2023-07-07T18:13:37.362 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:37.362 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2023-07-07T18:13:37.363 INFO:teuthology.orchestra.run.smithi160.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-07T18:13:37.363 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.363 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.364 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2023-07-07T18:13:37.364 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-07T18:13:37.364 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.1-7.el8.noarch 2023-07-07T18:13:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.0.4-10.el8.x86_64 2023-07-07T18:13:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.365 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.366 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.367 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.367 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.367 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.367 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.368 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.368 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.368 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.369 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.370 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.370 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.370 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.371 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.371 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:37.371 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-07T18:13:37.371 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.1-9.el8.x86_64 2023-07-07T18:13:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-07T18:13:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-07T18:13:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: jq-1.6-3.el8.x86_64 2023-07-07T18:13:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-07T18:13:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-07T18:13:37.372 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-07T18:13:37.373 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.373 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.373 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.373 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-07T18:13:37.374 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-07T18:13:37.374 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-07T18:13:37.374 INFO:teuthology.orchestra.run.smithi160.stdout: libpq-13.5-1.el8.x86_64 2023-07-07T18:13:37.374 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-07T18:13:37.375 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-07T18:13:37.375 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.375 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.376 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-07T18:13:37.376 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.376 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-07T18:13:37.376 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-07T18:13:37.377 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-07T18:13:37.377 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-07T18:13:37.377 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-07T18:13:37.377 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-07T18:13:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-07T18:13:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-07T18:13:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-07T18:13:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-07T18:13:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-07T18:13:37.378 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-07T18:13:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-07T18:13:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-07T18:13:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-07T18:13:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-07T18:13:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-07T18:13:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-07T18:13:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-07T18:13:37.379 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-07T18:13:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-07T18:13:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-07T18:13:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-07T18:13:37.380 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-07T18:13:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-07T18:13:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-07T18:13:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-07T18:13:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-07T18:13:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-07T18:13:37.381 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-07T18:13:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-07T18:13:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-07T18:13:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-07T18:13:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-07T18:13:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-07T18:13:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-07T18:13:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-07T18:13:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-07T18:13:37.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-07T18:13:37.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-07T18:13:37.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-07T18:13:37.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-07T18:13:37.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-07T18:13:37.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-07T18:13:37.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-2.6-1.el8.noarch 2023-07-07T18:13:37.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-07T18:13:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-07T18:13:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-07T18:13:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-07T18:13:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-07T18:13:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-07T18:13:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.384 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-07T18:13:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-07T18:13:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-07T18:13:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-07T18:13:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-07T18:13:37.385 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-07T18:13:37.386 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-07T18:13:37.386 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-07T18:13:37.386 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-07T18:13:37.386 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-07T18:13:37.386 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-07T18:13:37.387 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-07T18:13:37.387 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-07T18:13:37.387 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-07T18:13:37.387 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-07T18:13:37.387 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.387 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.388 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:37.388 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-07T18:13:37.388 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-07T18:13:37.388 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-07T18:13:37.388 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-07T18:13:37.388 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-07T18:13:37.389 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-07T18:13:37.389 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:37.389 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2023-07-07T18:13:37.599 DEBUG:teuthology.parallel:result is None 2023-07-07T18:13:38.072 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-07T18:13:38.072 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:59 ago on Fri 07 Jul 2023 06:11:39 PM UTC. 2023-07-07T18:13:41.785 INFO:teuthology.orchestra.run.smithi012.stdout:Installed products updated. 2023-07-07T18:13:42.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:42.056 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2023-07-07T18:13:42.057 INFO:teuthology.orchestra.run.smithi012.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-07T18:13:42.057 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.057 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.057 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2023-07-07T18:13:42.057 INFO:teuthology.orchestra.run.smithi012.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-07T18:13:42.057 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.1-7.el8.noarch 2023-07-07T18:13:42.057 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.0.4-10.el8.x86_64 2023-07-07T18:13:42.058 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.058 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.058 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.058 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.058 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.058 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.058 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.058 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.059 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.059 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.059 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.059 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.059 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.059 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.059 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.060 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.060 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.060 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.060 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.060 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.060 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.060 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.061 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:18.0.0-4477.g8e854f7d.el8.noarch 2023-07-07T18:13:42.061 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-07T18:13:42.061 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.1-9.el8.x86_64 2023-07-07T18:13:42.061 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-07T18:13:42.061 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-07T18:13:42.061 INFO:teuthology.orchestra.run.smithi012.stdout: jq-1.6-3.el8.x86_64 2023-07-07T18:13:42.061 INFO:teuthology.orchestra.run.smithi012.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-07T18:13:42.061 INFO:teuthology.orchestra.run.smithi012.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-07T18:13:42.062 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-07T18:13:42.062 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.062 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.062 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.062 INFO:teuthology.orchestra.run.smithi012.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-07T18:13:42.062 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-07T18:13:42.062 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-07T18:13:42.063 INFO:teuthology.orchestra.run.smithi012.stdout: libpq-13.5-1.el8.x86_64 2023-07-07T18:13:42.063 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-07T18:13:42.063 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-07T18:13:42.063 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.063 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.063 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-07T18:13:42.063 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.064 INFO:teuthology.orchestra.run.smithi012.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-07T18:13:42.064 INFO:teuthology.orchestra.run.smithi012.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-07T18:13:42.064 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-07T18:13:42.064 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-07T18:13:42.064 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-07T18:13:42.064 INFO:teuthology.orchestra.run.smithi012.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-07T18:13:42.065 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-07T18:13:42.065 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-07T18:13:42.065 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-07T18:13:42.065 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-07T18:13:42.065 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-07T18:13:42.065 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-07T18:13:42.065 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-07T18:13:42.066 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-07T18:13:42.066 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-07T18:13:42.066 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-07T18:13:42.067 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-07T18:13:42.067 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-07T18:13:42.067 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-07T18:13:42.067 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-07T18:13:42.067 INFO:teuthology.orchestra.run.smithi012.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-07T18:13:42.068 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-07T18:13:42.068 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.068 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.068 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.068 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-07T18:13:42.068 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-07T18:13:42.069 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-07T18:13:42.069 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-07T18:13:42.069 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-07T18:13:42.069 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-07T18:13:42.069 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-07T18:13:42.069 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-07T18:13:42.069 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-07T18:13:42.069 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-07T18:13:42.070 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-07T18:13:42.070 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-07T18:13:42.070 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-07T18:13:42.070 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-07T18:13:42.071 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-07T18:13:42.071 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-07T18:13:42.071 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-07T18:13:42.071 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-07T18:13:42.072 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-07T18:13:42.072 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-07T18:13:42.072 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-07T18:13:42.073 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-07T18:13:42.073 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-2.6-1.el8.noarch 2023-07-07T18:13:42.073 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-07T18:13:42.073 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-07T18:13:42.074 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-07T18:13:42.074 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-07T18:13:42.074 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-07T18:13:42.074 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-07T18:13:42.075 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.075 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.075 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-07T18:13:42.075 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-07T18:13:42.076 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.076 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-07T18:13:42.076 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-07T18:13:42.077 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-07T18:13:42.077 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-07T18:13:42.077 INFO:teuthology.orchestra.run.smithi012.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-07T18:13:42.077 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-07T18:13:42.078 INFO:teuthology.orchestra.run.smithi012.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-07T18:13:42.078 INFO:teuthology.orchestra.run.smithi012.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-07T18:13:42.078 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-07T18:13:42.079 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-07T18:13:42.079 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-07T18:13:42.079 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-07T18:13:42.079 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-07T18:13:42.079 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.079 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.080 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:18.0.0-4477.g8e854f7d.el8.x86_64 2023-07-07T18:13:42.080 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-07T18:13:42.080 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-07T18:13:42.080 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-07T18:13:42.080 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-07T18:13:42.081 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-07T18:13:42.081 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-07T18:13:42.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:42.082 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-07-07T18:13:42.279 DEBUG:teuthology.parallel:result is None 2023-07-07T18:13:42.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e854f7d61ef670caec08861f0f82587a7320e12 2023-07-07T18:13:42.434 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-07T18:13:42.459 INFO:teuthology.orchestra.run.smithi012.stdout:18.0.0-4477.g8e854f7d.el8 2023-07-07T18:13:42.460 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4477.g8e854f7d.el8 2023-07-07T18:13:42.461 INFO:teuthology.task.install:The correct ceph version 18.0.0-4477.g8e854f7d is installed. 2023-07-07T18:13:42.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8e854f7d61ef670caec08861f0f82587a7320e12 2023-07-07T18:13:42.672 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-07T18:13:42.702 INFO:teuthology.orchestra.run.smithi160.stdout:18.0.0-4477.g8e854f7d.el8 2023-07-07T18:13:42.702 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4477.g8e854f7d.el8 2023-07-07T18:13:42.702 INFO:teuthology.task.install:The correct ceph version 18.0.0-4477.g8e854f7d is installed. 2023-07-07T18:13:42.703 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-07T18:13:42.703 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:42.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-07T18:13:42.747 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:13:42.747 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-07T18:13:42.792 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-07T18:13:42.793 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:42.793 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2023-07-07T18:13:42.834 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-07T18:13:42.901 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:13:42.902 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2023-07-07T18:13:42.932 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-07T18:13:43.001 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-07T18:13:43.001 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:43.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-07T18:13:43.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-07T18:13:43.140 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:13:43.140 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-07T18:13:43.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-07T18:13:43.240 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-07T18:13:43.240 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:43.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2023-07-07T18:13:43.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-07T18:13:43.334 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:13:43.335 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2023-07-07T18:13:43.363 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-07T18:13:43.431 INFO:teuthology.run_tasks:Running task ceph... 2023-07-07T18:13:43.587 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-07T18:13:43.588 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2023-07-07T18:13:43.591 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2023-07-07T18:13:43.621 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-07T18:13:43.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-07T18:13:43.659 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-07T18:13:43.689 INFO:tasks.ceph:Creating extra log directories... 2023-07-07T18:13:43.690 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-07T18:13:43.726 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-07T18:13:43.769 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-07T18:13:43.769 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-07T18:13:43.770 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-07T18:13:43.771 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:43.771 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-07T18:13:43.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-07T18:13:43.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-07T18:13:43.979 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:13:43.979 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-07T18:13:43.997 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-07T18:13:44.137 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-07T18:13:44.173 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-07T18:13:44.174 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-07T18:13:44.175 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-07_17:52:00-fs-wip-rishabh-mdscaps-testing-default-smithi/7328414', 'branch': 'wip-rishabh-mdscaps', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7328414', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-07_17:52:00-fs-wip-rishabh-mdscaps-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-mdscaps'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '8e854f7d61ef670caec08861f0f82587a7320e12'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8e854f7d61ef670caec08861f0f82587a7320e12'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-mdscaps', 'sha1': '8e854f7d61ef670caec08861f0f82587a7320e12'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '8e854f7d61ef670caec08861f0f82587a7320e12', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-mdscaps', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8e854f7d61ef670caec08861f0f82587a7320e12/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8e854f7d61ef670caec08861f0f82587a7320e12', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi012.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi160.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8e854f7d61ef670caec08861f0f82587a7320e12'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-07_17:52:00', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-07T18:13:44.176 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-07T18:13:44.179 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-07T18:13:44.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2023-07-07T18:13:44.241 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2023-07-07T18:13:44.292 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:44.292 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2023-07-07T18:13:44.325 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-07T18:13:44.326 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2023-07-07T18:13:44.383 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-07T18:13:44.384 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-07T18:13:44.384 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 371525 Links: 1 2023-07-07T18:13:44.385 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-07T18:13:44.385 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-07-07T18:13:44.386 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-07-07 18:13:35.181676600 +0000 2023-07-07T18:13:44.386 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-07-07 18:10:42.192455136 +0000 2023-07-07T18:13:44.386 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-07-07 18:10:42.192455136 +0000 2023-07-07T18:13:44.387 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-07-07T18:13:44.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-07T18:13:44.451 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-07-07T18:13:44.451 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-07-07T18:13:44.452 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000221271 s, 2.3 MB/s 2023-07-07T18:13:44.453 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-07T18:13:44.512 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2023-07-07T18:13:44.571 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-07T18:13:44.571 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-07T18:13:44.571 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 371573 Links: 1 2023-07-07T18:13:44.572 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-07T18:13:44.572 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-07-07T18:13:44.572 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-07-07 18:13:35.181676600 +0000 2023-07-07T18:13:44.573 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-07-07 18:10:42.752450307 +0000 2023-07-07T18:13:44.573 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-07-07 18:10:42.752450307 +0000 2023-07-07T18:13:44.573 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-07-07T18:13:44.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-07T18:13:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-07-07T18:13:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-07-07T18:13:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000220918 s, 2.3 MB/s 2023-07-07T18:13:44.639 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-07T18:13:44.698 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2023-07-07T18:13:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-07T18:13:44.755 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-07T18:13:44.755 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 382056 Links: 1 2023-07-07T18:13:44.756 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-07T18:13:44.756 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-07-07T18:13:44.756 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-07-07 18:13:35.181676600 +0000 2023-07-07T18:13:44.756 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-07-07 18:10:43.315445452 +0000 2023-07-07T18:13:44.756 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-07-07 18:10:43.315445452 +0000 2023-07-07T18:13:44.756 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-07-07T18:13:44.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-07T18:13:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-07-07T18:13:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-07-07T18:13:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000197867 s, 2.6 MB/s 2023-07-07T18:13:44.824 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-07T18:13:44.883 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2023-07-07T18:13:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-07T18:13:44.941 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-07T18:13:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 377619 Links: 1 2023-07-07T18:13:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-07T18:13:44.941 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-07-07T18:13:44.942 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-07-07 18:13:35.181676600 +0000 2023-07-07T18:13:44.942 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-07-07 18:10:43.867440692 +0000 2023-07-07T18:13:44.942 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-07-07 18:10:43.867440692 +0000 2023-07-07T18:13:44.942 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-07-07T18:13:44.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-07T18:13:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-07-07T18:13:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-07-07T18:13:45.007 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000229683 s, 2.2 MB/s 2023-07-07T18:13:45.007 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-07T18:13:45.065 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-07T18:13:45.067 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:13:45.068 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2023-07-07T18:13:45.088 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-07T18:13:45.088 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2023-07-07T18:13:45.148 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-07T18:13:45.149 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-07T18:13:45.149 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 372502 Links: 1 2023-07-07T18:13:45.149 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-07T18:13:45.149 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-07-07T18:13:45.149 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-07-07 18:13:31.168039946 +0000 2023-07-07T18:13:45.150 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-07-07 18:10:44.824315401 +0000 2023-07-07T18:13:45.150 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-07-07 18:10:44.824315401 +0000 2023-07-07T18:13:45.150 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-07-07T18:13:45.150 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-07T18:13:45.218 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-07-07T18:13:45.218 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-07-07T18:13:45.219 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000291582 s, 1.8 MB/s 2023-07-07T18:13:45.220 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-07T18:13:45.280 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2023-07-07T18:13:45.339 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-07T18:13:45.340 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-07T18:13:45.340 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 379327 Links: 1 2023-07-07T18:13:45.340 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-07T18:13:45.340 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-07-07T18:13:45.340 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-07-07 18:13:31.169039931 +0000 2023-07-07T18:13:45.341 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-07-07 18:10:45.405306549 +0000 2023-07-07T18:13:45.341 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-07-07 18:10:45.405306549 +0000 2023-07-07T18:13:45.341 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-07-07T18:13:45.341 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-07T18:13:45.407 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-07-07T18:13:45.407 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-07-07T18:13:45.408 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000233128 s, 2.2 MB/s 2023-07-07T18:13:45.409 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-07T18:13:45.467 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2023-07-07T18:13:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-07T18:13:45.525 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-07T18:13:45.525 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 375647 Links: 1 2023-07-07T18:13:45.526 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-07T18:13:45.526 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-07-07T18:13:45.526 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-07-07 18:13:31.169039931 +0000 2023-07-07T18:13:45.526 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-07-07 18:10:45.968297971 +0000 2023-07-07T18:13:45.526 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-07-07 18:10:45.968297971 +0000 2023-07-07T18:13:45.526 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-07-07T18:13:45.527 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-07T18:13:45.592 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-07-07T18:13:45.593 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-07-07T18:13:45.593 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000207676 s, 2.5 MB/s 2023-07-07T18:13:45.594 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-07T18:13:45.652 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2023-07-07T18:13:45.709 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-07T18:13:45.710 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-07T18:13:45.710 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 375781 Links: 1 2023-07-07T18:13:45.711 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-07T18:13:45.711 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-07-07T18:13:45.711 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-07-07 18:13:31.169039931 +0000 2023-07-07T18:13:45.711 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-07-07 18:10:46.537289302 +0000 2023-07-07T18:13:45.712 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-07-07 18:10:46.537289302 +0000 2023-07-07T18:13:45.712 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-07-07T18:13:45.712 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-07T18:13:45.780 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-07-07T18:13:45.780 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-07-07T18:13:45.780 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000194389 s, 2.6 MB/s 2023-07-07T18:13:45.781 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-07T18:13:45.837 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-07T18:13:45.838 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-07T18:13:45.838 INFO:tasks.ceph:Generating config... 2023-07-07T18:13:45.839 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-07T18:13:45.840 INFO:tasks.ceph:[client] debug client = 20 2023-07-07T18:13:45.840 INFO:tasks.ceph:[client] debug ms = 1 2023-07-07T18:13:45.840 INFO:tasks.ceph:[client] pid file = 2023-07-07T18:13:45.840 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-07T18:13:45.840 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-07T18:13:45.841 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-07T18:13:45.841 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-07T18:13:45.841 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-07T18:13:45.841 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-07T18:13:45.841 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-07T18:13:45.842 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-07T18:13:45.842 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-07T18:13:45.842 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-07T18:13:45.842 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-07T18:13:45.842 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-07T18:13:45.843 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-07T18:13:45.843 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-07T18:13:45.843 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-07T18:13:45.843 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-07T18:13:45.843 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-07T18:13:45.844 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-07T18:13:45.844 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-07T18:13:45.844 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-07T18:13:45.844 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-07T18:13:45.844 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-07T18:13:45.844 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-07T18:13:45.845 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-07T18:13:45.845 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-07T18:13:45.845 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-07T18:13:45.845 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-07T18:13:45.845 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-07T18:13:45.846 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-07T18:13:45.846 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-07T18:13:45.846 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-07T18:13:45.846 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-07T18:13:45.846 INFO:tasks.ceph:Setting up mon.a... 2023-07-07T18:13:45.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-07T18:13:45.906 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2023-07-07T18:13:45.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-07T18:13:45.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-07T18:13:45.984 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.b', '172.21.15.160'), ('mon.c', '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]')] 2023-07-07T18:13:45.985 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-07T18:13:45.985 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:45.986 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-07T18:13:46.041 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --add b 172.21.15.160 --addv c '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:13:46.129 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:13:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 6f09c1a9-a759-4e94-bed7-68b16c28b7f9 2023-07-07T18:13:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = pacific 2023-07-07T18:13:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2023-07-07T18:13:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 6f09c1a9-a759-4e94-bed7-68b16c28b7f9 2023-07-07T18:13:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2023-07-07T18:13:46.129233+0000 2023-07-07T18:13:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:created 2023-07-07T18:13:46.129233+0000 2023-07-07T18:13:46.130 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 16 (pacific) 2023-07-07T18:13:46.131 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2023-07-07T18:13:46.131 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-07-07T18:13:46.131 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2023-07-07T18:13:46.131 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] mon.c 2023-07-07T18:13:46.131 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-07T18:13:46.132 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-07T18:13:46.149 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6f09c1a9-a759-4e94-bed7-68b16c28b7f9... 2023-07-07T18:13:46.151 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-07T18:13:46.191 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-07T18:13:46.238 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2023-07-07T18:13:46.238 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2023-07-07T18:13:46.239 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-07T18:13:46.239 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2023-07-07T18:13:46.239 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.240 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2023-07-07T18:13:46.240 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.240 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2023-07-07T18:13:46.240 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.241 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2023-07-07T18:13:46.241 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2023-07-07T18:13:46.241 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.241 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2023-07-07T18:13:46.242 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2023-07-07T18:13:46.242 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.242 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-07T18:13:46.242 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2023-07-07T18:13:46.243 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.243 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2023-07-07T18:13:46.243 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-07T18:13:46.244 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.244 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2023-07-07T18:13:46.245 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.245 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2023-07-07T18:13:46.245 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2023-07-07T18:13:46.245 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2023-07-07T18:13:46.246 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2023-07-07T18:13:46.246 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2023-07-07T18:13:46.246 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2023-07-07T18:13:46.246 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2023-07-07T18:13:46.247 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-07T18:13:46.247 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-07T18:13:46.247 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2023-07-07T18:13:46.247 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.247 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-07T18:13:46.248 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.248 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2023-07-07T18:13:46.248 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.248 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2023-07-07T18:13:46.249 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.249 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2023-07-07T18:13:46.249 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2023-07-07T18:13:46.249 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2023-07-07T18:13:46.249 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.12,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2023-07-07T18:13:46.250 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on skipped message = False 2023-07-07T18:13:46.250 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = 6f09c1a9-a759-4e94-bed7-68b16c28b7f9 2023-07-07T18:13:46.250 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.250 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2023-07-07T18:13:46.251 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2023-07-07T18:13:46.251 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.251 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2023-07-07T18:13:46.251 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2023-07-07T18:13:46.252 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2023-07-07T18:13:46.252 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.252 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2023-07-07T18:13:46.252 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2023-07-07T18:13:46.253 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.253 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2023-07-07T18:13:46.253 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2023-07-07T18:13:46.254 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2023-07-07T18:13:46.254 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.254 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2023-07-07T18:13:46.254 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2023-07-07T18:13:46.255 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.255 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2023-07-07T18:13:46.256 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.256 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2023-07-07T18:13:46.256 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.257 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2023-07-07T18:13:46.257 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.257 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2023-07-07T18:13:46.257 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2023-07-07T18:13:46.258 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.258 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2023-07-07T18:13:46.258 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2023-07-07T18:13:46.259 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2023-07-07T18:13:46.259 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2023-07-07T18:13:46.259 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 20 2023-07-07T18:13:46.259 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 20 2023-07-07T18:13:46.260 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-07-07T18:13:46.260 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2023-07-07T18:13:46.260 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 10 2023-07-07T18:13:46.260 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2023-07-07T18:13:46.260 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2023-07-07T18:13:46.261 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2023-07-07T18:13:46.261 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2023-07-07T18:13:46.261 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2023-07-07T18:13:46.261 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2023-07-07T18:13:46.261 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.262 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2023-07-07T18:13:46.262 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-07-07T18:13:46.262 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2023-07-07T18:13:46.263 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2023-07-07T18:13:46.263 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2023-07-07T18:13:46.264 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2023-07-07T18:13:46.264 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2023-07-07T18:13:46.264 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2023-07-07T18:13:46.264 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.264 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2023-07-07T18:13:46.264 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-07-07T18:13:46.265 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2023-07-07T18:13:46.265 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2023-07-07T18:13:46.265 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2023-07-07T18:13:46.265 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2023-07-07T18:13:46.266 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2023-07-07T18:13:46.266 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2023-07-07T18:13:46.266 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2023-07-07T18:13:46.266 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2023-07-07T18:13:46.267 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2023-07-07T18:13:46.267 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.267 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-07T18:13:46.268 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2023-07-07T18:13:46.268 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2023-07-07T18:13:46.268 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.268 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2023-07-07T18:13:46.269 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-07T18:13:46.269 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-07T18:13:46.269 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.269 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2023-07-07T18:13:46.270 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2023-07-07T18:13:46.270 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.270 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2023-07-07T18:13:46.270 INFO:teuthology.orchestra.run.smithi160.stdout: mon op complaint time = 120 2023-07-07T18:13:46.271 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-07-07T18:13:46.271 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2023-07-07T18:13:46.271 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2023-07-07T18:13:46.271 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2023-07-07T18:13:46.272 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2023-07-07T18:13:46.272 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-07T18:13:46.272 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-07T18:13:46.273 INFO:teuthology.orchestra.run.smithi160.stdout: client mount timeout = 600 2023-07-07T18:13:46.273 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2023-07-07T18:13:46.273 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-07-07T18:13:46.273 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = "" 2023-07-07T18:13:46.274 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2023-07-07T18:13:46.274 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2023-07-07T18:13:46.274 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2023-07-07T18:13:46.274 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2023-07-07T18:13:46.275 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2023-07-07T18:13:46.275 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2023-07-07T18:13:46.275 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2023-07-07T18:13:46.275 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2023-07-07T18:13:46.276 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2023-07-07T18:13:46.276 INFO:teuthology.orchestra.run.smithi160.stdout:[mds] 2023-07-07T18:13:46.276 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds = 20 2023-07-07T18:13:46.276 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds balancer = 20 2023-07-07T18:13:46.277 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2023-07-07T18:13:46.277 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug frag = True 2023-07-07T18:13:46.277 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug scatterstat = True 2023-07-07T18:13:46.277 INFO:teuthology.orchestra.run.smithi160.stdout: mds op complaint time = 180 2023-07-07T18:13:46.278 INFO:teuthology.orchestra.run.smithi160.stdout: mds verify scatter = True 2023-07-07T18:13:46.278 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2023-07-07T18:13:46.278 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 900 2023-07-07T18:13:46.278 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 900 2023-07-07T18:13:46.280 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2023-07-07T18:13:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2023-07-07T18:13:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-07T18:13:46.280 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2023-07-07T18:13:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2023-07-07T18:13:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.281 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2023-07-07T18:13:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2023-07-07T18:13:46.282 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2023-07-07T18:13:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2023-07-07T18:13:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2023-07-07T18:13:46.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-07T18:13:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2023-07-07T18:13:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.284 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2023-07-07T18:13:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-07T18:13:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.285 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2023-07-07T18:13:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2023-07-07T18:13:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2023-07-07T18:13:46.286 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2023-07-07T18:13:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2023-07-07T18:13:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2023-07-07T18:13:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2023-07-07T18:13:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2023-07-07T18:13:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-07T18:13:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-07T18:13:46.288 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2023-07-07T18:13:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-07T18:13:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2023-07-07T18:13:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2023-07-07T18:13:46.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2023-07-07T18:13:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2023-07-07T18:13:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2023-07-07T18:13:46.291 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2023-07-07T18:13:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on skipped message = False 2023-07-07T18:13:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 6f09c1a9-a759-4e94-bed7-68b16c28b7f9 2023-07-07T18:13:46.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.292 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2023-07-07T18:13:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2023-07-07T18:13:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2023-07-07T18:13:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2023-07-07T18:13:46.293 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2023-07-07T18:13:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2023-07-07T18:13:46.294 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2023-07-07T18:13:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2023-07-07T18:13:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2023-07-07T18:13:46.295 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2023-07-07T18:13:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2023-07-07T18:13:46.296 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2023-07-07T18:13:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2023-07-07T18:13:46.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2023-07-07T18:13:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2023-07-07T18:13:46.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2023-07-07T18:13:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2023-07-07T18:13:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2023-07-07T18:13:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2023-07-07T18:13:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2023-07-07T18:13:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2023-07-07T18:13:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 20 2023-07-07T18:13:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 20 2023-07-07T18:13:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-07-07T18:13:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2023-07-07T18:13:46.301 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 10 2023-07-07T18:13:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2023-07-07T18:13:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2023-07-07T18:13:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2023-07-07T18:13:46.302 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2023-07-07T18:13:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2023-07-07T18:13:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2023-07-07T18:13:46.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.303 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2023-07-07T18:13:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-07-07T18:13:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2023-07-07T18:13:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-07-07T18:13:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-07-07T18:13:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-07-07T18:13:46.304 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-07-07T18:13:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2023-07-07T18:13:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.305 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2023-07-07T18:13:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-07-07T18:13:46.305 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-07-07T18:13:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2023-07-07T18:13:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-07-07T18:13:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2023-07-07T18:13:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2023-07-07T18:13:46.306 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-07-07T18:13:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2023-07-07T18:13:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2023-07-07T18:13:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-07-07T18:13:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-07T18:13:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2023-07-07T18:13:46.307 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2023-07-07T18:13:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2023-07-07T18:13:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-07T18:13:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-07T18:13:46.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2023-07-07T18:13:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2023-07-07T18:13:46.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.310 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2023-07-07T18:13:46.310 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2023-07-07T18:13:46.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:13:46.310 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2023-07-07T18:13:46.310 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2023-07-07T18:13:46.311 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2023-07-07T18:13:46.311 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2023-07-07T18:13:46.311 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-07T18:13:46.311 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-07T18:13:46.311 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2023-07-07T18:13:46.312 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2023-07-07T18:13:46.312 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-07-07T18:13:46.312 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = "" 2023-07-07T18:13:46.312 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2023-07-07T18:13:46.312 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2023-07-07T18:13:46.312 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2023-07-07T18:13:46.312 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2023-07-07T18:13:46.313 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2023-07-07T18:13:46.313 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2023-07-07T18:13:46.313 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2023-07-07T18:13:46.313 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2023-07-07T18:13:46.313 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2023-07-07T18:13:46.313 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2023-07-07T18:13:46.313 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2023-07-07T18:13:46.313 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds balancer = 20 2023-07-07T18:13:46.314 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-07-07T18:13:46.314 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2023-07-07T18:13:46.314 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2023-07-07T18:13:46.314 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2023-07-07T18:13:46.314 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2023-07-07T18:13:46.314 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2023-07-07T18:13:46.314 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2023-07-07T18:13:46.314 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2023-07-07T18:13:46.315 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-07T18:13:46.315 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-07T18:13:46.377 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-07T18:13:46.378 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:46.378 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-07T18:13:46.395 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:46.395 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-07T18:13:46.451 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T18:13:46.451 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:46.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-07T18:13:46.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-07T18:13:46.531 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:13:46.531 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:13:46.588 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T18:13:46.588 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:13:46.588 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-07T18:13:46.589 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-07T18:13:46.625 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:13:46.626 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:13:46.681 INFO:tasks.ceph:Setting up mon nodes... 2023-07-07T18:13:46.682 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-07T18:13:46.682 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-07T18:13:46.741 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-07T18:13:46.744 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-07T18:13:46.805 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-07T18:13:46.808 INFO:tasks.ceph:Setting up mds nodes... 2023-07-07T18:13:46.809 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-07T18:13:46.866 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-07T18:13:46.868 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-07T18:13:46.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-07T18:13:46.993 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-07T18:13:46.996 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-07T18:13:47.023 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-07T18:13:47.077 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-07T18:13:47.080 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-07T18:13:47.106 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-07T18:13:47.200 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-07T18:13:47.202 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-07T18:13:47.230 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-07T18:13:47.231 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-07T18:13:47.277 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-07T18:13:47.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-07T18:13:47.338 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-07T18:13:47.353 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-07T18:13:47.395 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-07T18:13:47.408 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-07T18:13:47.492 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-07T18:13:47.505 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-07T18:13:47.506 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-07T18:13:47.506 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-07T18:13:47.535 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-07T18:13:47.535 INFO:tasks.ceph:role: osd.0 2023-07-07T18:13:47.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T18:13:47.536 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-07T18:13:47.608 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-07T18:13:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-07T18:13:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-07T18:13:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-07T18:13:47.609 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-07T18:13:47.609 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-07-07T18:13:47.609 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-07T18:13:47.610 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-07T18:13:47.610 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-07T18:13:47.610 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-07T18:13:48.034 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-07-07T18:13:48.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-07-07T18:13:48.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-07T18:13:48.196 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-07T18:13:48.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-07T18:13:48.303 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-07T18:13:48.304 INFO:tasks.ceph:role: osd.1 2023-07-07T18:13:48.304 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T18:13:48.305 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-07T18:13:48.378 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-07T18:13:48.378 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-07T18:13:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-07T18:13:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-07T18:13:48.379 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-07T18:13:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-07-07T18:13:48.379 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-07T18:13:48.379 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-07T18:13:48.379 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-07T18:13:48.379 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-07T18:13:48.797 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-07-07T18:13:48.849 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-07-07T18:13:48.850 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-07T18:13:48.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-07T18:13:48.989 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-07T18:13:49.056 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-07T18:13:49.056 INFO:tasks.ceph:role: osd.2 2023-07-07T18:13:49.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T18:13:49.057 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-07T18:13:49.131 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-07T18:13:49.131 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-07T18:13:49.131 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-07T18:13:49.132 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-07T18:13:49.132 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-07T18:13:49.132 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-07-07T18:13:49.132 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-07T18:13:49.132 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-07T18:13:49.132 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-07T18:13:49.132 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-07T18:13:49.573 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-07-07T18:13:49.575 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-07-07T18:13:49.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-07T18:13:49.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-07T18:13:49.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-07T18:13:49.849 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-07T18:13:49.849 INFO:tasks.ceph:role: osd.3 2023-07-07T18:13:49.849 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T18:13:49.850 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-07T18:13:49.925 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-07T18:13:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-07T18:13:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-07T18:13:49.925 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-07T18:13:49.925 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-07T18:13:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-07-07T18:13:49.926 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-07T18:13:49.926 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-07T18:13:49.926 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-07T18:13:49.926 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-07T18:13:50.367 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-07-07T18:13:50.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-07-07T18:13:50.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-07T18:13:50.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-07T18:13:50.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:13:50.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:50.707+0000 7fdcade4c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-07T18:13:50.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:50.707+0000 7fdcade4c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-07T18:13:50.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:50.707+0000 7fdcade4c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-07T18:13:50.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:50.707+0000 7fdcade4c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-07T18:13:50.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:50.707+0000 7fdcade4c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-07T18:13:50.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:50.708+0000 7fdcade4c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-07T18:13:53.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-07T18:13:53.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:13:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:53.723+0000 7f2e1c659640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-07T18:13:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:53.723+0000 7f2e1c659640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-07T18:13:53.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:53.723+0000 7f2e1c659640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-07T18:13:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:53.723+0000 7f2e1c659640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-07T18:13:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:53.723+0000 7f2e1c659640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-07T18:13:53.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:53.723+0000 7f2e1c659640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-07T18:13:56.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-07T18:13:56.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:13:56.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:56.761+0000 7fb9d14bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-07T18:13:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:56.762+0000 7fb9d14bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-07T18:13:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:56.762+0000 7fb9d14bb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-07T18:13:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:56.762+0000 7fb9d14bb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-07T18:13:56.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:56.762+0000 7fb9d14bb640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-07T18:13:56.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:56.762+0000 7fb9d14bb640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-07T18:13:59.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-07T18:13:59.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:13:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:59.795+0000 7ff63c812640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-07T18:13:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:59.795+0000 7ff63c812640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-07T18:13:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:59.795+0000 7ff63c812640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-07T18:13:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:59.795+0000 7ff63c812640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-07T18:13:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:59.795+0000 7ff63c812640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-07T18:13:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:13:59.796+0000 7ff63c812640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-07T18:14:02.687 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-07T18:14:02.715 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-07T18:14:02.748 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-07T18:14:02.749 INFO:tasks.ceph:role: osd.4 2023-07-07T18:14:02.749 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T18:14:02.749 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-07T18:14:02.829 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-07T18:14:02.829 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-07T18:14:02.829 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-07T18:14:02.830 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-07T18:14:02.830 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-07T18:14:02.830 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2023-07-07T18:14:02.830 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-07T18:14:02.830 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-07T18:14:02.831 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-07T18:14:02.831 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-07T18:14:03.269 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2023-07-07T18:14:03.272 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2023-07-07T18:14:03.272 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-07T18:14:03.458 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-07T18:14:03.495 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-07T18:14:03.566 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-07T18:14:03.566 INFO:tasks.ceph:role: osd.5 2023-07-07T18:14:03.567 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T18:14:03.567 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-07T18:14:03.643 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-07T18:14:03.643 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-07T18:14:03.643 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-07T18:14:03.644 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-07T18:14:03.644 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-07T18:14:03.644 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2023-07-07T18:14:03.645 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-07T18:14:03.645 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-07T18:14:03.645 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-07T18:14:03.645 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-07T18:14:04.060 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2023-07-07T18:14:04.062 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2023-07-07T18:14:04.062 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-07T18:14:04.175 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-07T18:14:04.208 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-07T18:14:04.277 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-07T18:14:04.277 INFO:tasks.ceph:role: osd.6 2023-07-07T18:14:04.278 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T18:14:04.278 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-07T18:14:04.354 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-07T18:14:04.354 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-07T18:14:04.354 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-07T18:14:04.354 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-07T18:14:04.355 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-07T18:14:04.355 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2023-07-07T18:14:04.355 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-07T18:14:04.355 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-07T18:14:04.355 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-07T18:14:04.355 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-07T18:14:04.805 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2023-07-07T18:14:04.807 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2023-07-07T18:14:04.808 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-07T18:14:04.960 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-07T18:14:04.998 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-07T18:14:05.068 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-07T18:14:05.068 INFO:tasks.ceph:role: osd.7 2023-07-07T18:14:05.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T18:14:05.069 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-07T18:14:05.144 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-07T18:14:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-07T18:14:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-07T18:14:05.145 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-07T18:14:05.146 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-07T18:14:05.146 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2023-07-07T18:14:05.146 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-07T18:14:05.146 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-07T18:14:05.147 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-07T18:14:05.147 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-07T18:14:05.589 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2023-07-07T18:14:05.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2023-07-07T18:14:05.592 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-07T18:14:05.772 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-07T18:14:05.811 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:14:05.918 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:05.916+0000 7f9b9200b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-07T18:14:05.919 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:05.916+0000 7f9b9200b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-07T18:14:05.919 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:05.916+0000 7f9b9200b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-07T18:14:05.919 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:05.916+0000 7f9b9200b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-07T18:14:05.920 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:05.916+0000 7f9b9200b640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-07T18:14:05.920 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:05.916+0000 7f9b9200b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-07T18:14:08.786 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-07T18:14:08.818 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:14:08.911 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:08.909+0000 7f79bf939640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-07T18:14:08.912 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:08.909+0000 7f79bf939640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-07T18:14:08.912 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:08.909+0000 7f79bf939640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-07T18:14:08.912 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:08.909+0000 7f79bf939640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-07T18:14:08.912 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:08.909+0000 7f79bf939640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-07T18:14:08.912 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:08.910+0000 7f79bf939640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-07T18:14:11.770 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-07T18:14:11.803 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:14:11.894 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:11.892+0000 7f6d55ad4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-07T18:14:11.895 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:11.892+0000 7f6d55ad4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-07T18:14:11.895 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:11.892+0000 7f6d55ad4640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-07T18:14:11.895 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:11.892+0000 7f6d55ad4640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-07T18:14:11.895 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:11.892+0000 7f6d55ad4640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-07T18:14:11.895 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:11.893+0000 7f6d55ad4640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-07T18:14:14.178 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:14:14.180 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:14:14.771 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-07T18:14:14.801 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:14:14.891 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:14.889+0000 7f7b93371640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-07T18:14:14.892 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:14.889+0000 7f7b93371640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-07T18:14:14.892 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:14.889+0000 7f7b93371640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-07T18:14:14.892 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:14.889+0000 7f7b93371640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-07T18:14:14.892 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:14.889+0000 7f7b93371640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-07T18:14:14.893 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:14.890+0000 7f7b93371640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-07T18:14:17.754 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-07T18:14:17.786 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-07T18:14:17.786 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:17.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-07T18:14:17.821 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:17.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-07T18:14:17.893 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:17.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-07T18:14:17.965 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:17.965 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-07T18:14:18.035 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:18.035 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-07T18:14:18.104 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:18.105 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-07T18:14:18.173 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:18.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-07T18:14:18.242 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:18.243 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-07T18:14:18.275 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:18.275 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-07T18:14:18.346 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:18.346 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-07T18:14:18.415 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:18.416 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-07T18:14:18.484 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:18.484 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-07T18:14:18.552 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:18.553 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-07T18:14:18.620 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:18.620 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-07T18:14:18.687 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:18.688 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-07T18:14:18.708 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:18.709 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-07T18:14:18.768 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:18.769 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-07T18:14:18.786 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:18.787 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-07T18:14:18.843 INFO:tasks.ceph:Adding keys to all mons... 2023-07-07T18:14:18.843 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-07T18:14:18.845 DEBUG:teuthology.orchestra.run.smithi160:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-07T18:14:18.886 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2023-07-07T18:14:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDaVahkQgg0LBAA4sTfWRn0DxADMGvqxTcWVQ== 2023-07-07T18:14:18.886 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2023-07-07T18:14:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDaVahkEwmXMxAA0N67oUjM+lo9lCbJy2LOhQ== 2023-07-07T18:14:18.887 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2023-07-07T18:14:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDaVahkQX84OxAArGJ7gx3jDV4oMj7EqAE3YQ== 2023-07-07T18:14:18.887 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2023-07-07T18:14:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDeVahkDD0+KhAAWgslZQ2Y3JWKvAYpk+PSwQ== 2023-07-07T18:14:18.887 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2023-07-07T18:14:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDhVahkmj8xKxAAwogMNCf5P5YhfAypyUSV8w== 2023-07-07T18:14:18.888 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2023-07-07T18:14:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDkVahkQEd6LRAA5M6fmo+oZkj3ht26aZtYlg== 2023-07-07T18:14:18.888 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2023-07-07T18:14:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDnVahk7gWDLxAAV5tSWaQSP+ZaqeI4eIzmZg== 2023-07-07T18:14:18.888 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2023-07-07T18:14:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDaVahkat8CMBAAaic8I//8rMHdbP11gJ/AAg== 2023-07-07T18:14:18.889 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2023-07-07T18:14:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDbVahkUgCdBBAAsYJlTiGSOT1EFE8yyQ9NHw== 2023-07-07T18:14:18.889 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2023-07-07T18:14:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDbVahkz+rmCxAAMUjWCjf38RicKatpjIKVjg== 2023-07-07T18:14:18.889 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2023-07-07T18:14:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDtVahk+D2wNhAAKj7cFwIijeo7aRzeKXk4vg== 2023-07-07T18:14:18.889 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2023-07-07T18:14:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDwVahkPEJHNhAAEoZWvD9ezs05l0y4WdbYRg== 2023-07-07T18:14:18.890 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2023-07-07T18:14:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDzVahk4jJKNRAAWAUNxQVvVYrX9nWtEFZL9A== 2023-07-07T18:14:18.890 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2023-07-07T18:14:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD2Vahk/X0bNRAAfBRtuV7Ib2Vj+0oXVjOhSg== 2023-07-07T18:14:18.890 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2023-07-07T18:14:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDbVahk/qJ+EBAAyWYDEbqpYZz+0Etm6L8jmQ== 2023-07-07T18:14:18.890 INFO:teuthology.orchestra.run.smithi012.stdout:[client.2] 2023-07-07T18:14:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDbVahkjrUmFBAANC465Dp1j+deGsLyjOPZog== 2023-07-07T18:14:18.891 INFO:teuthology.orchestra.run.smithi012.stdout:[client.1] 2023-07-07T18:14:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDbVahkhLSTFxAAoynbRXnwI3XHNW+VbjxZTg== 2023-07-07T18:14:18.891 INFO:teuthology.orchestra.run.smithi012.stdout:[client.3] 2023-07-07T18:14:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDbVahkKNBSHRAA3Fuays/RfZh9749Nvumb2w== 2023-07-07T18:14:18.908 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.y] 2023-07-07T18:14:18.909 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDaVahkQgg0LBAA4sTfWRn0DxADMGvqxTcWVQ== 2023-07-07T18:14:18.909 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2023-07-07T18:14:18.909 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDaVahkEwmXMxAA0N67oUjM+lo9lCbJy2LOhQ== 2023-07-07T18:14:18.909 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2023-07-07T18:14:18.909 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDaVahkQX84OxAArGJ7gx3jDV4oMj7EqAE3YQ== 2023-07-07T18:14:18.909 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2023-07-07T18:14:18.910 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDeVahkDD0+KhAAWgslZQ2Y3JWKvAYpk+PSwQ== 2023-07-07T18:14:18.910 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.1] 2023-07-07T18:14:18.910 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDhVahkmj8xKxAAwogMNCf5P5YhfAypyUSV8w== 2023-07-07T18:14:18.910 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.2] 2023-07-07T18:14:18.910 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDkVahkQEd6LRAA5M6fmo+oZkj3ht26aZtYlg== 2023-07-07T18:14:18.910 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2023-07-07T18:14:18.910 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDnVahk7gWDLxAAV5tSWaQSP+ZaqeI4eIzmZg== 2023-07-07T18:14:18.910 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2023-07-07T18:14:18.911 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDaVahkat8CMBAAaic8I//8rMHdbP11gJ/AAg== 2023-07-07T18:14:18.911 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2023-07-07T18:14:18.911 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDbVahkUgCdBBAAsYJlTiGSOT1EFE8yyQ9NHw== 2023-07-07T18:14:18.911 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2023-07-07T18:14:18.911 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDbVahkz+rmCxAAMUjWCjf38RicKatpjIKVjg== 2023-07-07T18:14:18.911 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.4] 2023-07-07T18:14:18.911 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDtVahk+D2wNhAAKj7cFwIijeo7aRzeKXk4vg== 2023-07-07T18:14:18.912 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.5] 2023-07-07T18:14:18.912 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDwVahkPEJHNhAAEoZWvD9ezs05l0y4WdbYRg== 2023-07-07T18:14:18.912 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.6] 2023-07-07T18:14:18.912 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDzVahk4jJKNRAAWAUNxQVvVYrX9nWtEFZL9A== 2023-07-07T18:14:18.912 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.7] 2023-07-07T18:14:18.912 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD2Vahk/X0bNRAAfBRtuV7Ib2Vj+0oXVjOhSg== 2023-07-07T18:14:18.912 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2023-07-07T18:14:18.912 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDbVahk/qJ+EBAAyWYDEbqpYZz+0Etm6L8jmQ== 2023-07-07T18:14:18.913 INFO:teuthology.orchestra.run.smithi160.stdout:[client.2] 2023-07-07T18:14:18.913 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDbVahkjrUmFBAANC465Dp1j+deGsLyjOPZog== 2023-07-07T18:14:18.913 INFO:teuthology.orchestra.run.smithi160.stdout:[client.1] 2023-07-07T18:14:18.913 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDbVahkhLSTFxAAoynbRXnwI3XHNW+VbjxZTg== 2023-07-07T18:14:18.913 INFO:teuthology.orchestra.run.smithi160.stdout:[client.3] 2023-07-07T18:14:18.913 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDbVahkKNBSHRAA3Fuays/RfZh9749Nvumb2w== 2023-07-07T18:14:18.914 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-07T18:14:18.935 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-07T18:14:19.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-07T18:14:19.010 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-07T18:14:19.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-07T18:14:19.071 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-07T18:14:19.129 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.132 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.185 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.188 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.242 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.244 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.300 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-07T18:14:19.357 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-07T18:14:19.411 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-07T18:14:19.414 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-07T18:14:19.471 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-07T18:14:19.474 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-07T18:14:19.531 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.546 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.602 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.655 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.658 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.711 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.714 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-07T18:14:19.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-07T18:14:19.770 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-07T18:14:19.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-07T18:14:19.829 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-07T18:14:19.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-07T18:14:19.887 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-07T18:14:19.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-07T18:14:19.947 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-07T18:14:20.004 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-07T18:14:20.004 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-07T18:14:20.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-07T18:14:20.129 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-07T18:14:20.156 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-07T18:14:20.183 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-07T18:14:20.281 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-07T18:14:20.307 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-07T18:14:20.374 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-07T18:14:20.473 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-07T18:14:20.500 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:14:20.502 DEBUG:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-07T18:14:20.556 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-07T18:14:20.556 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-07T18:14:20.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-07T18:14:20.559 INFO:tasks.ceph.mon.a:Started 2023-07-07T18:14:20.560 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-07T18:14:20.560 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-07T18:14:20.598 INFO:tasks.ceph.mon.b:Started 2023-07-07T18:14:20.598 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-07T18:14:20.598 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-07T18:14:20.600 INFO:tasks.ceph.mon.c:Started 2023-07-07T18:14:20.601 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-07T18:14:20.601 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-07T18:14:20.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-07T18:14:20.603 INFO:tasks.ceph.mgr.y:Started 2023-07-07T18:14:20.603 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-07T18:14:20.604 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-07T18:14:20.605 INFO:tasks.ceph.mgr.x:Started 2023-07-07T18:14:20.606 INFO:tasks.ceph:Setting crush tunables to default 2023-07-07T18:14:20.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2023-07-07T18:14:20.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.731+0000 7efc23f73700 1 Processor -- start 2023-07-07T18:14:20.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.731+0000 7efc23f73700 1 -- start start 2023-07-07T18:14:20.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc23f73700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc1c15fc60 0x7efc1c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:20.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc23f73700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 0x7efc1c0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:20.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc23f73700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c0ce620 con 0x7efc1c0aecc0 2023-07-07T18:14:20.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc23f73700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c160580 con 0x7efc1c15fc60 2023-07-07T18:14:20.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc23f73700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c160860 con 0x7efc1c06e970 2023-07-07T18:14:20.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc21d0f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc1c15fc60 0x7efc1c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:20.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc21d0f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc1c15fc60 0x7efc1c06a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56166/0 (socket says 172.21.15.12:56166) 2023-07-07T18:14:20.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc21d0f700 1 -- 172.21.15.12:0/4216250848 learned_addr learned my addr 172.21.15.12:0/4216250848 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:20.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc21d0f700 1 -- 172.21.15.12:0/4216250848 >> v2:172.21.15.12:3300/0 conn(0x7efc1c15fc60 msgr2=0x7efc1c06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-07T18:14:20.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc21d0f700 1 -- 172.21.15.12:0/4216250848 >> v2:172.21.15.12:3300/0 conn(0x7efc1c15fc60 msgr2=0x7efc1c06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-07T18:14:20.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc21d0f700 1 --2- 172.21.15.12:0/4216250848 >> v2:172.21.15.12:3300/0 conn(0x7efc1c15fc60 0x7efc1c06a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-07T18:14:20.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.732+0000 7efc21d0f700 1 --2- 172.21.15.12:0/4216250848 >> v2:172.21.15.12:3300/0 conn(0x7efc1c15fc60 0x7efc1c06a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-07T18:14:20.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.733+0000 7efc22510700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 0x7efc1c0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:20.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.733+0000 7efc22510700 1 -- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 msgr2=0x7efc1c0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-07T18:14:20.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.733+0000 7efc22510700 1 -- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 msgr2=0x7efc1c0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-07T18:14:20.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.733+0000 7efc22510700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 0x7efc1c0ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-07T18:14:20.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.733+0000 7efc22510700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 0x7efc1c0ac600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-07T18:14:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.926+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649411632 0 0) 0x7efc1c0ce620 con 0x7efc1c0aecc0 2023-07-07T18:14:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.926+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc040035b0 con 0x7efc1c0aecc0 2023-07-07T18:14:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2396008981 0 0) 0x7efc040035b0 con 0x7efc1c0aecc0 2023-07-07T18:14:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 msgr2=0x7efc1c0ac600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T18:14:20.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 0x7efc1c0ac600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 >> v2:172.21.15.12:3300/0 conn(0x7efc1c15fc60 msgr2=0x7efc1c06a900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T18:14:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 --2- 172.21.15.12:0/4216250848 >> v2:172.21.15.12:3300/0 conn(0x7efc1c15fc60 0x7efc1c06a900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c160b40 con 0x7efc1c0aecc0 2023-07-07T18:14:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7efc10001670 con 0x7efc1c0aecc0 2023-07-07T18:14:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 >> v1:172.21.15.12:6789/0 conn(0x7efc1c0aecc0 legacy=0x7efc1c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 0x7efc04003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04003ff0 0x7efc04004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc04004d90 0x7efc04005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c160580 con 0x7efc04003ff0 2023-07-07T18:14:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c160860 con 0x7efc04004d90 2023-07-07T18:14:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.928+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0400bac0 con 0x7efc1c06e970 2023-07-07T18:14:20.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc21d0f700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 0x7efc04003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:20.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc2150e700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04003ff0 0x7efc04004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:20.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc22510700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc04004d90 0x7efc04005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:20.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc2150e700 1 -- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 msgr2=0x7efc04003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:20.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc2150e700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 0x7efc04003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc2150e700 1 -- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc04004d90 msgr2=0x7efc04005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc2150e700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc04004d90 0x7efc04005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc2150e700 1 -- 172.21.15.12:0/4216250848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040035b0 con 0x7efc04003ff0 2023-07-07T18:14:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc21d0f700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c06e970 0x7efc04003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:14:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc2150e700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04003ff0 0x7efc04004850 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0af090 tx=0x7efc04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635070965edefb79 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10003820 con 0x7efc04003ff0 2023-07-07T18:14:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10006310 con 0x7efc04003ff0 2023-07-07T18:14:20.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.929+0000 7efc20d0d700 1 -- 172.21.15.12:0/4216250848 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc100046d0 con 0x7efc04003ff0 2023-07-07T18:14:20.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.930+0000 7efc23f73700 1 -- 172.21.15.12:0/4216250848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04003ff0 msgr2=0x7efc04004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.930+0000 7efc23f73700 1 --2- 172.21.15.12:0/4216250848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc04003ff0 0x7efc04004850 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0af090 tx=0x7efc04005880 comp rx=0 tx=0).stop 2023-07-07T18:14:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.930+0000 7efc22510700 1 -- 172.21.15.12:0/4216250848 reap_dead start 2023-07-07T18:14:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.930+0000 7efc23f73700 1 -- 172.21.15.12:0/4216250848 shutdown_connections 2023-07-07T18:14:20.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.930+0000 7efc23f73700 1 -- 172.21.15.12:0/4216250848 >> 172.21.15.12:0/4216250848 conn(0x7efc1c06b920 msgr2=0x7efc1c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.930+0000 7efc23f73700 1 -- 172.21.15.12:0/4216250848 shutdown_connections 2023-07-07T18:14:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.930+0000 7efc23f73700 1 -- 172.21.15.12:0/4216250848 wait complete. 2023-07-07T18:14:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.932+0000 7efc23f73700 1 Processor -- start 2023-07-07T18:14:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.932+0000 7efc23f73700 1 -- start start 2023-07-07T18:14:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc23f73700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc04003ff0 0x7efc1c1f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc23f73700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c0c6ae0 0x7efc1c0ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:20.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc23f73700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c0b52b0 0x7efc1c152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc23f73700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c154250 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc23f73700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0b5820 con 0x7efc04003ff0 2023-07-07T18:14:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc23f73700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c0b3940 con 0x7efc1c0b52b0 2023-07-07T18:14:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc2150e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c0c6ae0 0x7efc1c0ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc2150e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c0c6ae0 0x7efc1c0ad660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56200/0 (socket says 172.21.15.12:56200) 2023-07-07T18:14:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc21d0f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc04003ff0 0x7efc1c1f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:20.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc2150e700 1 -- 172.21.15.12:0/839361605 learned_addr learned my addr 172.21.15.12:0/839361605 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc22510700 1 --2- 172.21.15.12:0/839361605 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c0b52b0 0x7efc1c152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc2150e700 1 -- 172.21.15.12:0/839361605 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c0b52b0 msgr2=0x7efc1c152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc2150e700 1 --2- 172.21.15.12:0/839361605 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c0b52b0 0x7efc1c152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc2150e700 1 -- 172.21.15.12:0/839361605 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc04003ff0 msgr2=0x7efc1c1f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc2150e700 1 --2- 172.21.15.12:0/839361605 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc04003ff0 0x7efc1c1f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc2150e700 1 -- 172.21.15.12:0/839361605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c0c6440 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc2150e700 1 --2- 172.21.15.12:0/839361605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c0c6ae0 0x7efc1c0ad660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc0400ba10 tx=0x7efc10003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:20.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.933+0000 7efc1a7fc700 1 -- 172.21.15.12:0/839361605 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10006480 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.934+0000 7efc1a7fc700 1 -- 172.21.15.12:0/839361605 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10007870 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.934+0000 7efc23f73700 1 -- 172.21.15.12:0/839361605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c0b3be0 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.934+0000 7efc1a7fc700 1 -- 172.21.15.12:0/839361605 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10007c20 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.934+0000 7efc23f73700 1 -- 172.21.15.12:0/839361605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c0c6160 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.934+0000 7efc1a7fc700 1 -- 172.21.15.12:0/839361605 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc10008030 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.934+0000 7efc1a7fc700 1 -- 172.21.15.12:0/839361605 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efc100016b0 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.935+0000 7efc23f73700 1 -- 172.21.15.12:0/839361605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c0b3d70 con 0x7efc1c0c6ae0 2023-07-07T18:14:20.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:20.937+0000 7efc1a7fc700 1 -- 172.21.15.12:0/839361605 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7efc10025070 con 0x7efc1c0c6ae0 2023-07-07T18:14:21.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.014+0000 7efc23f73700 1 -- 172.21.15.12:0/839361605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7efc1c0741b0 con 0x7efc1c0c6ae0 2023-07-07T18:14:21.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.018+0000 7efc1a7fc700 1 -- 172.21.15.12:0/839361605 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7efc1001a040 con 0x7efc1c0c6ae0 2023-07-07T18:14:21.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.019+0000 7efc23f73700 1 -- 172.21.15.12:0/839361605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c0c6ae0 msgr2=0x7efc1c0ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.019+0000 7efc23f73700 1 --2- 172.21.15.12:0/839361605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c0c6ae0 0x7efc1c0ad660 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc0400ba10 tx=0x7efc10003780 comp rx=0 tx=0).stop 2023-07-07T18:14:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.019+0000 7efc23f73700 1 -- 172.21.15.12:0/839361605 shutdown_connections 2023-07-07T18:14:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.019+0000 7efc23f73700 1 --2- 172.21.15.12:0/839361605 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc1c0b52b0 0x7efc1c152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.019+0000 7efc23f73700 1 --2- 172.21.15.12:0/839361605 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc04003ff0 0x7efc1c1f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.019+0000 7efc23f73700 1 --2- 172.21.15.12:0/839361605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc1c0c6ae0 0x7efc1c0ad660 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.019+0000 7efc23f73700 1 -- 172.21.15.12:0/839361605 >> 172.21.15.12:0/839361605 conn(0x7efc1c06b920 msgr2=0x7efc1c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.019+0000 7efc23f73700 1 -- 172.21.15.12:0/839361605 shutdown_connections 2023-07-07T18:14:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:21.019+0000 7efc23f73700 1 -- 172.21.15.12:0/839361605 wait complete. 2023-07-07T18:14:21.022 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2023-07-07T18:14:21.033 INFO:tasks.ceph:check_enable_crimson: False 2023-07-07T18:14:21.033 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-07T18:14:21.034 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:21.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-07T18:14:21.042 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:21.041+0000 7f3573e5e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-07T18:14:21.052 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:21.051+0000 7f23b0270200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-07T18:14:21.061 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:21.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-07T18:14:21.107 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:21.106+0000 7f3573e5e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-07T18:14:21.125 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:21.124+0000 7f23b0270200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-07T18:14:21.131 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:21.132 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-07T18:14:21.182 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:21.181+0000 7f3573e5e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-07T18:14:21.197 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:21.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-07T18:14:21.208 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:21.206+0000 7f23b0270200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-07T18:14:21.235 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:21.235 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-07T18:14:21.261 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:21.260+0000 7f3573e5e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-07T18:14:21.263 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:21.263 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-07T18:14:21.292 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:21.292+0000 7f23b0270200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-07T18:14:21.329 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:21.329 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-07T18:14:21.395 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:14:21.395 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-07T18:14:21.410 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:21.409+0000 7f3573e5e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-07T18:14:21.435 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 2f33734e-017d-4614-b88b-df0cb9c4af35 0 2023-07-07T18:14:21.442 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:21.441+0000 7f23b0270200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-07T18:14:21.597 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.596+0000 7efc35edc700 1 Processor -- start 2023-07-07T18:14:21.598 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.596+0000 7efc35edc700 1 -- start start 2023-07-07T18:14:21.599 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc35edc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc300cd5e0 0x7efc300cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.600 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc35edc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc3006e030 0x7efc3006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.600 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc35edc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3006f0e0 con 0x7efc3015cf70 2023-07-07T18:14:21.600 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc35edc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc300ce2c0 con 0x7efc3006e030 2023-07-07T18:14:21.600 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc35edc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc300cdef0 con 0x7efc300cd5e0 2023-07-07T18:14:21.600 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc2f7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc300cd5e0 0x7efc300cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.600 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc2ffff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7efc3015cf70 0x7efc3015d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:33310/0 (socket says 172.21.15.160:33310) 2023-07-07T18:14:21.600 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc2ffff700 1 -- 172.21.15.160:0/906142579 learned_addr learned my addr 172.21.15.160:0/906142579 (peer_addr_for_me v1:172.21.15.160:0/0) 2023-07-07T18:14:21.601 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc2effd700 1 --2- 172.21.15.160:0/906142579 >> v2:172.21.15.12:3300/0 conn(0x7efc3006e030 0x7efc3006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.601 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc2f7fe700 1 -- 172.21.15.160:0/906142579 >> v2:172.21.15.12:3300/0 conn(0x7efc3006e030 msgr2=0x7efc3006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:21.601 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc2e7fc700 1 -- 172.21.15.160:0/906142579 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1682008070 0 0) 0x7efc3006f0e0 con 0x7efc3015cf70 2023-07-07T18:14:21.601 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc2f7fe700 1 --2- 172.21.15.160:0/906142579 >> v2:172.21.15.12:3300/0 conn(0x7efc3006e030 0x7efc3006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.601 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc2f7fe700 1 -- 172.21.15.160:0/906142579 >> v1:172.21.15.160:6789/0 conn(0x7efc3015cf70 legacy=0x7efc3015d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.601 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.597+0000 7efc2f7fe700 1 -- 172.21.15.160:0/906142579 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3006eb20 con 0x7efc300cd5e0 2023-07-07T18:14:21.601 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc2f7fe700 1 --2- 172.21.15.160:0/906142579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc300cd5e0 0x7efc300cd9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efc20009820 tx=0x7efc20009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5329d4c2f1f8a545 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:21.602 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc2e7fc700 1 -- 172.21.15.160:0/906142579 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc20005e30 con 0x7efc300cd5e0 2023-07-07T18:14:21.602 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc2e7fc700 1 -- 172.21.15.160:0/906142579 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc20006030 con 0x7efc300cd5e0 2023-07-07T18:14:21.602 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc2e7fc700 1 -- 172.21.15.160:0/906142579 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200063c0 con 0x7efc300cd5e0 2023-07-07T18:14:21.602 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc35edc700 1 -- 172.21.15.160:0/906142579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc300cd5e0 msgr2=0x7efc300cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.602 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc35edc700 1 --2- 172.21.15.160:0/906142579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc300cd5e0 0x7efc300cd9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efc20009820 tx=0x7efc20009b30 comp rx=0 tx=0).stop 2023-07-07T18:14:21.602 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc35edc700 1 -- 172.21.15.160:0/906142579 shutdown_connections 2023-07-07T18:14:21.602 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc35edc700 1 --2- 172.21.15.160:0/906142579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc300cd5e0 0x7efc300cd9b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.602 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc35edc700 1 --2- 172.21.15.160:0/906142579 >> v2:172.21.15.12:3300/0 conn(0x7efc3006e030 0x7efc3006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.603 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc35edc700 1 -- 172.21.15.160:0/906142579 >> 172.21.15.160:0/906142579 conn(0x7efc3006b920 msgr2=0x7efc300cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:21.603 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc35edc700 1 -- 172.21.15.160:0/906142579 shutdown_connections 2023-07-07T18:14:21.603 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.598+0000 7efc35edc700 1 -- 172.21.15.160:0/906142579 wait complete. 2023-07-07T18:14:21.604 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.599+0000 7efc35edc700 1 Processor -- start 2023-07-07T18:14:21.605 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.600+0000 7efc35edc700 1 -- start start 2023-07-07T18:14:21.605 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.600+0000 7efc35edc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc3006e030 0x7efc300b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.605 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.600+0000 7efc35edc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc300cd5e0 0x7efc301f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.605 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.600+0000 7efc35edc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc3015cf70 0x7efc300c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.605 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.600+0000 7efc35edc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc30142910 con 0x7efc300cd5e0 2023-07-07T18:14:21.605 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.600+0000 7efc35edc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc300c62a0 con 0x7efc3015cf70 2023-07-07T18:14:21.605 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.600+0000 7efc35edc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc300c5720 con 0x7efc3006e030 2023-07-07T18:14:21.606 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.600+0000 7efc2f7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc3006e030 0x7efc300b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.606 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2f7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc3006e030 0x7efc300b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:45240/0 (socket says 172.21.15.160:45240) 2023-07-07T18:14:21.606 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2f7fe700 1 -- 172.21.15.160:0/1678170090 learned_addr learned my addr 172.21.15.160:0/1678170090 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:21.606 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2ffff700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc3015cf70 0x7efc300c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.606 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2effd700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc300cd5e0 0x7efc301f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.606 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2ffff700 1 -- 172.21.15.160:0/1678170090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc3006e030 msgr2=0x7efc300b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.606 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2ffff700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc3006e030 0x7efc300b5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.606 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2ffff700 1 -- 172.21.15.160:0/1678170090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc300cd5e0 msgr2=0x7efc301f20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.607 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2ffff700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc300cd5e0 0x7efc301f20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.607 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2ffff700 1 -- 172.21.15.160:0/1678170090 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20009430 con 0x7efc3015cf70 2023-07-07T18:14:21.607 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2f7fe700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc3006e030 0x7efc300b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:14:21.607 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc2ffff700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc3015cf70 0x7efc300c3290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc2800ef80 tx=0x7efc28010330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:21.607 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc17fff700 1 -- 172.21.15.160:0/1678170090 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28013070 con 0x7efc3015cf70 2023-07-07T18:14:21.607 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc17fff700 1 -- 172.21.15.160:0/1678170090 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc280109d0 con 0x7efc3015cf70 2023-07-07T18:14:21.607 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc17fff700 1 -- 172.21.15.160:0/1678170090 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28010d60 con 0x7efc3015cf70 2023-07-07T18:14:21.608 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc35edc700 1 -- 172.21.15.160:0/1678170090 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc300c5a00 con 0x7efc3015cf70 2023-07-07T18:14:21.608 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc35edc700 1 -- 172.21.15.160:0/1678170090 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc300c5fc0 con 0x7efc3015cf70 2023-07-07T18:14:21.608 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc17fff700 1 -- 172.21.15.160:0/1678170090 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc280073d0 con 0x7efc3015cf70 2023-07-07T18:14:21.608 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.601+0000 7efc17fff700 1 -- 172.21.15.160:0/1678170090 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7efc2800c9b0 con 0x7efc3015cf70 2023-07-07T18:14:21.608 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.602+0000 7efc35edc700 1 -- 172.21.15.160:0/1678170090 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3015a830 con 0x7efc3015cf70 2023-07-07T18:14:21.608 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.604+0000 7efc17fff700 1 -- 172.21.15.160:0/1678170090 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7efc3015a830 con 0x7efc3015cf70 2023-07-07T18:14:21.688 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.687+0000 7efc35edc700 1 -- 172.21.15.160:0/1678170090 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2f33734e-017d-4614-b88b-df0cb9c4af35", "id": 0} v 0) v1 -- 0x7efc30070910 con 0x7efc3015cf70 2023-07-07T18:14:21.693 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.693+0000 7efc17fff700 1 -- 172.21.15.160:0/1678170090 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f33734e-017d-4614-b88b-df0cb9c4af35", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7efc2801e020 con 0x7efc3015cf70 2023-07-07T18:14:21.694 INFO:teuthology.orchestra.run.smithi160.stdout:0 2023-07-07T18:14:21.695 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.694+0000 7efc35edc700 1 -- 172.21.15.160:0/1678170090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc3015cf70 msgr2=0x7efc300c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.695 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.694+0000 7efc35edc700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc3015cf70 0x7efc300c3290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efc2800ef80 tx=0x7efc28010330 comp rx=0 tx=0).stop 2023-07-07T18:14:21.695 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.694+0000 7efc35edc700 1 -- 172.21.15.160:0/1678170090 shutdown_connections 2023-07-07T18:14:21.695 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.694+0000 7efc35edc700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc3015cf70 0x7efc300c3290 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.695 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.694+0000 7efc35edc700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc3006e030 0x7efc300b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.695 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.694+0000 7efc35edc700 1 --2- 172.21.15.160:0/1678170090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc300cd5e0 0x7efc301f20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.696 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.694+0000 7efc35edc700 1 -- 172.21.15.160:0/1678170090 >> 172.21.15.160:0/1678170090 conn(0x7efc3006b920 msgr2=0x7efc300ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:21.696 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.694+0000 7efc35edc700 1 -- 172.21.15.160:0/1678170090 shutdown_connections 2023-07-07T18:14:21.696 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.694+0000 7efc35edc700 1 -- 172.21.15.160:0/1678170090 wait complete. 2023-07-07T18:14:21.706 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 05872099-8d4c-4dff-9448-bda38b002ab7 1 2023-07-07T18:14:21.755 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:21.754+0000 7f3573e5e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-07T18:14:21.803 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:21.803+0000 7f23b0270200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-07T18:14:21.835 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.834+0000 7f457eb92700 1 Processor -- start 2023-07-07T18:14:21.835 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.834+0000 7f457eb92700 1 -- start start 2023-07-07T18:14:21.844 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f457eb92700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45780cd5e0 0x7f45780cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.844 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f457eb92700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457806f0e0 con 0x7f45780adf40 2023-07-07T18:14:21.845 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f457eb92700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457815dd90 con 0x7f457806e030 2023-07-07T18:14:21.845 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f457eb92700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45780ce2c0 con 0x7f45780cd5e0 2023-07-07T18:14:21.845 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f4577fff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f457806e030 0x7f457815cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:33318/0 (socket says 172.21.15.160:33318) 2023-07-07T18:14:21.845 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f4577fff700 1 -- 172.21.15.160:0/3851552022 learned_addr learned my addr 172.21.15.160:0/3851552022 (peer_addr_for_me v1:172.21.15.160:0/0) 2023-07-07T18:14:21.846 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f457c92e700 1 --2- 172.21.15.160:0/3851552022 >> v2:172.21.15.12:3300/0 conn(0x7f45780cd5e0 0x7f45780cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.846 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597991359 0 0) 0x7f457815dd90 con 0x7f457806e030 2023-07-07T18:14:21.846 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45680035b0 con 0x7f457806e030 2023-07-07T18:14:21.847 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1698947527 0 0) 0x7f45680035b0 con 0x7f457806e030 2023-07-07T18:14:21.847 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 >> v2:172.21.15.12:3300/0 conn(0x7f45780cd5e0 msgr2=0x7f45780cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:21.847 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 --2- 172.21.15.160:0/3851552022 >> v2:172.21.15.12:3300/0 conn(0x7f45780cd5e0 0x7f45780cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.847 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 >> v1:172.21.15.12:6789/0 conn(0x7f45780adf40 legacy=0x7f457815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.848 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780cdef0 con 0x7f457806e030 2023-07-07T18:14:21.848 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f45640016b0 con 0x7f457806e030 2023-07-07T18:14:21.848 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 >> v1:172.21.15.160:6789/0 conn(0x7f457806e030 legacy=0x7f457815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.848 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.835+0000 7f45777fe700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4568003a00 0x7f4568003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.849 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f45777fe700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4568004850 0x7f4568004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.849 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f45777fe700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4568005200 0x7f456800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.849 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780ce2c0 con 0x7f4568005200 2023-07-07T18:14:21.850 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456800c110 con 0x7f4568003a00 2023-07-07T18:14:21.850 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456800c2d0 con 0x7f4568004850 2023-07-07T18:14:21.850 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f457c92e700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4568003a00 0x7f4568003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.851 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f4577fff700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4568004850 0x7f4568004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.851 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f457d12f700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4568005200 0x7f456800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.851 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f457c92e700 1 -- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4568004850 msgr2=0x7f4568004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:21.851 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f457c92e700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4568004850 0x7f4568004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.852 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f457c92e700 1 -- 172.21.15.160:0/3851552022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4568005200 msgr2=0x7f456800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:21.852 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f457c92e700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4568005200 0x7f456800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.852 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f457c92e700 1 -- 172.21.15.160:0/3851552022 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45680035b0 con 0x7f4568003a00 2023-07-07T18:14:21.853 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f457d12f700 1 -- 172.21.15.160:0/3851552022 reap_dead start 2023-07-07T18:14:21.853 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f457c92e700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4568003a00 0x7f4568003e10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f456c009b40 tx=0x7f4568005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ded2f4c05d187b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:21.853 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c005a20 con 0x7f4568003a00 2023-07-07T18:14:21.853 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c005b80 con 0x7f4568003a00 2023-07-07T18:14:21.854 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.836+0000 7f45777fe700 1 -- 172.21.15.160:0/3851552022 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c00e6c0 con 0x7f4568003a00 2023-07-07T18:14:21.854 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.837+0000 7f457eb92700 1 -- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4568003a00 msgr2=0x7f4568003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.854 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.837+0000 7f457eb92700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4568003a00 0x7f4568003e10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f456c009b40 tx=0x7f4568005880 comp rx=0 tx=0).stop 2023-07-07T18:14:21.855 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.837+0000 7f457eb92700 1 -- 172.21.15.160:0/3851552022 shutdown_connections 2023-07-07T18:14:21.855 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.837+0000 7f457eb92700 1 --2- 172.21.15.160:0/3851552022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4568003a00 0x7f4568003e10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.855 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.837+0000 7f457eb92700 1 -- 172.21.15.160:0/3851552022 >> 172.21.15.160:0/3851552022 conn(0x7f457806b920 msgr2=0x7f45780cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:21.855 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.837+0000 7f457eb92700 1 -- 172.21.15.160:0/3851552022 shutdown_connections 2023-07-07T18:14:21.855 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.837+0000 7f457eb92700 1 -- 172.21.15.160:0/3851552022 wait complete. 2023-07-07T18:14:21.856 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.839+0000 7f457eb92700 1 Processor -- start 2023-07-07T18:14:21.856 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.839+0000 7f457eb92700 1 -- start start 2023-07-07T18:14:21.856 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.840+0000 7f457eb92700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4568003a00 0x7f457815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.856 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457eb92700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45780c5f10 0x7f45781525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.856 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457eb92700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45781ef320 0x7f45780b1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:21.856 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457eb92700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4578152b30 con 0x7f4568003a00 2023-07-07T18:14:21.856 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457eb92700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45781ef820 con 0x7f45780c5f10 2023-07-07T18:14:21.857 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457eb92700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45781efb00 con 0x7f45781ef320 2023-07-07T18:14:21.857 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f4577fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45780c5f10 0x7f45781525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.857 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457d12f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45781ef320 0x7f45780b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.857 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f4577fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45780c5f10 0x7f45781525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:36762/0 (socket says 172.21.15.160:36762) 2023-07-07T18:14:21.857 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f4577fff700 1 -- 172.21.15.160:0/4199978074 learned_addr learned my addr 172.21.15.160:0/4199978074 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:21.857 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457c92e700 1 --2- 172.21.15.160:0/4199978074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4568003a00 0x7f457815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:21.857 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f4577fff700 1 -- 172.21.15.160:0/4199978074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45781ef320 msgr2=0x7f45780b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.858 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f4577fff700 1 --2- 172.21.15.160:0/4199978074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45781ef320 0x7f45780b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.858 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f4577fff700 1 -- 172.21.15.160:0/4199978074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4568003a00 msgr2=0x7f457815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.858 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f4577fff700 1 --2- 172.21.15.160:0/4199978074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4568003a00 0x7f457815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.858 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f4577fff700 1 -- 172.21.15.160:0/4199978074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45781efde0 con 0x7f45780c5f10 2023-07-07T18:14:21.858 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457d12f700 1 --2- 172.21.15.160:0/4199978074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45781ef320 0x7f45780b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:14:21.859 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f4577fff700 1 --2- 172.21.15.160:0/4199978074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45780c5f10 0x7f45781525f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45640072e0 tx=0x7f45640075f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:21.859 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f45757fa700 1 -- 172.21.15.160:0/4199978074 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45640015d0 con 0x7f45780c5f10 2023-07-07T18:14:21.859 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f45757fa700 1 -- 172.21.15.160:0/4199978074 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4564012780 con 0x7f45780c5f10 2023-07-07T18:14:21.859 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457eb92700 1 -- 172.21.15.160:0/4199978074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45781f00c0 con 0x7f45780c5f10 2023-07-07T18:14:21.859 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f45757fa700 1 -- 172.21.15.160:0/4199978074 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564012b10 con 0x7f45780c5f10 2023-07-07T18:14:21.859 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.841+0000 7f457eb92700 1 -- 172.21.15.160:0/4199978074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4578152f40 con 0x7f45780c5f10 2023-07-07T18:14:21.860 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.842+0000 7f45757fa700 1 -- 172.21.15.160:0/4199978074 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4564018020 con 0x7f45780c5f10 2023-07-07T18:14:21.860 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.842+0000 7f45757fa700 1 -- 172.21.15.160:0/4199978074 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f456401a780 con 0x7f45780c5f10 2023-07-07T18:14:21.860 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.843+0000 7f457eb92700 1 -- 172.21.15.160:0/4199978074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45781f02b0 con 0x7f45780c5f10 2023-07-07T18:14:21.860 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:21.843+0000 7f3573e5e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-07T18:14:21.861 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.845+0000 7f45757fa700 1 -- 172.21.15.160:0/4199978074 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f456403ab00 con 0x7f45780c5f10 2023-07-07T18:14:21.883 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:21.882+0000 7f23b0270200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-07T18:14:21.945 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.944+0000 7f457eb92700 1 -- 172.21.15.160:0/4199978074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "05872099-8d4c-4dff-9448-bda38b002ab7", "id": 1} v 0) v1 -- 0x7f45780af5e0 con 0x7f45780c5f10 2023-07-07T18:14:21.952 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.952+0000 7f45757fa700 1 -- 172.21.15.160:0/4199978074 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "05872099-8d4c-4dff-9448-bda38b002ab7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f45780af5e0 con 0x7f45780c5f10 2023-07-07T18:14:21.953 INFO:teuthology.orchestra.run.smithi160.stdout:1 2023-07-07T18:14:21.954 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.953+0000 7f457eb92700 1 -- 172.21.15.160:0/4199978074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45780c5f10 msgr2=0x7f45781525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:21.954 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.953+0000 7f457eb92700 1 --2- 172.21.15.160:0/4199978074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45780c5f10 0x7f45781525f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45640072e0 tx=0x7f45640075f0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.954 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.953+0000 7f457eb92700 1 -- 172.21.15.160:0/4199978074 shutdown_connections 2023-07-07T18:14:21.954 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.953+0000 7f457eb92700 1 --2- 172.21.15.160:0/4199978074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45781ef320 0x7f45780b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.954 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.953+0000 7f457eb92700 1 --2- 172.21.15.160:0/4199978074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4568003a00 0x7f457815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.954 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.953+0000 7f457eb92700 1 --2- 172.21.15.160:0/4199978074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45780c5f10 0x7f45781525f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:21.955 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.953+0000 7f457eb92700 1 -- 172.21.15.160:0/4199978074 >> 172.21.15.160:0/4199978074 conn(0x7f457806b920 msgr2=0x7f45780ad660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:21.955 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.953+0000 7f457eb92700 1 -- 172.21.15.160:0/4199978074 shutdown_connections 2023-07-07T18:14:21.955 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:21.953+0000 7f457eb92700 1 -- 172.21.15.160:0/4199978074 wait complete. 2023-07-07T18:14:21.965 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 4d42dfd6-cf7c-4309-82e0-bba598ca05b8 2 2023-07-07T18:14:21.989 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:21.988+0000 7f3573e5e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-07T18:14:22.028 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:22.027+0000 7f23b0270200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-07T18:14:22.074 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:22.073+0000 7f3573e5e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-07T18:14:22.086 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.085+0000 7f2917596700 1 Processor -- start 2023-07-07T18:14:22.086 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.085+0000 7f2917596700 1 -- start start 2023-07-07T18:14:22.087 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2917596700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291015a430 0x7f291006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2917596700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29100aee00 con 0x7f29100acd10 2023-07-07T18:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2917596700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291006e340 con 0x7f29100ae8b0 2023-07-07T18:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2917596700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29100af330 con 0x7f291015a430 2023-07-07T18:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2915332700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291015a430 0x7f291006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2915332700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291015a430 0x7f291006e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:45264/0 (socket says 172.21.15.160:45264) 2023-07-07T18:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2915332700 1 -- 172.21.15.160:0/2800462708 learned_addr learned my addr 172.21.15.160:0/2800462708 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:22.090 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2915332700 1 -- 172.21.15.160:0/2800462708 >> v1:172.21.15.160:6789/0 conn(0x7f29100ae8b0 legacy=0x7f29100ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.090 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2915332700 1 -- 172.21.15.160:0/2800462708 >> v1:172.21.15.12:6789/0 conn(0x7f29100acd10 legacy=0x7f291015e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.090 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2907fff700 1 -- 172.21.15.160:0/2800462708 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731090107 0 0) 0x7f291006e340 con 0x7f29100ae8b0 2023-07-07T18:14:22.090 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2915332700 1 -- 172.21.15.160:0/2800462708 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100af050 con 0x7f291015a430 2023-07-07T18:14:22.090 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.087+0000 7f2915332700 1 --2- 172.21.15.160:0/2800462708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291015a430 0x7f291006e7d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f290c0098f0 tx=0x7f290c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c74336acfe74ed4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:22.090 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.088+0000 7f2907fff700 1 -- 172.21.15.160:0/2800462708 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c005e30 con 0x7f291015a430 2023-07-07T18:14:22.090 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.088+0000 7f2907fff700 1 -- 172.21.15.160:0/2800462708 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c004030 con 0x7f291015a430 2023-07-07T18:14:22.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.088+0000 7f2907fff700 1 -- 172.21.15.160:0/2800462708 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c0043e0 con 0x7f291015a430 2023-07-07T18:14:22.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.088+0000 7f2917596700 1 -- 172.21.15.160:0/2800462708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291015a430 msgr2=0x7f291006e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.088+0000 7f2917596700 1 --2- 172.21.15.160:0/2800462708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291015a430 0x7f291006e7d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f290c0098f0 tx=0x7f290c009c00 comp rx=0 tx=0).stop 2023-07-07T18:14:22.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.088+0000 7f2917596700 1 -- 172.21.15.160:0/2800462708 shutdown_connections 2023-07-07T18:14:22.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.088+0000 7f2917596700 1 --2- 172.21.15.160:0/2800462708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291015a430 0x7f291006e7d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.088+0000 7f2917596700 1 -- 172.21.15.160:0/2800462708 >> 172.21.15.160:0/2800462708 conn(0x7f291006b920 msgr2=0x7f29100cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:22.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.089+0000 7f2917596700 1 -- 172.21.15.160:0/2800462708 shutdown_connections 2023-07-07T18:14:22.092 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.089+0000 7f2917596700 1 -- 172.21.15.160:0/2800462708 wait complete. 2023-07-07T18:14:22.093 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.090+0000 7f2917596700 1 Processor -- start 2023-07-07T18:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.090+0000 7f2917596700 1 -- start start 2023-07-07T18:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2917596700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29100acd10 0x7f29100c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2917596700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29100ae8b0 0x7f29100b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2917596700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f291015a430 0x7f29100c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2917596700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29100c7240 con 0x7f291015a430 2023-07-07T18:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2917596700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2910152810 con 0x7f29100ae8b0 2023-07-07T18:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2917596700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29100c9a00 con 0x7f29100acd10 2023-07-07T18:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2915332700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29100acd10 0x7f29100c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2915332700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29100acd10 0x7f29100c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:45270/0 (socket says 172.21.15.160:45270) 2023-07-07T18:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2915332700 1 -- 172.21.15.160:0/1088128438 learned_addr learned my addr 172.21.15.160:0/1088128438 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2914b31700 1 --2- 172.21.15.160:0/1088128438 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29100ae8b0 0x7f29100b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2915b33700 1 --2- 172.21.15.160:0/1088128438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f291015a430 0x7f29100c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2914b31700 1 -- 172.21.15.160:0/1088128438 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29100acd10 msgr2=0x7f29100c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2914b31700 1 --2- 172.21.15.160:0/1088128438 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29100acd10 0x7f29100c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2914b31700 1 -- 172.21.15.160:0/1088128438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f291015a430 msgr2=0x7f29100c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2914b31700 1 --2- 172.21.15.160:0/1088128438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f291015a430 0x7f29100c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2914b31700 1 -- 172.21.15.160:0/1088128438 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c009500 con 0x7f29100ae8b0 2023-07-07T18:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2914b31700 1 --2- 172.21.15.160:0/1088128438 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29100ae8b0 0x7f29100b1870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f290000c460 tx=0x7f290000c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2905ffb700 1 -- 172.21.15.160:0/1088128438 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000054e0 con 0x7f29100ae8b0 2023-07-07T18:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2905ffb700 1 -- 172.21.15.160:0/1088128438 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290000ce30 con 0x7f29100ae8b0 2023-07-07T18:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2917596700 1 -- 172.21.15.160:0/1088128438 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29100c6c80 con 0x7f29100ae8b0 2023-07-07T18:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.092+0000 7f2905ffb700 1 -- 172.21.15.160:0/1088128438 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000038c0 con 0x7f29100ae8b0 2023-07-07T18:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.093+0000 7f2905ffb700 1 -- 172.21.15.160:0/1088128438 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2900003d20 con 0x7f29100ae8b0 2023-07-07T18:14:22.097 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.093+0000 7f2917596700 1 -- 172.21.15.160:0/1088128438 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29100b1070 con 0x7f29100ae8b0 2023-07-07T18:14:22.097 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.093+0000 7f2905ffb700 1 -- 172.21.15.160:0/1088128438 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2900012db0 con 0x7f29100ae8b0 2023-07-07T18:14:22.097 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.094+0000 7f2917596700 1 -- 172.21.15.160:0/1088128438 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29100b0ed0 con 0x7f29100ae8b0 2023-07-07T18:14:22.097 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.096+0000 7f2905ffb700 1 -- 172.21.15.160:0/1088128438 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f29100b0ed0 con 0x7f29100ae8b0 2023-07-07T18:14:22.113 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:22.112+0000 7f23b0270200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-07T18:14:22.190 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.189+0000 7f2917596700 1 -- 172.21.15.160:0/1088128438 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4d42dfd6-cf7c-4309-82e0-bba598ca05b8", "id": 2} v 0) v1 -- 0x7f291004ea20 con 0x7f29100ae8b0 2023-07-07T18:14:22.196 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.195+0000 7f2905ffb700 1 -- 172.21.15.160:0/1088128438 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d42dfd6-cf7c-4309-82e0-bba598ca05b8", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2900017070 con 0x7f29100ae8b0 2023-07-07T18:14:22.196 INFO:teuthology.orchestra.run.smithi160.stdout:2 2023-07-07T18:14:22.197 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.196+0000 7f2917596700 1 -- 172.21.15.160:0/1088128438 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29100ae8b0 msgr2=0x7f29100b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.197 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.196+0000 7f2917596700 1 --2- 172.21.15.160:0/1088128438 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29100ae8b0 0x7f29100b1870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f290000c460 tx=0x7f290000c770 comp rx=0 tx=0).stop 2023-07-07T18:14:22.197 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.196+0000 7f2917596700 1 -- 172.21.15.160:0/1088128438 shutdown_connections 2023-07-07T18:14:22.197 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.196+0000 7f2917596700 1 --2- 172.21.15.160:0/1088128438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f291015a430 0x7f29100c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.198 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.196+0000 7f2917596700 1 --2- 172.21.15.160:0/1088128438 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29100acd10 0x7f29100c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.198 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.196+0000 7f2917596700 1 --2- 172.21.15.160:0/1088128438 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29100ae8b0 0x7f29100b1870 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.198 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.196+0000 7f2917596700 1 -- 172.21.15.160:0/1088128438 >> 172.21.15.160:0/1088128438 conn(0x7f291006b920 msgr2=0x7f291006d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:22.198 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.196+0000 7f2917596700 1 -- 172.21.15.160:0/1088128438 shutdown_connections 2023-07-07T18:14:22.198 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.196+0000 7f2917596700 1 -- 172.21.15.160:0/1088128438 wait complete. 2023-07-07T18:14:22.209 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 55dc08a3-2854-40d6-9e14-5c45ef4ec196 3 2023-07-07T18:14:22.370 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.369+0000 7f597ba3c700 1 Processor -- start 2023-07-07T18:14:22.370 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.369+0000 7f597ba3c700 1 -- start start 2023-07-07T18:14:22.371 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.370+0000 7f597ba3c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 0x7f59740b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.370+0000 7f597ba3c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59740cd9d0 con 0x7f59740cf910 2023-07-07T18:14:22.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.370+0000 7f597ba3c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59740b5640 con 0x7f59740b51d0 2023-07-07T18:14:22.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.370+0000 7f597ba3c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59740d0060 con 0x7f59740d0a60 2023-07-07T18:14:22.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.370+0000 7f5978fd7700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f59740b51d0 0x7f59740d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:33350/0 (socket says 172.21.15.160:33350) 2023-07-07T18:14:22.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.370+0000 7f5978fd7700 1 -- 172.21.15.160:0/1189163482 learned_addr learned my addr 172.21.15.160:0/1189163482 (peer_addr_for_me v1:172.21.15.160:0/0) 2023-07-07T18:14:22.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.370+0000 7f59797d8700 1 --2- 172.21.15.160:0/1189163482 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 0x7f59740b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f596bfff700 1 -- 172.21.15.160:0/1189163482 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459408305 0 0) 0x7f59740b5640 con 0x7f59740b51d0 2023-07-07T18:14:22.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f596bfff700 1 -- 172.21.15.160:0/1189163482 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59600035b0 con 0x7f59740b51d0 2023-07-07T18:14:22.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f59797d8700 1 -- 172.21.15.160:0/1189163482 >> v1:172.21.15.160:6789/0 conn(0x7f59740b51d0 legacy=0x7f59740d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f59797d8700 1 -- 172.21.15.160:0/1189163482 >> v1:172.21.15.12:6789/0 conn(0x7f59740cf910 legacy=0x7f59740d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f59797d8700 1 -- 172.21.15.160:0/1189163482 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59740cfd90 con 0x7f59740d0a60 2023-07-07T18:14:22.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f59797d8700 1 --2- 172.21.15.160:0/1189163482 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 0x7f59740b5a70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f596c009870 tx=0x7f596c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5337b33b8ed29da8 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:22.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f596bfff700 1 -- 172.21.15.160:0/1189163482 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c011830 con 0x7f59740d0a60 2023-07-07T18:14:22.374 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f596bfff700 1 -- 172.21.15.160:0/1189163482 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c011990 con 0x7f59740d0a60 2023-07-07T18:14:22.374 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f596bfff700 1 -- 172.21.15.160:0/1189163482 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c011d20 con 0x7f59740d0a60 2023-07-07T18:14:22.376 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f597ba3c700 1 -- 172.21.15.160:0/1189163482 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 msgr2=0x7f59740b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.376 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f597ba3c700 1 --2- 172.21.15.160:0/1189163482 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 0x7f59740b5a70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f596c009870 tx=0x7f596c009b80 comp rx=0 tx=0).stop 2023-07-07T18:14:22.377 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f597ba3c700 1 -- 172.21.15.160:0/1189163482 shutdown_connections 2023-07-07T18:14:22.377 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f597ba3c700 1 --2- 172.21.15.160:0/1189163482 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 0x7f59740b5a70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.377 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.371+0000 7f597ba3c700 1 -- 172.21.15.160:0/1189163482 >> 172.21.15.160:0/1189163482 conn(0x7f5974071620 msgr2=0x7f59740719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:22.377 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.372+0000 7f597ba3c700 1 -- 172.21.15.160:0/1189163482 shutdown_connections 2023-07-07T18:14:22.377 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.372+0000 7f597ba3c700 1 -- 172.21.15.160:0/1189163482 wait complete. 2023-07-07T18:14:22.377 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.373+0000 7f597ba3c700 1 Processor -- start 2023-07-07T18:14:22.378 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.373+0000 7f597ba3c700 1 -- start start 2023-07-07T18:14:22.378 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.373+0000 7f597ba3c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59740b51d0 0x7f597415e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.378 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.373+0000 7f597ba3c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cf910 0x7f59741520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.378 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.373+0000 7f597ba3c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 0x7f597415c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.378 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.373+0000 7f597ba3c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597415dff0 con 0x7f59740b51d0 2023-07-07T18:14:22.379 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.373+0000 7f597ba3c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59741525f0 con 0x7f59740cf910 2023-07-07T18:14:22.379 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.373+0000 7f597ba3c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597415d3b0 con 0x7f59740d0a60 2023-07-07T18:14:22.379 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.373+0000 7f5978fd7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cf910 0x7f59741520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.379 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5979fd9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 0x7f597415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.379 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5978fd7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cf910 0x7f59741520b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:36786/0 (socket says 172.21.15.160:36786) 2023-07-07T18:14:22.379 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5978fd7700 1 -- 172.21.15.160:0/3884590584 learned_addr learned my addr 172.21.15.160:0/3884590584 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:22.379 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f59797d8700 1 --2- 172.21.15.160:0/3884590584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59740b51d0 0x7f597415e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.380 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5978fd7700 1 -- 172.21.15.160:0/3884590584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 msgr2=0x7f597415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.380 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5978fd7700 1 --2- 172.21.15.160:0/3884590584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 0x7f597415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.380 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5978fd7700 1 -- 172.21.15.160:0/3884590584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59740b51d0 msgr2=0x7f597415e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.380 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5978fd7700 1 --2- 172.21.15.160:0/3884590584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59740b51d0 0x7f597415e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.380 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5978fd7700 1 -- 172.21.15.160:0/3884590584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c0094a0 con 0x7f59740cf910 2023-07-07T18:14:22.380 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5978fd7700 1 --2- 172.21.15.160:0/3884590584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cf910 0x7f59741520b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f596400c700 tx=0x7f596400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:22.380 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5969ffb700 1 -- 172.21.15.160:0/3884590584 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964005d70 con 0x7f59740cf910 2023-07-07T18:14:22.381 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5969ffb700 1 -- 172.21.15.160:0/3884590584 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59640070d0 con 0x7f59740cf910 2023-07-07T18:14:22.381 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f597ba3c700 1 -- 172.21.15.160:0/3884590584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597415d650 con 0x7f59740cf910 2023-07-07T18:14:22.381 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5969ffb700 1 -- 172.21.15.160:0/3884590584 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964007460 con 0x7f59740cf910 2023-07-07T18:14:22.381 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5969ffb700 1 -- 172.21.15.160:0/3884590584 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5964012400 con 0x7f59740cf910 2023-07-07T18:14:22.381 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f597ba3c700 1 -- 172.21.15.160:0/3884590584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597415dc10 con 0x7f59740cf910 2023-07-07T18:14:22.381 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.374+0000 7f5969ffb700 1 -- 172.21.15.160:0/3884590584 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5964012d70 con 0x7f59740cf910 2023-07-07T18:14:22.382 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.375+0000 7f597ba3c700 1 -- 172.21.15.160:0/3884590584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597404ea20 con 0x7f59740cf910 2023-07-07T18:14:22.382 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.377+0000 7f5969ffb700 1 -- 172.21.15.160:0/3884590584 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5964017070 con 0x7f59740cf910 2023-07-07T18:14:22.484 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.483+0000 7f597ba3c700 1 -- 172.21.15.160:0/3884590584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "55dc08a3-2854-40d6-9e14-5c45ef4ec196", "id": 3} v 0) v1 -- 0x7f59740d01a0 con 0x7f59740cf910 2023-07-07T18:14:22.490 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.489+0000 7f5969ffb700 1 -- 172.21.15.160:0/3884590584 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55dc08a3-2854-40d6-9e14-5c45ef4ec196", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f59640129b0 con 0x7f59740cf910 2023-07-07T18:14:22.491 INFO:teuthology.orchestra.run.smithi160.stdout:3 2023-07-07T18:14:22.492 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.490+0000 7f597ba3c700 1 -- 172.21.15.160:0/3884590584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cf910 msgr2=0x7f59741520b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.493 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.490+0000 7f597ba3c700 1 --2- 172.21.15.160:0/3884590584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cf910 0x7f59741520b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f596400c700 tx=0x7f596400ca10 comp rx=0 tx=0).stop 2023-07-07T18:14:22.493 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.490+0000 7f597ba3c700 1 -- 172.21.15.160:0/3884590584 shutdown_connections 2023-07-07T18:14:22.493 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.490+0000 7f597ba3c700 1 --2- 172.21.15.160:0/3884590584 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59740d0a60 0x7f597415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.490+0000 7f597ba3c700 1 --2- 172.21.15.160:0/3884590584 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59740b51d0 0x7f597415e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.490+0000 7f597ba3c700 1 --2- 172.21.15.160:0/3884590584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59740cf910 0x7f59741520b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.490+0000 7f597ba3c700 1 -- 172.21.15.160:0/3884590584 >> 172.21.15.160:0/3884590584 conn(0x7f5974071620 msgr2=0x7f59740b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:22.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.490+0000 7f597ba3c700 1 -- 172.21.15.160:0/3884590584 shutdown_connections 2023-07-07T18:14:22.494 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.490+0000 7f597ba3c700 1 -- 172.21.15.160:0/3884590584 wait complete. 2023-07-07T18:14:22.506 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 19aa8797-5779-45f0-8cfe-b8c96521e2f4 4 2023-07-07T18:14:22.565 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:22.564+0000 7f3573e5e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-07T18:14:22.570 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:22.569+0000 7f23b0270200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-07T18:14:22.630 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.630+0000 7fc7f568f700 1 Processor -- start 2023-07-07T18:14:22.631 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.630+0000 7fc7f568f700 1 -- start start 2023-07-07T18:14:22.633 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.630+0000 7fc7f568f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc7f015a430 0x7fc7f006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.633 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.630+0000 7fc7f568f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f015e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.633 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.630+0000 7fc7f568f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f00aee00 con 0x7fc7f00ae8b0 2023-07-07T18:14:22.633 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.630+0000 7fc7f568f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f00af330 con 0x7fc7f015a430 2023-07-07T18:14:22.633 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.630+0000 7fc7f568f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f006e340 con 0x7fc7f00acd10 2023-07-07T18:14:22.633 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7ef7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f015e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.634 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7ee7fc700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fc7f00ae8b0 0x7fc7f00ac600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:33360/0 (socket says 172.21.15.160:33360) 2023-07-07T18:14:22.634 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7ee7fc700 1 -- 172.21.15.160:0/161839544 learned_addr learned my addr 172.21.15.160:0/161839544 (peer_addr_for_me v1:172.21.15.160:0/0) 2023-07-07T18:14:22.634 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7eeffd700 1 --2- 172.21.15.160:0/161839544 >> v2:172.21.15.12:3300/0 conn(0x7fc7f015a430 0x7fc7f006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.634 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7ef7fe700 1 -- 172.21.15.160:0/161839544 >> v2:172.21.15.12:3300/0 conn(0x7fc7f015a430 msgr2=0x7fc7f006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:22.634 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7edffb700 1 -- 172.21.15.160:0/161839544 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406473972 0 0) 0x7fc7f00aee00 con 0x7fc7f00ae8b0 2023-07-07T18:14:22.634 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7ef7fe700 1 --2- 172.21.15.160:0/161839544 >> v2:172.21.15.12:3300/0 conn(0x7fc7f015a430 0x7fc7f006e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.634 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7ef7fe700 1 -- 172.21.15.160:0/161839544 >> v1:172.21.15.160:6789/0 conn(0x7fc7f00ae8b0 legacy=0x7fc7f00ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.635 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7ef7fe700 1 -- 172.21.15.160:0/161839544 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f00af050 con 0x7fc7f00acd10 2023-07-07T18:14:22.635 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7ef7fe700 1 --2- 172.21.15.160:0/161839544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f015e040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009d90 tx=0x7fc7e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fddf1e2d0ef3d833 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:22.635 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7edffb700 1 -- 172.21.15.160:0/161839544 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800e070 con 0x7fc7f00acd10 2023-07-07T18:14:22.635 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7edffb700 1 -- 172.21.15.160:0/161839544 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e800bb20 con 0x7fc7f00acd10 2023-07-07T18:14:22.635 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.631+0000 7fc7edffb700 1 -- 172.21.15.160:0/161839544 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8012430 con 0x7fc7f00acd10 2023-07-07T18:14:22.635 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.632+0000 7fc7f568f700 1 -- 172.21.15.160:0/161839544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 msgr2=0x7fc7f015e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.635 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.632+0000 7fc7f568f700 1 --2- 172.21.15.160:0/161839544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f015e040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8009d90 tx=0x7fc7e800b330 comp rx=0 tx=0).stop 2023-07-07T18:14:22.635 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.632+0000 7fc7f568f700 1 -- 172.21.15.160:0/161839544 shutdown_connections 2023-07-07T18:14:22.636 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.632+0000 7fc7f568f700 1 --2- 172.21.15.160:0/161839544 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f015e040 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.636 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.632+0000 7fc7f568f700 1 --2- 172.21.15.160:0/161839544 >> v2:172.21.15.12:3300/0 conn(0x7fc7f015a430 0x7fc7f006e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.636 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.632+0000 7fc7f568f700 1 -- 172.21.15.160:0/161839544 >> 172.21.15.160:0/161839544 conn(0x7fc7f006b920 msgr2=0x7fc7f00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:22.636 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.632+0000 7fc7f568f700 1 -- 172.21.15.160:0/161839544 shutdown_connections 2023-07-07T18:14:22.636 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.632+0000 7fc7f568f700 1 -- 172.21.15.160:0/161839544 wait complete. 2023-07-07T18:14:22.638 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.633+0000 7fc7f568f700 1 Processor -- start 2023-07-07T18:14:22.638 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.633+0000 7fc7f568f700 1 -- start start 2023-07-07T18:14:22.638 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7f568f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f00b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.638 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7f568f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f00ae8b0 0x7fc7f0150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.639 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7f568f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7f015a430 0x7fc7f0150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.639 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7f568f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f00af8f0 con 0x7fc7f00ae8b0 2023-07-07T18:14:22.639 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7f568f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f0151430 con 0x7fc7f015a430 2023-07-07T18:14:22.639 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7f568f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f00c5630 con 0x7fc7f00acd10 2023-07-07T18:14:22.639 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7eeffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f00b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.639 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7ef7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7f015a430 0x7fc7f0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.639 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7eeffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f00b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:45292/0 (socket says 172.21.15.160:45292) 2023-07-07T18:14:22.639 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7ef7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7f015a430 0x7fc7f0150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:36798/0 (socket says 172.21.15.160:36798) 2023-07-07T18:14:22.640 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7eeffd700 1 -- 172.21.15.160:0/2741921326 learned_addr learned my addr 172.21.15.160:0/2741921326 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:22.640 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.634+0000 7fc7ee7fc700 1 --2- 172.21.15.160:0/2741921326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f00ae8b0 0x7fc7f0150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.640 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7ef7fe700 1 -- 172.21.15.160:0/2741921326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 msgr2=0x7fc7f00b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.640 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7ef7fe700 1 --2- 172.21.15.160:0/2741921326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f00b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.640 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7ef7fe700 1 -- 172.21.15.160:0/2741921326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f00ae8b0 msgr2=0x7fc7f0150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.640 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7ef7fe700 1 --2- 172.21.15.160:0/2741921326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f00ae8b0 0x7fc7f0150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.640 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7ef7fe700 1 -- 172.21.15.160:0/2741921326 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009a70 con 0x7fc7f015a430 2023-07-07T18:14:22.641 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7eeffd700 1 --2- 172.21.15.160:0/2741921326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f00b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:14:22.641 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7ef7fe700 1 --2- 172.21.15.160:0/2741921326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7f015a430 0x7fc7f0150370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8016000 tx=0x7fc7e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:22.641 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7d77fe700 1 -- 172.21.15.160:0/2741921326 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8012430 con 0x7fc7f015a430 2023-07-07T18:14:22.641 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7d77fe700 1 -- 172.21.15.160:0/2741921326 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e8020070 con 0x7fc7f015a430 2023-07-07T18:14:22.641 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7d77fe700 1 -- 172.21.15.160:0/2741921326 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8004280 con 0x7fc7f015a430 2023-07-07T18:14:22.641 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7f568f700 1 -- 172.21.15.160:0/2741921326 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f00c5910 con 0x7fc7f015a430 2023-07-07T18:14:22.641 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.635+0000 7fc7f568f700 1 -- 172.21.15.160:0/2741921326 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f00af510 con 0x7fc7f015a430 2023-07-07T18:14:22.641 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.636+0000 7fc7d77fe700 1 -- 172.21.15.160:0/2741921326 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc7e80046e0 con 0x7fc7f015a430 2023-07-07T18:14:22.642 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.636+0000 7fc7d77fe700 1 -- 172.21.15.160:0/2741921326 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc7e8022070 con 0x7fc7f015a430 2023-07-07T18:14:22.642 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.636+0000 7fc7f568f700 1 -- 172.21.15.160:0/2741921326 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f00afa30 con 0x7fc7f015a430 2023-07-07T18:14:22.642 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.638+0000 7fc7d77fe700 1 -- 172.21.15.160:0/2741921326 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc7f00afa30 con 0x7fc7f015a430 2023-07-07T18:14:22.725 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.724+0000 7fc7f568f700 1 -- 172.21.15.160:0/2741921326 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "19aa8797-5779-45f0-8cfe-b8c96521e2f4", "id": 4} v 0) v1 -- 0x7fc7f004ea20 con 0x7fc7f015a430 2023-07-07T18:14:22.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.731+0000 7fc7d77fe700 1 -- 172.21.15.160:0/2741921326 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19aa8797-5779-45f0-8cfe-b8c96521e2f4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc7e802c060 con 0x7fc7f015a430 2023-07-07T18:14:22.732 INFO:teuthology.orchestra.run.smithi160.stdout:4 2023-07-07T18:14:22.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.732+0000 7fc7f568f700 1 -- 172.21.15.160:0/2741921326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7f015a430 msgr2=0x7fc7f0150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.732+0000 7fc7f568f700 1 --2- 172.21.15.160:0/2741921326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7f015a430 0x7fc7f0150370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8016000 tx=0x7fc7e8004ad0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.732+0000 7fc7f568f700 1 -- 172.21.15.160:0/2741921326 shutdown_connections 2023-07-07T18:14:22.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.732+0000 7fc7f568f700 1 --2- 172.21.15.160:0/2741921326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7f015a430 0x7fc7f0150370 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.732+0000 7fc7f568f700 1 --2- 172.21.15.160:0/2741921326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7f00acd10 0x7fc7f00b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.736 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.732+0000 7fc7f568f700 1 --2- 172.21.15.160:0/2741921326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7f00ae8b0 0x7fc7f0150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.736 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.732+0000 7fc7f568f700 1 -- 172.21.15.160:0/2741921326 >> 172.21.15.160:0/2741921326 conn(0x7fc7f006b920 msgr2=0x7fc7f00cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:22.736 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.732+0000 7fc7f568f700 1 -- 172.21.15.160:0/2741921326 shutdown_connections 2023-07-07T18:14:22.737 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.732+0000 7fc7f568f700 1 -- 172.21.15.160:0/2741921326 wait complete. 2023-07-07T18:14:22.745 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 53b5cbc4-0849-45a7-9c3a-c4c841875a77 5 2023-07-07T18:14:22.866 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.866+0000 7f480a2c8700 1 Processor -- start 2023-07-07T18:14:22.867 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.866+0000 7f480a2c8700 1 -- start start 2023-07-07T18:14:22.869 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.866+0000 7f480a2c8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f480415fc60 0x7f480406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.871 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.866+0000 7f480a2c8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f48040aecc0 0x7f48040ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.872 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.866+0000 7f480a2c8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48040ce620 con 0x7f480406e260 2023-07-07T18:14:22.872 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.866+0000 7f480a2c8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4804160580 con 0x7f480415fc60 2023-07-07T18:14:22.872 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.866+0000 7f480a2c8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4804160860 con 0x7f48040aecc0 2023-07-07T18:14:22.872 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.866+0000 7f48037fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f48040aecc0 0x7f48040ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.872 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f48037fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f48040aecc0 0x7f48040ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:36800/0 (socket says 172.21.15.160:36800) 2023-07-07T18:14:22.872 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f48037fe700 1 -- 172.21.15.160:0/468086095 learned_addr learned my addr 172.21.15.160:0/468086095 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:22.873 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f4803fff700 1 --2- 172.21.15.160:0/468086095 >> v2:172.21.15.12:3300/0 conn(0x7f480415fc60 0x7f480406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.873 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f48037fe700 1 -- 172.21.15.160:0/468086095 >> v2:172.21.15.12:3300/0 conn(0x7f480415fc60 msgr2=0x7f480406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:22.873 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f48037fe700 1 --2- 172.21.15.160:0/468086095 >> v2:172.21.15.12:3300/0 conn(0x7f480415fc60 0x7f480406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.873 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f48037fe700 1 -- 172.21.15.160:0/468086095 >> v1:172.21.15.12:6789/0 conn(0x7f480406e260 legacy=0x7f480406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.873 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f48037fe700 1 -- 172.21.15.160:0/468086095 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4804160b40 con 0x7f48040aecc0 2023-07-07T18:14:22.873 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f48037fe700 1 --2- 172.21.15.160:0/468086095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 0x7f48040ac600 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4804071b40 tx=0x7f47f8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f6a54d25e27600 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:22.873 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f4802ffd700 1 -- 172.21.15.160:0/468086095 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f800b870 con 0x7f48040aecc0 2023-07-07T18:14:22.874 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f4802ffd700 1 -- 172.21.15.160:0/468086095 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f800b9d0 con 0x7f48040aecc0 2023-07-07T18:14:22.874 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.867+0000 7f4802ffd700 1 -- 172.21.15.160:0/468086095 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f800bd60 con 0x7f48040aecc0 2023-07-07T18:14:22.874 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.868+0000 7f480a2c8700 1 -- 172.21.15.160:0/468086095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 msgr2=0x7f48040ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.874 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.868+0000 7f480a2c8700 1 --2- 172.21.15.160:0/468086095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 0x7f48040ac600 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4804071b40 tx=0x7f47f8009bd0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.874 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.868+0000 7f480a2c8700 1 -- 172.21.15.160:0/468086095 shutdown_connections 2023-07-07T18:14:22.875 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.868+0000 7f480a2c8700 1 --2- 172.21.15.160:0/468086095 >> v2:172.21.15.12:3300/0 conn(0x7f480415fc60 0x7f480406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.875 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.868+0000 7f480a2c8700 1 --2- 172.21.15.160:0/468086095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 0x7f48040ac600 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.875 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.868+0000 7f480a2c8700 1 -- 172.21.15.160:0/468086095 >> 172.21.15.160:0/468086095 conn(0x7f480406b920 msgr2=0x7f48040cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:22.875 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.868+0000 7f480a2c8700 1 -- 172.21.15.160:0/468086095 shutdown_connections 2023-07-07T18:14:22.875 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.868+0000 7f480a2c8700 1 -- 172.21.15.160:0/468086095 wait complete. 2023-07-07T18:14:22.877 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.869+0000 7f480a2c8700 1 Processor -- start 2023-07-07T18:14:22.877 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.869+0000 7f480a2c8700 1 -- start start 2023-07-07T18:14:22.878 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f480a2c8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f480406e260 0x7f48040b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.878 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f480a2c8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 0x7f480415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.878 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f480a2c8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f480415fc60 0x7f480415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:22.878 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f480a2c8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040c5ec0 con 0x7f480415fc60 2023-07-07T18:14:22.878 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f480a2c8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040c52b0 con 0x7f48040aecc0 2023-07-07T18:14:22.878 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f480a2c8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48040c5590 con 0x7f480406e260 2023-07-07T18:14:22.878 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f48037fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 0x7f480415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.878 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f4803fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f480406e260 0x7f48040b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.879 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f48037fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 0x7f480415a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:36808/0 (socket says 172.21.15.160:36808) 2023-07-07T18:14:22.879 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f48037fe700 1 -- 172.21.15.160:0/1872357944 learned_addr learned my addr 172.21.15.160:0/1872357944 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:22.879 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f4808865700 1 --2- 172.21.15.160:0/1872357944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f480415fc60 0x7f480415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:22.879 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f48037fe700 1 -- 172.21.15.160:0/1872357944 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f480406e260 msgr2=0x7f48040b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.879 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f48037fe700 1 --2- 172.21.15.160:0/1872357944 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f480406e260 0x7f48040b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.879 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f48037fe700 1 -- 172.21.15.160:0/1872357944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f480415fc60 msgr2=0x7f480415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.879 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f48037fe700 1 --2- 172.21.15.160:0/1872357944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f480415fc60 0x7f480415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.880 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.870+0000 7f48037fe700 1 -- 172.21.15.160:0/1872357944 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8009550 con 0x7f48040aecc0 2023-07-07T18:14:22.880 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.871+0000 7f48037fe700 1 --2- 172.21.15.160:0/1872357944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 0x7f480415a1b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47f8000c00 tx=0x7f47f8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:22.880 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.871+0000 7f4800ff9700 1 -- 172.21.15.160:0/1872357944 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8004480 con 0x7f48040aecc0 2023-07-07T18:14:22.880 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.871+0000 7f4800ff9700 1 -- 172.21.15.160:0/1872357944 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f80045e0 con 0x7f48040aecc0 2023-07-07T18:14:22.880 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.871+0000 7f480a2c8700 1 -- 172.21.15.160:0/1872357944 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48040c5870 con 0x7f48040aecc0 2023-07-07T18:14:22.880 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.871+0000 7f4800ff9700 1 -- 172.21.15.160:0/1872357944 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f80038e0 con 0x7f48040aecc0 2023-07-07T18:14:22.880 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.871+0000 7f480a2c8700 1 -- 172.21.15.160:0/1872357944 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48040b53f0 con 0x7f48040aecc0 2023-07-07T18:14:22.881 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.871+0000 7f4800ff9700 1 -- 172.21.15.160:0/1872357944 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f47f8021070 con 0x7f48040aecc0 2023-07-07T18:14:22.881 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.871+0000 7f4800ff9700 1 -- 172.21.15.160:0/1872357944 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f47f8003d40 con 0x7f48040aecc0 2023-07-07T18:14:22.881 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.872+0000 7f480a2c8700 1 -- 172.21.15.160:0/1872357944 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480404ea20 con 0x7f48040aecc0 2023-07-07T18:14:22.881 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.874+0000 7f4800ff9700 1 -- 172.21.15.160:0/1872357944 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f47f8015020 con 0x7f48040aecc0 2023-07-07T18:14:22.960 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.959+0000 7f480a2c8700 1 -- 172.21.15.160:0/1872357944 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "53b5cbc4-0849-45a7-9c3a-c4c841875a77", "id": 5} v 0) v1 -- 0x7f48040c6000 con 0x7f48040aecc0 2023-07-07T18:14:22.969 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.968+0000 7f4800ff9700 1 -- 172.21.15.160:0/1872357944 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "53b5cbc4-0849-45a7-9c3a-c4c841875a77", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47f8033020 con 0x7f48040aecc0 2023-07-07T18:14:22.969 INFO:teuthology.orchestra.run.smithi160.stdout:5 2023-07-07T18:14:22.970 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.969+0000 7f480a2c8700 1 -- 172.21.15.160:0/1872357944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 msgr2=0x7f480415a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:22.970 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.969+0000 7f480a2c8700 1 --2- 172.21.15.160:0/1872357944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 0x7f480415a1b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47f8000c00 tx=0x7f47f8004750 comp rx=0 tx=0).stop 2023-07-07T18:14:22.970 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.969+0000 7f480a2c8700 1 -- 172.21.15.160:0/1872357944 shutdown_connections 2023-07-07T18:14:22.970 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.969+0000 7f480a2c8700 1 --2- 172.21.15.160:0/1872357944 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f480415fc60 0x7f480415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.970 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.969+0000 7f480a2c8700 1 --2- 172.21.15.160:0/1872357944 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f480406e260 0x7f48040b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.971 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.969+0000 7f480a2c8700 1 --2- 172.21.15.160:0/1872357944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48040aecc0 0x7f480415a1b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:22.971 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.969+0000 7f480a2c8700 1 -- 172.21.15.160:0/1872357944 >> 172.21.15.160:0/1872357944 conn(0x7f480406b920 msgr2=0x7f48040b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:22.971 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.969+0000 7f480a2c8700 1 -- 172.21.15.160:0/1872357944 shutdown_connections 2023-07-07T18:14:22.971 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:22.969+0000 7f480a2c8700 1 -- 172.21.15.160:0/1872357944 wait complete. 2023-07-07T18:14:22.982 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new fbf4e9fa-08da-4210-886f-edb3eeeb6d68 6 2023-07-07T18:14:23.128 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.127+0000 7f4fa978a700 1 Processor -- start 2023-07-07T18:14:23.128 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.127+0000 7f4fa978a700 1 -- start start 2023-07-07T18:14:23.130 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa978a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa40b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.130 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa978a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4fa40cf910 0x7f4fa40d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.130 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa978a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa40b5ec0 con 0x7f4fa40d0a60 2023-07-07T18:14:23.130 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa978a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa40d0060 con 0x7f4fa40cf910 2023-07-07T18:14:23.131 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa978a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40cd9d0 con 0x7f4fa40b5a70 2023-07-07T18:14:23.131 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa37fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4fa40cf910 0x7f4fa40d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.131 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa27fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa40b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.131 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa37fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4fa40cf910 0x7f4fa40d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:36816/0 (socket says 172.21.15.160:36816) 2023-07-07T18:14:23.131 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa27fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa40b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:45312/0 (socket says 172.21.15.160:45312) 2023-07-07T18:14:23.131 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa37fe700 1 -- 172.21.15.160:0/221280172 learned_addr learned my addr 172.21.15.160:0/221280172 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:23.131 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa37fe700 1 -- 172.21.15.160:0/221280172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 msgr2=0x7f4fa40b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:23.132 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa37fe700 1 --2- 172.21.15.160:0/221280172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa40b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.132 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa37fe700 1 -- 172.21.15.160:0/221280172 >> v1:172.21.15.12:6789/0 conn(0x7f4fa40d0a60 legacy=0x7f4fa40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.132 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa37fe700 1 -- 172.21.15.160:0/221280172 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa40cfd90 con 0x7f4fa40cf910 2023-07-07T18:14:23.132 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa27fc700 1 --2- 172.21.15.160:0/221280172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa40b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:14:23.132 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa37fe700 1 --2- 172.21.15.160:0/221280172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40cf910 0x7f4fa40d2e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009e50 tx=0x7f4f9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec6f51854f1230d server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:23.132 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa1ffb700 1 -- 172.21.15.160:0/221280172 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00e070 con 0x7f4fa40cf910 2023-07-07T18:14:23.133 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa1ffb700 1 -- 172.21.15.160:0/221280172 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c00b910 con 0x7f4fa40cf910 2023-07-07T18:14:23.133 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.128+0000 7f4fa1ffb700 1 -- 172.21.15.160:0/221280172 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00bcc0 con 0x7f4fa40cf910 2023-07-07T18:14:23.133 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.129+0000 7f4fa978a700 1 -- 172.21.15.160:0/221280172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40cf910 msgr2=0x7f4fa40d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.133 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.129+0000 7f4fa978a700 1 --2- 172.21.15.160:0/221280172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40cf910 0x7f4fa40d2e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009e50 tx=0x7f4f9c00b330 comp rx=0 tx=0).stop 2023-07-07T18:14:23.133 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.129+0000 7f4fa978a700 1 -- 172.21.15.160:0/221280172 shutdown_connections 2023-07-07T18:14:23.133 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.129+0000 7f4fa978a700 1 --2- 172.21.15.160:0/221280172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40cf910 0x7f4fa40d2e00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.133 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.129+0000 7f4fa978a700 1 --2- 172.21.15.160:0/221280172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa40b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.134 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.129+0000 7f4fa978a700 1 -- 172.21.15.160:0/221280172 >> 172.21.15.160:0/221280172 conn(0x7f4fa4071620 msgr2=0x7f4fa40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:23.134 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.129+0000 7f4fa978a700 1 -- 172.21.15.160:0/221280172 shutdown_connections 2023-07-07T18:14:23.134 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.129+0000 7f4fa978a700 1 -- 172.21.15.160:0/221280172 wait complete. 2023-07-07T18:14:23.136 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.130+0000 7f4fa978a700 1 Processor -- start 2023-07-07T18:14:23.136 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.130+0000 7f4fa978a700 1 -- start start 2023-07-07T18:14:23.136 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa978a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa4146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.136 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa978a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa40cf910 0x7f4fa40c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.137 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa978a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40d0a60 0x7f4fa40d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.137 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa978a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa4147690 con 0x7f4fa40cf910 2023-07-07T18:14:23.137 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa978a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa41473d0 con 0x7f4fa40d0a60 2023-07-07T18:14:23.137 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa978a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa40c81b0 con 0x7f4fa40b5a70 2023-07-07T18:14:23.137 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40d0a60 0x7f4fa40d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.137 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa2ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa4146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.137 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40d0a60 0x7f4fa40d2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:36820/0 (socket says 172.21.15.160:36820) 2023-07-07T18:14:23.138 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa2ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa4146e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:45316/0 (socket says 172.21.15.160:45316) 2023-07-07T18:14:23.138 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa37fe700 1 -- 172.21.15.160:0/2417638031 learned_addr learned my addr 172.21.15.160:0/2417638031 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:23.138 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.131+0000 7f4fa27fc700 1 --2- 172.21.15.160:0/2417638031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa40cf910 0x7f4fa40c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.138 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4fa2ffd700 1 -- 172.21.15.160:0/2417638031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40d0a60 msgr2=0x7f4fa40d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.138 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4fa2ffd700 1 --2- 172.21.15.160:0/2417638031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40d0a60 0x7f4fa40d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.138 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4fa2ffd700 1 -- 172.21.15.160:0/2417638031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa40cf910 msgr2=0x7f4fa40c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.138 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4fa2ffd700 1 --2- 172.21.15.160:0/2417638031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa40cf910 0x7f4fa40c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4fa2ffd700 1 -- 172.21.15.160:0/2417638031 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f980094a0 con 0x7f4fa40b5a70 2023-07-07T18:14:23.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4fa37fe700 1 --2- 172.21.15.160:0/2417638031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40d0a60 0x7f4fa40d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:14:23.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4fa2ffd700 1 --2- 172.21.15.160:0/2417638031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa4146e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4f94000f60 tx=0x7f4f9400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:23.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4f8b7fe700 1 -- 172.21.15.160:0/2417638031 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940052d0 con 0x7f4fa40b5a70 2023-07-07T18:14:23.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4f8b7fe700 1 -- 172.21.15.160:0/2417638031 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94005430 con 0x7f4fa40b5a70 2023-07-07T18:14:23.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4fa978a700 1 -- 172.21.15.160:0/2417638031 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c009b30 con 0x7f4fa40b5a70 2023-07-07T18:14:23.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4f8b7fe700 1 -- 172.21.15.160:0/2417638031 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940038c0 con 0x7f4fa40b5a70 2023-07-07T18:14:23.140 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.132+0000 7f4fa978a700 1 -- 172.21.15.160:0/2417638031 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa40c8770 con 0x7f4fa40b5a70 2023-07-07T18:14:23.140 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.133+0000 7f4f8b7fe700 1 -- 172.21.15.160:0/2417638031 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4f9401c440 con 0x7f4fa40b5a70 2023-07-07T18:14:23.140 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.133+0000 7f4f8b7fe700 1 -- 172.21.15.160:0/2417638031 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4f94012a10 con 0x7f4fa40b5a70 2023-07-07T18:14:23.140 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.133+0000 7f4fa978a700 1 -- 172.21.15.160:0/2417638031 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa404ea20 con 0x7f4fa40b5a70 2023-07-07T18:14:23.140 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.135+0000 7f4f8b7fe700 1 -- 172.21.15.160:0/2417638031 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4f94017070 con 0x7f4fa40b5a70 2023-07-07T18:14:23.167 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:23.166+0000 7f3573e5e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-07T18:14:23.172 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:23.171+0000 7f23b0270200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-07T18:14:23.219 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.218+0000 7f4fa978a700 1 -- 172.21.15.160:0/2417638031 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fbf4e9fa-08da-4210-886f-edb3eeeb6d68", "id": 6} v 0) v1 -- 0x7f4fa40b4300 con 0x7f4fa40b5a70 2023-07-07T18:14:23.227 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.226+0000 7f4f8b7fe700 1 -- 172.21.15.160:0/2417638031 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fbf4e9fa-08da-4210-886f-edb3eeeb6d68", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4f94012420 con 0x7f4fa40b5a70 2023-07-07T18:14:23.228 INFO:teuthology.orchestra.run.smithi160.stdout:6 2023-07-07T18:14:23.229 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.227+0000 7f4fa978a700 1 -- 172.21.15.160:0/2417638031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 msgr2=0x7f4fa4146e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.230 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.227+0000 7f4fa978a700 1 --2- 172.21.15.160:0/2417638031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa4146e90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4f94000f60 tx=0x7f4f9400c6e0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.230 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.227+0000 7f4fa978a700 1 -- 172.21.15.160:0/2417638031 shutdown_connections 2023-07-07T18:14:23.230 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.227+0000 7f4fa978a700 1 --2- 172.21.15.160:0/2417638031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fa40d0a60 0x7f4fa40d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.231 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.227+0000 7f4fa978a700 1 --2- 172.21.15.160:0/2417638031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4fa40b5a70 0x7f4fa4146e90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.231 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.227+0000 7f4fa978a700 1 --2- 172.21.15.160:0/2417638031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4fa40cf910 0x7f4fa40c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.231 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.227+0000 7f4fa978a700 1 -- 172.21.15.160:0/2417638031 >> 172.21.15.160:0/2417638031 conn(0x7f4fa4071620 msgr2=0x7f4fa40d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:23.231 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.228+0000 7f4fa978a700 1 -- 172.21.15.160:0/2417638031 shutdown_connections 2023-07-07T18:14:23.232 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.228+0000 7f4fa978a700 1 -- 172.21.15.160:0/2417638031 wait complete. 2023-07-07T18:14:23.241 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new c6a7c666-1fce-4dd2-934e-9fb7efa12276 7 2023-07-07T18:14:23.331 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:23.330+0000 7f3573e5e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-07T18:14:23.333 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:23.332+0000 7f23b0270200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-07T18:14:23.363 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.362+0000 7f9b626cc700 1 Processor -- start 2023-07-07T18:14:23.363 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.362+0000 7f9b626cc700 1 -- start start 2023-07-07T18:14:23.365 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b626cc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.365 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b626cc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9b5c0afc40 0x7f9b5c15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.365 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b626cc700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c0caf70 con 0x7f9b5c0cd330 2023-07-07T18:14:23.365 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b626cc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c0cb210 con 0x7f9b5c0afc40 2023-07-07T18:14:23.365 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b626cc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0ccc20 con 0x7f9b5c15a330 2023-07-07T18:14:23.366 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.366 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:45322/0 (socket says 172.21.15.160:45322) 2023-07-07T18:14:23.366 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5b7fe700 1 -- 172.21.15.160:0/255434892 learned_addr learned my addr 172.21.15.160:0/255434892 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:23.366 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b60c69700 1 --2- 172.21.15.160:0/255434892 >> v2:172.21.15.12:3300/0 conn(0x7f9b5c0afc40 0x7f9b5c15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.366 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5b7fe700 1 -- 172.21.15.160:0/255434892 >> v2:172.21.15.12:3300/0 conn(0x7f9b5c0afc40 msgr2=0x7f9b5c15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:23.366 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5b7fe700 1 --2- 172.21.15.160:0/255434892 >> v2:172.21.15.12:3300/0 conn(0x7f9b5c0afc40 0x7f9b5c15dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.366 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5b7fe700 1 -- 172.21.15.160:0/255434892 >> v1:172.21.15.12:6789/0 conn(0x7f9b5c0cd330 legacy=0x7f9b5c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.367 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5affd700 1 -- 172.21.15.160:0/255434892 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3356897334 0 0) 0x7f9b5c0caf70 con 0x7f9b5c0cd330 2023-07-07T18:14:23.367 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5b7fe700 1 -- 172.21.15.160:0/255434892 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c0ccf00 con 0x7f9b5c15a330 2023-07-07T18:14:23.367 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5b7fe700 1 --2- 172.21.15.160:0/255434892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c070980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9b500098f0 tx=0x7f9b50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d177464e1577a3e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:23.367 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.363+0000 7f9b5affd700 1 -- 172.21.15.160:0/255434892 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50011830 con 0x7f9b5c15a330 2023-07-07T18:14:23.367 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b5affd700 1 -- 172.21.15.160:0/255434892 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b50011990 con 0x7f9b5c15a330 2023-07-07T18:14:23.367 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b5affd700 1 -- 172.21.15.160:0/255434892 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50011d20 con 0x7f9b5c15a330 2023-07-07T18:14:23.367 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b626cc700 1 -- 172.21.15.160:0/255434892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 msgr2=0x7f9b5c070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.367 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b626cc700 1 --2- 172.21.15.160:0/255434892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c070980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9b500098f0 tx=0x7f9b50009c00 comp rx=0 tx=0).stop 2023-07-07T18:14:23.368 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b626cc700 1 -- 172.21.15.160:0/255434892 shutdown_connections 2023-07-07T18:14:23.368 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b626cc700 1 --2- 172.21.15.160:0/255434892 >> v2:172.21.15.12:3300/0 conn(0x7f9b5c0afc40 0x7f9b5c15dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.368 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b626cc700 1 --2- 172.21.15.160:0/255434892 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c070980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.368 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b626cc700 1 -- 172.21.15.160:0/255434892 >> 172.21.15.160:0/255434892 conn(0x7f9b5c06e5c0 msgr2=0x7f9b5c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:23.368 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b626cc700 1 -- 172.21.15.160:0/255434892 shutdown_connections 2023-07-07T18:14:23.368 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.364+0000 7f9b626cc700 1 -- 172.21.15.160:0/255434892 wait complete. 2023-07-07T18:14:23.370 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.365+0000 7f9b626cc700 1 Processor -- start 2023-07-07T18:14:23.370 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b626cc700 1 -- start start 2023-07-07T18:14:23.370 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b626cc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0afc40 0x7f9b5c153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.371 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b626cc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b5c0cd330 0x7f9b5c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.371 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b626cc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.371 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b626cc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c153870 con 0x7f9b5c0afc40 2023-07-07T18:14:23.371 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b626cc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c15b130 con 0x7f9b5c0cd330 2023-07-07T18:14:23.371 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b626cc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c15b410 con 0x7f9b5c15a330 2023-07-07T18:14:23.371 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b60c69700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.371 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b5c0cd330 0x7f9b5c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b60c69700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c15a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:45330/0 (socket says 172.21.15.160:45330) 2023-07-07T18:14:23.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.366+0000 7f9b60c69700 1 -- 172.21.15.160:0/4197494449 learned_addr learned my addr 172.21.15.160:0/4197494449 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-07-07T18:14:23.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b5bfff700 1 --2- 172.21.15.160:0/4197494449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0afc40 0x7f9b5c153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b60c69700 1 -- 172.21.15.160:0/4197494449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b5c0cd330 msgr2=0x7f9b5c0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b60c69700 1 --2- 172.21.15.160:0/4197494449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b5c0cd330 0x7f9b5c0b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b60c69700 1 -- 172.21.15.160:0/4197494449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0afc40 msgr2=0x7f9b5c153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b60c69700 1 --2- 172.21.15.160:0/4197494449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0afc40 0x7f9b5c153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.372 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b60c69700 1 -- 172.21.15.160:0/4197494449 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50009550 con 0x7f9b5c15a330 2023-07-07T18:14:23.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b60c69700 1 --2- 172.21.15.160:0/4197494449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c15a750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400efc0 tx=0x7f9b5400c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:23.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b58ff9700 1 -- 172.21.15.160:0/4197494449 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400cad0 con 0x7f9b5c15a330 2023-07-07T18:14:23.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b58ff9700 1 -- 172.21.15.160:0/4197494449 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5400f040 con 0x7f9b5c15a330 2023-07-07T18:14:23.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b58ff9700 1 -- 172.21.15.160:0/4197494449 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400ce70 con 0x7f9b5c15a330 2023-07-07T18:14:23.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b626cc700 1 -- 172.21.15.160:0/4197494449 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c15b6f0 con 0x7f9b5c15a330 2023-07-07T18:14:23.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b626cc700 1 -- 172.21.15.160:0/4197494449 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c15bcb0 con 0x7f9b5c15a330 2023-07-07T18:14:23.373 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b58ff9700 1 -- 172.21.15.160:0/4197494449 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9b54014780 con 0x7f9b5c15a330 2023-07-07T18:14:23.374 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.367+0000 7f9b58ff9700 1 -- 172.21.15.160:0/4197494449 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f9b5401d400 con 0x7f9b5c15a330 2023-07-07T18:14:23.374 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.368+0000 7f9b626cc700 1 -- 172.21.15.160:0/4197494449 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c04ea20 con 0x7f9b5c15a330 2023-07-07T18:14:23.374 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.370+0000 7f9b58ff9700 1 -- 172.21.15.160:0/4197494449 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9b54018020 con 0x7f9b5c15a330 2023-07-07T18:14:23.454 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.453+0000 7f9b626cc700 1 -- 172.21.15.160:0/4197494449 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c6a7c666-1fce-4dd2-934e-9fb7efa12276", "id": 7} v 0) v1 -- 0x7f9b5c0b68a0 con 0x7f9b5c15a330 2023-07-07T18:14:23.462 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.461+0000 7f9b58ff9700 1 -- 172.21.15.160:0/4197494449 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6a7c666-1fce-4dd2-934e-9fb7efa12276", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b54014bb0 con 0x7f9b5c15a330 2023-07-07T18:14:23.462 INFO:teuthology.orchestra.run.smithi160.stdout:7 2023-07-07T18:14:23.463 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.462+0000 7f9b626cc700 1 -- 172.21.15.160:0/4197494449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 msgr2=0x7f9b5c15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.463 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.462+0000 7f9b626cc700 1 --2- 172.21.15.160:0/4197494449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c15a750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400efc0 tx=0x7f9b5400c0c0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.463 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.462+0000 7f9b626cc700 1 -- 172.21.15.160:0/4197494449 shutdown_connections 2023-07-07T18:14:23.463 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.462+0000 7f9b626cc700 1 --2- 172.21.15.160:0/4197494449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b5c15a330 0x7f9b5c15a750 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.464 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.462+0000 7f9b626cc700 1 --2- 172.21.15.160:0/4197494449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0afc40 0x7f9b5c153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.464 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.462+0000 7f9b626cc700 1 --2- 172.21.15.160:0/4197494449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b5c0cd330 0x7f9b5c0b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.464 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.462+0000 7f9b626cc700 1 -- 172.21.15.160:0/4197494449 >> 172.21.15.160:0/4197494449 conn(0x7f9b5c06e5c0 msgr2=0x7f9b5c0b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:23.464 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.462+0000 7f9b626cc700 1 -- 172.21.15.160:0/4197494449 shutdown_connections 2023-07-07T18:14:23.464 INFO:teuthology.orchestra.run.smithi160.stderr:2023-07-07T18:14:23.462+0000 7f9b626cc700 1 -- 172.21.15.160:0/4197494449 wait complete. 2023-07-07T18:14:23.474 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-07T18:14:23.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-07T18:14:23.477 INFO:tasks.ceph.osd.0:Started 2023-07-07T18:14:23.477 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-07T18:14:23.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-07T18:14:23.479 INFO:tasks.ceph.osd.1:Started 2023-07-07T18:14:23.479 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-07T18:14:23.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-07T18:14:23.481 INFO:tasks.ceph.osd.2:Started 2023-07-07T18:14:23.482 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-07T18:14:23.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-07T18:14:23.484 INFO:tasks.ceph.osd.3:Started 2023-07-07T18:14:23.484 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-07T18:14:23.484 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-07T18:14:23.486 INFO:tasks.ceph.osd.4:Started 2023-07-07T18:14:23.487 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-07T18:14:23.487 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-07T18:14:23.489 INFO:tasks.ceph.osd.5:Started 2023-07-07T18:14:23.489 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-07T18:14:23.489 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-07T18:14:23.491 INFO:tasks.ceph.osd.6:Started 2023-07-07T18:14:23.492 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-07T18:14:23.492 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-07T18:14:23.494 INFO:tasks.ceph.osd.7:Started 2023-07-07T18:14:23.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:23.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.654+0000 7f92d2f1f700 1 Processor -- start 2023-07-07T18:14:23.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.654+0000 7f92d2f1f700 1 -- start start 2023-07-07T18:14:23.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d2f1f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc0d05d0 0x7f92cc06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d2f1f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92cc0cec80 0x7f92cc0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d2f1f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92cc0ae580 con 0x7f92cc15a640 2023-07-07T18:14:23.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d2f1f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc06f610 con 0x7f92cc0cec80 2023-07-07T18:14:23.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d2f1f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0adf70 con 0x7f92cc0d05d0 2023-07-07T18:14:23.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d0cbb700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f92cc15a640 0x7f92cc0ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53426/0 (socket says 172.21.15.12:53426) 2023-07-07T18:14:23.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d14bc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92cc0cec80 0x7f92cc0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d0cbb700 1 -- 172.21.15.12:0/1825398272 learned_addr learned my addr 172.21.15.12:0/1825398272 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:23.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92cbfff700 1 --2- 172.21.15.12:0/1825398272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc0d05d0 0x7f92cc06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92cb7fe700 1 -- 172.21.15.12:0/1825398272 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608072980 0 0) 0x7f92cc0ae580 con 0x7f92cc15a640 2023-07-07T18:14:23.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92cb7fe700 1 -- 172.21.15.12:0/1825398272 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92bc0035b0 con 0x7f92cc15a640 2023-07-07T18:14:23.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d14bc700 1 -- 172.21.15.12:0/1825398272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc0d05d0 msgr2=0x7f92cc06fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:23.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d14bc700 1 --2- 172.21.15.12:0/1825398272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc0d05d0 0x7f92cc06fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d14bc700 1 -- 172.21.15.12:0/1825398272 >> v1:172.21.15.12:6789/0 conn(0x7f92cc15a640 legacy=0x7f92cc0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.656+0000 7f92d14bc700 1 -- 172.21.15.12:0/1825398272 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc06f860 con 0x7f92cc0cec80 2023-07-07T18:14:23.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92d14bc700 1 --2- 172.21.15.12:0/1825398272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 0x7f92cc0aea10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009d90 tx=0x7f92c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc158e96065ee64 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:23.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92cb7fe700 1 -- 172.21.15.12:0/1825398272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c400e070 con 0x7f92cc0cec80 2023-07-07T18:14:23.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92cb7fe700 1 -- 172.21.15.12:0/1825398272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c400bb20 con 0x7f92cc0cec80 2023-07-07T18:14:23.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92cb7fe700 1 -- 172.21.15.12:0/1825398272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4012430 con 0x7f92cc0cec80 2023-07-07T18:14:23.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92d2f1f700 1 -- 172.21.15.12:0/1825398272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 msgr2=0x7f92cc0aea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92d2f1f700 1 --2- 172.21.15.12:0/1825398272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 0x7f92cc0aea10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009d90 tx=0x7f92c400b330 comp rx=0 tx=0).stop 2023-07-07T18:14:23.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92d2f1f700 1 -- 172.21.15.12:0/1825398272 shutdown_connections 2023-07-07T18:14:23.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92d2f1f700 1 --2- 172.21.15.12:0/1825398272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 0x7f92cc0aea10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92d2f1f700 1 --2- 172.21.15.12:0/1825398272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc0d05d0 0x7f92cc06fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92d2f1f700 1 -- 172.21.15.12:0/1825398272 >> 172.21.15.12:0/1825398272 conn(0x7f92cc089fe0 msgr2=0x7f92cc0d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:23.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92d2f1f700 1 -- 172.21.15.12:0/1825398272 shutdown_connections 2023-07-07T18:14:23.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.657+0000 7f92d2f1f700 1 -- 172.21.15.12:0/1825398272 wait complete. 2023-07-07T18:14:23.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.659+0000 7f92d2f1f700 1 Processor -- start 2023-07-07T18:14:23.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.659+0000 7f92d2f1f700 1 -- start start 2023-07-07T18:14:23.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d2f1f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 0x7f92cc0c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d2f1f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92cc0d05d0 0x7f92cc0c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d2f1f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc15a640 0x7f92cc15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d2f1f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc1f0710 con 0x7f92cc0cec80 2023-07-07T18:14:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d2f1f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc148720 con 0x7f92cc0d05d0 2023-07-07T18:14:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d2f1f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc1efde0 con 0x7f92cc15a640 2023-07-07T18:14:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d0cbb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 0x7f92cc0c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d0cbb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 0x7f92cc0c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56234/0 (socket says 172.21.15.12:56234) 2023-07-07T18:14:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d0cbb700 1 -- 172.21.15.12:0/2442028984 learned_addr learned my addr 172.21.15.12:0/2442028984 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:23.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92cbfff700 1 --2- 172.21.15.12:0/2442028984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92cc0d05d0 0x7f92cc0c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d14bc700 1 --2- 172.21.15.12:0/2442028984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc15a640 0x7f92cc15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d0cbb700 1 -- 172.21.15.12:0/2442028984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc15a640 msgr2=0x7f92cc15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d0cbb700 1 --2- 172.21.15.12:0/2442028984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc15a640 0x7f92cc15cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d0cbb700 1 -- 172.21.15.12:0/2442028984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92cc0d05d0 msgr2=0x7f92cc0c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d0cbb700 1 --2- 172.21.15.12:0/2442028984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92cc0d05d0 0x7f92cc0c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d0cbb700 1 -- 172.21.15.12:0/2442028984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4009a70 con 0x7f92cc0cec80 2023-07-07T18:14:23.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.661+0000 7f92d0cbb700 1 --2- 172.21.15.12:0/2442028984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 0x7f92cc0c50e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92c000c700 tx=0x7f92c000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.662+0000 7f92c97fa700 1 -- 172.21.15.12:0/2442028984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0005d70 con 0x7f92cc0cec80 2023-07-07T18:14:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.662+0000 7f92c97fa700 1 -- 172.21.15.12:0/2442028984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c00070d0 con 0x7f92cc0cec80 2023-07-07T18:14:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.662+0000 7f92d2f1f700 1 -- 172.21.15.12:0/2442028984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc1f00c0 con 0x7f92cc0cec80 2023-07-07T18:14:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.662+0000 7f92c97fa700 1 -- 172.21.15.12:0/2442028984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0007460 con 0x7f92cc0cec80 2023-07-07T18:14:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.662+0000 7f92d2f1f700 1 -- 172.21.15.12:0/2442028984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc1f0ba0 con 0x7f92cc0cec80 2023-07-07T18:14:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.662+0000 7f92c97fa700 1 -- 172.21.15.12:0/2442028984 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f92c001c440 con 0x7f92cc0cec80 2023-07-07T18:14:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.663+0000 7f92c97fa700 1 -- 172.21.15.12:0/2442028984 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f92c0012ad0 con 0x7f92cc0cec80 2023-07-07T18:14:23.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.662+0000 7f92d2f1f700 1 -- 172.21.15.12:0/2442028984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc1f09f0 con 0x7f92cc0cec80 2023-07-07T18:14:23.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.665+0000 7f92c97fa700 1 -- 172.21.15.12:0/2442028984 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f92c0017070 con 0x7f92cc0cec80 2023-07-07T18:14:23.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.736+0000 7f92d2f1f700 1 -- 172.21.15.12:0/2442028984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92cc0cfbf0 con 0x7f92cc0cec80 2023-07-07T18:14:23.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.736+0000 7f92c97fa700 1 -- 172.21.15.12:0/2442028984 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f92c00124b0 con 0x7f92cc0cec80 2023-07-07T18:14:23.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:23.738 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:23.454825+0000","last_up_change":"0.000000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:23.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.737+0000 7f92d2f1f700 1 -- 172.21.15.12:0/2442028984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 msgr2=0x7f92cc0c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:23.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.737+0000 7f92d2f1f700 1 --2- 172.21.15.12:0/2442028984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 0x7f92cc0c50e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f92c000c700 tx=0x7f92c000ca10 comp rx=0 tx=0).stop 2023-07-07T18:14:23.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.737+0000 7f92d2f1f700 1 -- 172.21.15.12:0/2442028984 shutdown_connections 2023-07-07T18:14:23.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.737+0000 7f92d2f1f700 1 --2- 172.21.15.12:0/2442028984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92cc15a640 0x7f92cc15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.737+0000 7f92d2f1f700 1 --2- 172.21.15.12:0/2442028984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92cc0cec80 0x7f92cc0c50e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.737+0000 7f92d2f1f700 1 --2- 172.21.15.12:0/2442028984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92cc0d05d0 0x7f92cc0c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:23.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.737+0000 7f92d2f1f700 1 -- 172.21.15.12:0/2442028984 >> 172.21.15.12:0/2442028984 conn(0x7f92cc089fe0 msgr2=0x7f92cc0c6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:23.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.737+0000 7f92d2f1f700 1 -- 172.21.15.12:0/2442028984 shutdown_connections 2023-07-07T18:14:23.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:23.737+0000 7f92d2f1f700 1 -- 172.21.15.12:0/2442028984 wait complete. 2023-07-07T18:14:23.750 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-07T18:14:23.751 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-07T18:14:23.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T18:14:23.851+0000 7fb631b12640 -1 Falling back to public interface 2023-07-07T18:14:24.055 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:24.054+0000 7f3573e5e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-07T18:14:24.100 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T18:14:24.099+0000 7f00e3ab3640 -1 Falling back to public interface 2023-07-07T18:14:24.103 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T18:14:24.102+0000 7f39c9a03640 -1 Falling back to public interface 2023-07-07T18:14:24.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T18:14:24.106+0000 7f18b3934640 -1 Falling back to public interface 2023-07-07T18:14:24.111 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T18:14:24.110+0000 7f5322b8c640 -1 Falling back to public interface 2023-07-07T18:14:24.112 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T18:14:24.111+0000 7efe6aa26640 -1 Falling back to public interface 2023-07-07T18:14:24.114 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T18:14:24.113+0000 7efe61de4700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6824/0: (98) Address already in use 2023-07-07T18:14:24.114 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T18:14:24.113+0000 7f93b4b5e640 -1 Falling back to public interface 2023-07-07T18:14:24.119 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T18:14:24.118+0000 7fa83fa0e640 -1 Falling back to public interface 2023-07-07T18:14:24.126 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:24.125+0000 7f23b0270200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-07T18:14:24.135 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:24.134+0000 7f3573e5e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-07T18:14:24.207 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:24.207+0000 7f23b0270200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-07T18:14:24.275 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:24.274+0000 7f3573e5e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-07T18:14:24.353 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:24.352+0000 7f23b0270200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-07T18:14:24.510 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:24.510+0000 7f3573e5e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-07T18:14:24.555 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:24.584 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:24.584+0000 7f3573e5e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-07T18:14:24.600 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:24.599+0000 7f23b0270200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-07T18:14:24.672 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.671+0000 7f5e55680700 1 Processor -- start 2023-07-07T18:14:24.673 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.671+0000 7f5e55680700 1 -- start start 2023-07-07T18:14:24.674 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e55680700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5e500b1250 0x7f5e5015ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:24.675 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e55680700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e500b1620 0x7f5e500cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:24.675 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e55680700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e50071410 0x7f5e50071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:24.675 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e55680700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e501460a0 con 0x7f5e500b1620 2023-07-07T18:14:24.675 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e55680700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e50160ef0 con 0x7f5e500b1250 2023-07-07T18:14:24.675 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e55680700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e50160650 con 0x7f5e50071410 2023-07-07T18:14:24.675 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e4e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e500b1620 0x7f5e500cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:24.675 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e4e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e500b1620 0x7f5e500cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56242/0 (socket says 172.21.15.12:56242) 2023-07-07T18:14:24.676 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e4e7fc700 1 -- 172.21.15.12:0/317499620 learned_addr learned my addr 172.21.15.12:0/317499620 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:24.676 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e4f7fe700 1 --2- 172.21.15.12:0/317499620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e50071410 0x7f5e50071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:24.676 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.672+0000 7f5e4effd700 1 --2- 172.21.15.12:0/317499620 >> v2:172.21.15.160:3300/0 conn(0x7f5e500b1250 0x7f5e5015ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:24.676 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4e7fc700 1 -- 172.21.15.12:0/317499620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e50071410 msgr2=0x7f5e50071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:24.676 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4e7fc700 1 --2- 172.21.15.12:0/317499620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e50071410 0x7f5e50071890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.676 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4e7fc700 1 -- 172.21.15.12:0/317499620 >> v2:172.21.15.160:3300/0 conn(0x7f5e500b1250 msgr2=0x7f5e5015ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:24.676 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4e7fc700 1 --2- 172.21.15.12:0/317499620 >> v2:172.21.15.160:3300/0 conn(0x7f5e500b1250 0x7f5e5015ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.677 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4e7fc700 1 -- 172.21.15.12:0/317499620 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50160930 con 0x7f5e500b1620 2023-07-07T18:14:24.677 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4f7fe700 1 --2- 172.21.15.12:0/317499620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e50071410 0x7f5e50071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:24.677 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4effd700 1 --2- 172.21.15.12:0/317499620 >> v2:172.21.15.160:3300/0 conn(0x7f5e500b1250 0x7f5e5015ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:24.677 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4e7fc700 1 --2- 172.21.15.12:0/317499620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e500b1620 0x7f5e500cd600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5e5006e9c0 tx=0x7f5e38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cae4791d91a9b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:24.677 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4dffb700 1 -- 172.21.15.12:0/317499620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800b870 con 0x7f5e500b1620 2023-07-07T18:14:24.677 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4dffb700 1 -- 172.21.15.12:0/317499620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800b9d0 con 0x7f5e500b1620 2023-07-07T18:14:24.677 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.673+0000 7f5e4dffb700 1 -- 172.21.15.12:0/317499620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800bd60 con 0x7f5e500b1620 2023-07-07T18:14:24.678 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.674+0000 7f5e55680700 1 -- 172.21.15.12:0/317499620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e500b1620 msgr2=0x7f5e500cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:24.678 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.674+0000 7f5e55680700 1 --2- 172.21.15.12:0/317499620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e500b1620 0x7f5e500cd600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5e5006e9c0 tx=0x7f5e38009bd0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.678 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.674+0000 7f5e55680700 1 -- 172.21.15.12:0/317499620 shutdown_connections 2023-07-07T18:14:24.678 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.674+0000 7f5e55680700 1 --2- 172.21.15.12:0/317499620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e50071410 0x7f5e50071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.678 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.674+0000 7f5e55680700 1 --2- 172.21.15.12:0/317499620 >> v2:172.21.15.160:3300/0 conn(0x7f5e500b1250 0x7f5e5015ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.678 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.674+0000 7f5e55680700 1 --2- 172.21.15.12:0/317499620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e500b1620 0x7f5e500cd600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.678 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.674+0000 7f5e55680700 1 -- 172.21.15.12:0/317499620 >> 172.21.15.12:0/317499620 conn(0x7f5e5006e0a0 msgr2=0x7f5e500cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:24.679 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.674+0000 7f5e55680700 1 -- 172.21.15.12:0/317499620 shutdown_connections 2023-07-07T18:14:24.679 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.674+0000 7f5e55680700 1 -- 172.21.15.12:0/317499620 wait complete. 2023-07-07T18:14:24.680 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.675+0000 7f5e55680700 1 Processor -- start 2023-07-07T18:14:24.681 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.675+0000 7f5e55680700 1 -- start start 2023-07-07T18:14:24.681 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e55680700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e50071410 0x7f5e500ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:24.681 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e55680700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e500b1250 0x7f5e5015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:24.681 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e55680700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e500b1620 0x7f5e500b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:24.681 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e55680700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500ac9c0 con 0x7f5e50071410 2023-07-07T18:14:24.681 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e55680700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5015b1c0 con 0x7f5e500b1250 2023-07-07T18:14:24.681 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e55680700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500acc30 con 0x7f5e500b1620 2023-07-07T18:14:24.682 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e50071410 0x7f5e500ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:24.682 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e50071410 0x7f5e500ad710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56246/0 (socket says 172.21.15.12:56246) 2023-07-07T18:14:24.682 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4effd700 1 -- 172.21.15.12:0/1075544475 learned_addr learned my addr 172.21.15.12:0/1075544475 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:24.682 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4f7fe700 1 --2- 172.21.15.12:0/1075544475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e500b1620 0x7f5e500b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:24.682 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4e7fc700 1 --2- 172.21.15.12:0/1075544475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e500b1250 0x7f5e5015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:24.682 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4effd700 1 -- 172.21.15.12:0/1075544475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e500b1620 msgr2=0x7f5e500b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:24.682 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4effd700 1 --2- 172.21.15.12:0/1075544475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e500b1620 0x7f5e500b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.683 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4effd700 1 -- 172.21.15.12:0/1075544475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e500b1250 msgr2=0x7f5e5015ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:24.683 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4effd700 1 --2- 172.21.15.12:0/1075544475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e500b1250 0x7f5e5015ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.683 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4effd700 1 -- 172.21.15.12:0/1075544475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38009550 con 0x7f5e50071410 2023-07-07T18:14:24.683 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.676+0000 7f5e4effd700 1 --2- 172.21.15.12:0/1075544475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e50071410 0x7f5e500ad710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800e810 tx=0x7f5e4800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:24.683 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.677+0000 7f5e477fe700 1 -- 172.21.15.12:0/1075544475 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800c070 con 0x7f5e50071410 2023-07-07T18:14:24.683 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.677+0000 7f5e477fe700 1 -- 172.21.15.12:0/1075544475 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e48004230 con 0x7f5e50071410 2023-07-07T18:14:24.683 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.677+0000 7f5e55680700 1 -- 172.21.15.12:0/1075544475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e500acf10 con 0x7f5e50071410 2023-07-07T18:14:24.683 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.677+0000 7f5e477fe700 1 -- 172.21.15.12:0/1075544475 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e480036a0 con 0x7f5e50071410 2023-07-07T18:14:24.684 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.677+0000 7f5e55680700 1 -- 172.21.15.12:0/1075544475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e501f2f20 con 0x7f5e50071410 2023-07-07T18:14:24.684 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.677+0000 7f5e477fe700 1 -- 172.21.15.12:0/1075544475 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5e48003b00 con 0x7f5e50071410 2023-07-07T18:14:24.684 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.677+0000 7f5e477fe700 1 -- 172.21.15.12:0/1075544475 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5e48013af0 con 0x7f5e50071410 2023-07-07T18:14:24.684 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.678+0000 7f5e55680700 1 -- 172.21.15.12:0/1075544475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e500adc50 con 0x7f5e50071410 2023-07-07T18:14:24.684 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.680+0000 7f5e477fe700 1 -- 172.21.15.12:0/1075544475 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5e4800f040 con 0x7f5e50071410 2023-07-07T18:14:24.685 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:24.680+0000 7f23b0270200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-07T18:14:24.752 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.751+0000 7f5e55680700 1 -- 172.21.15.12:0/1075544475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e50067290 con 0x7f5e50071410 2023-07-07T18:14:24.753 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.752+0000 7f5e477fe700 1 -- 172.21.15.12:0/1075544475 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5e48013d90 con 0x7f5e50071410 2023-07-07T18:14:24.753 INFO:teuthology.misc.health.smithi012.stdout: 2023-07-07T18:14:24.753 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:23.454825+0000","last_up_change":"0.000000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:24.754 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.753+0000 7f5e55680700 1 -- 172.21.15.12:0/1075544475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e50071410 msgr2=0x7f5e500ad710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:24.754 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.753+0000 7f5e55680700 1 --2- 172.21.15.12:0/1075544475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e50071410 0x7f5e500ad710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800e810 tx=0x7f5e4800eb20 comp rx=0 tx=0).stop 2023-07-07T18:14:24.754 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.753+0000 7f5e55680700 1 -- 172.21.15.12:0/1075544475 shutdown_connections 2023-07-07T18:14:24.754 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.753+0000 7f5e55680700 1 --2- 172.21.15.12:0/1075544475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e500b1620 0x7f5e500b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.755 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.753+0000 7f5e55680700 1 --2- 172.21.15.12:0/1075544475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e50071410 0x7f5e500ad710 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.755 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.753+0000 7f5e55680700 1 --2- 172.21.15.12:0/1075544475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e500b1250 0x7f5e5015ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:24.755 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.753+0000 7f5e55680700 1 -- 172.21.15.12:0/1075544475 >> 172.21.15.12:0/1075544475 conn(0x7f5e5006e0a0 msgr2=0x7f5e5015da10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:24.755 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.753+0000 7f5e55680700 1 -- 172.21.15.12:0/1075544475 shutdown_connections 2023-07-07T18:14:24.755 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:24.753+0000 7f5e55680700 1 -- 172.21.15.12:0/1075544475 wait complete. 2023-07-07T18:14:24.765 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-07T18:14:24.859 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:24.859+0000 7f3573e5e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-07T18:14:24.966 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:24.965+0000 7f23b0270200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-07T18:14:25.079 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:25.078+0000 7f3573e5e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-07T18:14:25.193 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:25.192+0000 7f23b0270200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-07T18:14:25.235 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:25.234+0000 7f3573e5e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-07T18:14:25.352 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:25.351+0000 7f3573e5e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-07T18:14:25.356 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:25.355+0000 7f23b0270200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-07T18:14:25.479 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:25.478+0000 7f23b0270200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-07T18:14:25.501 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:25.500+0000 7f3573e5e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-07T18:14:25.636 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:25.636+0000 7f23b0270200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-07T18:14:25.781 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:25.780+0000 7f3573e5e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-07T18:14:25.948 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:25.947+0000 7f23b0270200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-07T18:14:25.967 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:25.967+0000 7f3573e5e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-07T18:14:26.140 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:26.139+0000 7f23b0270200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-07T18:14:26.563 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:26.563+0000 7f3573e5e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-07T18:14:26.777 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-07-07T18:14:26.776+0000 7f23b0270200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-07T18:14:27.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T18:14:27.383+0000 7fb631b12640 -1 osd.1 0 log_to_monitors true 2023-07-07T18:14:27.579 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T18:14:27.579+0000 7f39c9a03640 -1 osd.5 0 log_to_monitors true 2023-07-07T18:14:27.590 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:27.589+0000 7f352c0c3700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-07T18:14:27.590 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T18:14:27.589+0000 7f352c0c3700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-07T18:14:27.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T18:14:27.622+0000 7f18b3934640 -1 osd.0 0 log_to_monitors true 2023-07-07T18:14:27.640 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T18:14:27.639+0000 7f00e3ab3640 -1 osd.6 0 log_to_monitors true 2023-07-07T18:14:27.657 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T18:14:27.656+0000 7f5322b8c640 -1 osd.2 0 log_to_monitors true 2023-07-07T18:14:27.657 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T18:14:27.656+0000 7efe6aa26640 -1 osd.3 0 log_to_monitors true 2023-07-07T18:14:27.703 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T18:14:27.703+0000 7f93b4b5e640 -1 osd.4 0 log_to_monitors true 2023-07-07T18:14:27.711 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T18:14:27.710+0000 7fa83fa0e640 -1 osd.7 0 log_to_monitors true 2023-07-07T18:14:29.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T18:14:29.977+0000 7f18a7cec700 -1 osd.0 0 waiting for initial osdmap 2023-07-07T18:14:29.990 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T18:14:29.989+0000 7f39bddbb700 -1 osd.5 0 waiting for initial osdmap 2023-07-07T18:14:30.018 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T18:14:30.017+0000 7f00d7e6b700 -1 osd.6 0 waiting for initial osdmap 2023-07-07T18:14:30.019 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T18:14:30.019+0000 7f39b5995700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-07T18:14:30.041 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T18:14:30.041+0000 7f00cfa45700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-07T18:14:30.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T18:14:30.069+0000 7fb625eca700 -1 osd.1 0 waiting for initial osdmap 2023-07-07T18:14:30.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T18:14:30.071+0000 7f189f8c6700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-07T18:14:30.200 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T18:14:30.199+0000 7fb61daa4700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-07T18:14:30.828 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T18:14:30.827+0000 7efe5f5df700 -1 osd.3 0 waiting for initial osdmap 2023-07-07T18:14:30.838 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T18:14:30.838+0000 7efe569b8700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-07T18:14:30.878 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T18:14:30.877+0000 7f5316f44700 -1 osd.2 0 waiting for initial osdmap 2023-07-07T18:14:30.897 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T18:14:30.896+0000 7f530eb1e700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-07T18:14:30.998 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T18:14:30.997+0000 7f93a8f16700 -1 osd.4 0 waiting for initial osdmap 2023-07-07T18:14:31.016 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T18:14:31.015+0000 7f93a0af0700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-07T18:14:31.045 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T18:14:31.045+0000 7fa833dc6700 -1 osd.7 0 waiting for initial osdmap 2023-07-07T18:14:31.059 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T18:14:31.059+0000 7fa82b9a0700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-07T18:14:31.570 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:31.692 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.691+0000 7fdf3d30c700 1 Processor -- start 2023-07-07T18:14:31.693 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.691+0000 7fdf3d30c700 1 -- start start 2023-07-07T18:14:31.696 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.692+0000 7fdf3d30c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf380b1250 0x7fdf3815ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:31.696 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.692+0000 7fdf3d30c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdf380b1620 0x7fdf380cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:31.696 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.692+0000 7fdf3d30c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf38160ef0 con 0x7fdf38071410 2023-07-07T18:14:31.697 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.692+0000 7fdf3d30c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf381460a0 con 0x7fdf380b1620 2023-07-07T18:14:31.697 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.692+0000 7fdf3d30c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38160650 con 0x7fdf380b1250 2023-07-07T18:14:31.697 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.692+0000 7fdf377fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdf38071410 0x7fdf38071890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53628/0 (socket says 172.21.15.12:53628) 2023-07-07T18:14:31.697 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.692+0000 7fdf377fe700 1 -- 172.21.15.12:0/1735030051 learned_addr learned my addr 172.21.15.12:0/1735030051 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:31.697 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf367fc700 1 --2- 172.21.15.12:0/1735030051 >> v2:172.21.15.160:3300/0 conn(0x7fdf380b1620 0x7fdf380cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:31.697 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf36ffd700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf380b1250 0x7fdf3815ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:31.698 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106242352 0 0) 0x7fdf38160ef0 con 0x7fdf38071410 2023-07-07T18:14:31.698 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf240035b0 con 0x7fdf38071410 2023-07-07T18:14:31.698 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992130926 0 0) 0x7fdf240035b0 con 0x7fdf38071410 2023-07-07T18:14:31.698 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf380b1250 msgr2=0x7fdf3815ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:31.698 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf380b1250 0x7fdf3815ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.698 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 >> v2:172.21.15.160:3300/0 conn(0x7fdf380b1620 msgr2=0x7fdf380cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:31.698 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 --2- 172.21.15.12:0/1735030051 >> v2:172.21.15.160:3300/0 conn(0x7fdf380b1620 0x7fdf380cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.699 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf38160930 con 0x7fdf38071410 2023-07-07T18:14:31.699 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fdf300019f0 con 0x7fdf38071410 2023-07-07T18:14:31.699 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 >> v1:172.21.15.12:6789/0 conn(0x7fdf38071410 legacy=0x7fdf38071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:31.699 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf380b1250 0x7fdf24003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:31.699 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf24003f80 0x7fdf24004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:31.699 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf24005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:31.699 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf381460a0 con 0x7fdf24004d90 2023-07-07T18:14:31.700 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38160650 con 0x7fdf24003f80 2023-07-07T18:14:31.700 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2400ba40 con 0x7fdf380b1250 2023-07-07T18:14:31.700 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf377fe700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf24005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:31.700 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf367fc700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf24003f80 0x7fdf24004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:31.700 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf36ffd700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf380b1250 0x7fdf24003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:31.700 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf377fe700 1 -- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf380b1250 msgr2=0x7fdf24003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:31.700 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf377fe700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf380b1250 0x7fdf24003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.701 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf377fe700 1 -- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf24003f80 msgr2=0x7fdf24004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:31.701 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf377fe700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf24003f80 0x7fdf24004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.701 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf377fe700 1 -- 172.21.15.12:0/1735030051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf240035b0 con 0x7fdf24004d90 2023-07-07T18:14:31.701 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf367fc700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf24003f80 0x7fdf24004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:31.701 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.693+0000 7fdf377fe700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf24005200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000a830 tx=0x7fdf24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d74245a1250e72 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:31.701 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30012600 con 0x7fdf24004d90 2023-07-07T18:14:31.701 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf30012760 con 0x7fdf24004d90 2023-07-07T18:14:31.701 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf35ffb700 1 -- 172.21.15.12:0/1735030051 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30012b10 con 0x7fdf24004d90 2023-07-07T18:14:31.702 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf3d30c700 1 -- 172.21.15.12:0/1735030051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 msgr2=0x7fdf24005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:31.702 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf3d30c700 1 --2- 172.21.15.12:0/1735030051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf24005200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000a830 tx=0x7fdf24005880 comp rx=0 tx=0).stop 2023-07-07T18:14:31.702 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf377fe700 1 -- 172.21.15.12:0/1735030051 reap_dead start 2023-07-07T18:14:31.702 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf3d30c700 1 -- 172.21.15.12:0/1735030051 shutdown_connections 2023-07-07T18:14:31.702 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf3d30c700 1 -- 172.21.15.12:0/1735030051 >> 172.21.15.12:0/1735030051 conn(0x7fdf3806e0a0 msgr2=0x7fdf380cc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:31.702 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf3d30c700 1 -- 172.21.15.12:0/1735030051 shutdown_connections 2023-07-07T18:14:31.702 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.694+0000 7fdf3d30c700 1 -- 172.21.15.12:0/1735030051 wait complete. 2023-07-07T18:14:31.704 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.696+0000 7fdf3d30c700 1 Processor -- start 2023-07-07T18:14:31.705 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.696+0000 7fdf3d30c700 1 -- start start 2023-07-07T18:14:31.705 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf3d30c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf380c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:31.705 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf3d30c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf381f20e0 0x7fdf3815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:31.705 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf3d30c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf3815c2b0 0x7fdf380acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:31.705 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf3d30c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf380c6940 con 0x7fdf24004d90 2023-07-07T18:14:31.705 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf3d30c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf380b4250 con 0x7fdf3815c2b0 2023-07-07T18:14:31.705 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf3d30c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf380b4530 con 0x7fdf381f20e0 2023-07-07T18:14:31.706 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf36ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf380c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:31.706 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf36ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf380c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56438/0 (socket says 172.21.15.12:56438) 2023-07-07T18:14:31.706 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf36ffd700 1 -- 172.21.15.12:0/70503169 learned_addr learned my addr 172.21.15.12:0/70503169 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:31.706 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf367fc700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf381f20e0 0x7fdf3815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:31.706 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.697+0000 7fdf377fe700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf3815c2b0 0x7fdf380acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:31.706 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf36ffd700 1 -- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf381f20e0 msgr2=0x7fdf3815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:31.706 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf36ffd700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf381f20e0 0x7fdf3815ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.707 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf36ffd700 1 -- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf3815c2b0 msgr2=0x7fdf380acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:31.707 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf36ffd700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf3815c2b0 0x7fdf380acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.707 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf36ffd700 1 -- 172.21.15.12:0/70503169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf380b4810 con 0x7fdf24004d90 2023-07-07T18:14:31.707 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf36ffd700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf380c92e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdf20011aa0 tx=0x7fdf20011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:31.707 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf2f7fe700 1 -- 172.21.15.12:0/70503169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20011ee0 con 0x7fdf24004d90 2023-07-07T18:14:31.707 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf2f7fe700 1 -- 172.21.15.12:0/70503169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2000f940 con 0x7fdf24004d90 2023-07-07T18:14:31.707 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf380b4af0 con 0x7fdf24004d90 2023-07-07T18:14:31.707 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf2f7fe700 1 -- 172.21.15.12:0/70503169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000fcf0 con 0x7fdf24004d90 2023-07-07T18:14:31.708 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.698+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3815bfb0 con 0x7fdf24004d90 2023-07-07T18:14:31.708 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.699+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf380c6a80 con 0x7fdf24004d90 2023-07-07T18:14:31.708 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.699+0000 7fdf2f7fe700 1 -- 172.21.15.12:0/70503169 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fdf20014440 con 0x7fdf24004d90 2023-07-07T18:14:31.708 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.700+0000 7fdf2f7fe700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdf1806ac50 0x7fdf1806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:31.708 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.700+0000 7fdf2f7fe700 1 -- 172.21.15.12:0/70503169 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4191+0+0 (secure 0 0 0) 0x7fdf20089270 con 0x7fdf24004d90 2023-07-07T18:14:31.708 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.700+0000 7fdf367fc700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdf1806ac50 0x7fdf1806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:31.708 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.700+0000 7fdf367fc700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdf1806ac50 0x7fdf1806d100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf3815d6d0 tx=0x7fdf28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:31.709 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.704+0000 7fdf2f7fe700 1 -- 172.21.15.12:0/70503169 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf20054c10 con 0x7fdf24004d90 2023-07-07T18:14:31.903 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.902+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf38067290 con 0x7fdf24004d90 2023-07-07T18:14:31.904 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.903+0000 7fdf2f7fe700 1 -- 172.21.15.12:0/70503169 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10422 (secure 0 0 0) 0x7fdf20058230 con 0x7fdf24004d90 2023-07-07T18:14:31.904 INFO:teuthology.misc.health.smithi012.stdout: 2023-07-07T18:14:31.904 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":14,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:31.051829+0000","last_up_change":"2023-07-07T18:14:31.051829+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:31.906 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdf1806ac50 msgr2=0x7fdf1806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:31.906 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdf1806ac50 0x7fdf1806d100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdf3815d6d0 tx=0x7fdf28008040 comp rx=0 tx=0).stop 2023-07-07T18:14:31.906 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 msgr2=0x7fdf380c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:31.907 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf380c92e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdf20011aa0 tx=0x7fdf20011db0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.907 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 shutdown_connections 2023-07-07T18:14:31.907 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdf1806ac50 0x7fdf1806d100 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.907 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf3815c2b0 0x7fdf380acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.907 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf24004d90 0x7fdf380c92e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.907 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 --2- 172.21.15.12:0/70503169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf381f20e0 0x7fdf3815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:31.907 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 >> 172.21.15.12:0/70503169 conn(0x7fdf3806e0a0 msgr2=0x7fdf380b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:31.908 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 shutdown_connections 2023-07-07T18:14:31.908 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:31.905+0000 7fdf3d30c700 1 -- 172.21.15.12:0/70503169 wait complete. 2023-07-07T18:14:31.917 DEBUG:teuthology.misc:7 of 8 OSDs are up 2023-07-07T18:14:38.726 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:38.856 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.853+0000 7f0ab5685700 1 Processor -- start 2023-07-07T18:14:38.856 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.853+0000 7f0ab5685700 1 -- start start 2023-07-07T18:14:38.856 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0ab5685700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00b8410 0x7f0ab00d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:38.857 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0ab5685700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0ab00cee90 0x7f0ab00cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:38.857 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0ab5685700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab00d0a80 con 0x7f0ab00d0f10 2023-07-07T18:14:38.857 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0ab5685700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab00d0810 con 0x7f0ab00cee90 2023-07-07T18:14:38.857 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0ab5685700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab00cd290 con 0x7f0ab00b8410 2023-07-07T18:14:38.857 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0aaf7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0ab00d0f10 0x7f0ab015fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53692/0 (socket says 172.21.15.12:53692) 2023-07-07T18:14:38.857 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0aaf7fe700 1 -- 172.21.15.12:0/3721503968 learned_addr learned my addr 172.21.15.12:0/3721503968 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:38.857 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0aaeffd700 1 --2- 172.21.15.12:0/3721503968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00b8410 0x7f0ab00d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:38.858 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0aae7fc700 1 --2- 172.21.15.12:0/3721503968 >> v2:172.21.15.160:3300/0 conn(0x7f0ab00cee90 0x7f0ab00cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:38.858 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0aadffb700 1 -- 172.21.15.12:0/3721503968 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1387732759 0 0) 0x7f0ab00d0a80 con 0x7f0ab00d0f10 2023-07-07T18:14:38.858 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.854+0000 7f0aadffb700 1 -- 172.21.15.12:0/3721503968 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a9c0035b0 con 0x7f0ab00d0f10 2023-07-07T18:14:38.858 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.855+0000 7f0aadffb700 1 -- 172.21.15.12:0/3721503968 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 134352977 0 0) 0x7f0a9c0035b0 con 0x7f0ab00d0f10 2023-07-07T18:14:38.858 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.855+0000 7f0aae7fc700 1 -- 172.21.15.12:0/3721503968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00b8410 msgr2=0x7f0ab00d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:38.858 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.855+0000 7f0aae7fc700 1 --2- 172.21.15.12:0/3721503968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00b8410 0x7f0ab00d35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:38.858 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.855+0000 7f0aae7fc700 1 -- 172.21.15.12:0/3721503968 >> v1:172.21.15.12:6789/0 conn(0x7f0ab00d0f10 legacy=0x7f0ab015fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:38.859 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.855+0000 7f0aae7fc700 1 -- 172.21.15.12:0/3721503968 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00cda60 con 0x7f0ab00cee90 2023-07-07T18:14:38.859 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.855+0000 7f0aae7fc700 1 --2- 172.21.15.12:0/3721503968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 0x7f0ab00cf2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009840 tx=0x7f0aa0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a86badad490274f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:38.859 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.855+0000 7f0aadffb700 1 -- 172.21.15.12:0/3721503968 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa80019f0 con 0x7f0ab00cee90 2023-07-07T18:14:38.859 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.855+0000 7f0aadffb700 1 -- 172.21.15.12:0/3721503968 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa0004030 con 0x7f0ab00cee90 2023-07-07T18:14:38.859 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.855+0000 7f0aadffb700 1 -- 172.21.15.12:0/3721503968 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00043c0 con 0x7f0ab00cee90 2023-07-07T18:14:38.861 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.856+0000 7f0ab5685700 1 -- 172.21.15.12:0/3721503968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 msgr2=0x7f0ab00cf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:38.862 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.856+0000 7f0ab5685700 1 --2- 172.21.15.12:0/3721503968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 0x7f0ab00cf2e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009840 tx=0x7f0aa0009b50 comp rx=0 tx=0).stop 2023-07-07T18:14:38.862 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.856+0000 7f0ab5685700 1 -- 172.21.15.12:0/3721503968 shutdown_connections 2023-07-07T18:14:38.862 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.856+0000 7f0ab5685700 1 --2- 172.21.15.12:0/3721503968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00b8410 0x7f0ab00d35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:38.862 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.856+0000 7f0ab5685700 1 --2- 172.21.15.12:0/3721503968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 0x7f0ab00cf2e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:38.862 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.856+0000 7f0ab5685700 1 -- 172.21.15.12:0/3721503968 >> 172.21.15.12:0/3721503968 conn(0x7f0ab0071620 msgr2=0x7f0ab00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:38.862 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.856+0000 7f0ab5685700 1 -- 172.21.15.12:0/3721503968 shutdown_connections 2023-07-07T18:14:38.863 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.856+0000 7f0ab5685700 1 -- 172.21.15.12:0/3721503968 wait complete. 2023-07-07T18:14:38.863 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.857+0000 7f0ab5685700 1 Processor -- start 2023-07-07T18:14:38.863 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.857+0000 7f0ab5685700 1 -- start start 2023-07-07T18:14:38.863 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0ab5685700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab00b8410 0x7f0ab014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:38.863 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0ab5685700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 0x7f0ab015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:38.863 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0ab5685700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00d0f10 0x7f0ab014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:38.863 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0ab5685700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab015cf10 con 0x7f0ab00b8410 2023-07-07T18:14:38.863 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0ab5685700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab015d7c0 con 0x7f0ab00cee90 2023-07-07T18:14:38.864 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0ab5685700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab015daa0 con 0x7f0ab00d0f10 2023-07-07T18:14:38.864 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab00b8410 0x7f0ab014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:38.864 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab00b8410 0x7f0ab014c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56500/0 (socket says 172.21.15.12:56500) 2023-07-07T18:14:38.864 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaeffd700 1 -- 172.21.15.12:0/3701125277 learned_addr learned my addr 172.21.15.12:0/3701125277 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:38.864 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaf7fe700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00d0f10 0x7f0ab014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:38.864 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aae7fc700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 0x7f0ab015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:38.864 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaeffd700 1 -- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00d0f10 msgr2=0x7f0ab014bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:38.865 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaeffd700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00d0f10 0x7f0ab014bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:38.865 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaeffd700 1 -- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 msgr2=0x7f0ab015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:38.865 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaeffd700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 0x7f0ab015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:38.865 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaeffd700 1 -- 172.21.15.12:0/3701125277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00094a0 con 0x7f0ab00b8410 2023-07-07T18:14:38.865 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aae7fc700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 0x7f0ab015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:38.865 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.858+0000 7f0aaeffd700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab00b8410 0x7f0ab014c9a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800e9b0 tx=0x7f0a9800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:38.865 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.859+0000 7f0aa77fe700 1 -- 172.21.15.12:0/3701125277 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98009710 con 0x7f0ab00b8410 2023-07-07T18:14:38.865 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.859+0000 7f0aa77fe700 1 -- 172.21.15.12:0/3701125277 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9800c850 con 0x7f0ab00b8410 2023-07-07T18:14:38.866 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.859+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab015dd80 con 0x7f0ab00b8410 2023-07-07T18:14:38.866 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.859+0000 7f0aa77fe700 1 -- 172.21.15.12:0/3701125277 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800cbc0 con 0x7f0ab00b8410 2023-07-07T18:14:38.866 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.859+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab015e340 con 0x7f0ab00b8410 2023-07-07T18:14:38.866 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.860+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab004e1d0 con 0x7f0ab00b8410 2023-07-07T18:14:38.866 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.860+0000 7f0aa77fe700 1 -- 172.21.15.12:0/3701125277 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a9800cd20 con 0x7f0ab00b8410 2023-07-07T18:14:38.866 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.861+0000 7f0aa77fe700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0a9006ace0 0x7f0a9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:38.866 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.861+0000 7f0aa77fe700 1 -- 172.21.15.12:0/3701125277 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0a98089190 con 0x7f0ab00b8410 2023-07-07T18:14:38.867 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.861+0000 7f0aae7fc700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0a9006ace0 0x7f0a9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:38.867 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.861+0000 7f0aae7fc700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0a9006ace0 0x7f0a9006d190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00090b0 tx=0x7f0aa0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:38.867 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:38.865+0000 7f0aa77fe700 1 -- 172.21.15.12:0/3701125277 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a98058100 con 0x7f0ab00b8410 2023-07-07T18:14:39.065 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.064+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ab00b5070 con 0x7f0ab00b8410 2023-07-07T18:14:39.066 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.065+0000 7f0aa77fe700 1 -- 172.21.15.12:0/3701125277 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f0a98057c90 con 0x7f0ab00b8410 2023-07-07T18:14:39.066 INFO:teuthology.misc.health.smithi012.stdout: 2023-07-07T18:14:39.066 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":18,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:35.068753+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:39.068 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0a9006ace0 msgr2=0x7f0a9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.069 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0a9006ace0 0x7f0a9006d190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00090b0 tx=0x7f0aa0008030 comp rx=0 tx=0).stop 2023-07-07T18:14:39.069 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab00b8410 msgr2=0x7f0ab014c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.069 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab00b8410 0x7f0ab014c9a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800e9b0 tx=0x7f0a9800ed70 comp rx=0 tx=0).stop 2023-07-07T18:14:39.069 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 shutdown_connections 2023-07-07T18:14:39.069 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0a9006ace0 0x7f0a9006d190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.069 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0ab00d0f10 0x7f0ab014bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.069 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ab00b8410 0x7f0ab014c9a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.070 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 --2- 172.21.15.12:0/3701125277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab00cee90 0x7f0ab015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.070 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 >> 172.21.15.12:0/3701125277 conn(0x7f0ab0071620 msgr2=0x7f0ab00b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:39.070 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 shutdown_connections 2023-07-07T18:14:39.070 INFO:teuthology.misc.health.smithi012.stderr:2023-07-07T18:14:39.067+0000 7f0ab5685700 1 -- 172.21.15.12:0/3701125277 wait complete. 2023-07-07T18:14:39.079 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-07T18:14:39.080 INFO:tasks.ceph:Creating RBD pool 2023-07-07T18:14:39.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-07T18:14:39.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.203+0000 7f9a56d1d700 1 Processor -- start 2023-07-07T18:14:39.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.203+0000 7f9a56d1d700 1 -- start start 2023-07-07T18:14:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.203+0000 7f9a56d1d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500b5a70 0x7f9a500b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.203+0000 7f9a56d1d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9a500cf910 0x7f9a500d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.203+0000 7f9a56d1d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a500b5ec0 con 0x7f9a500d0a60 2023-07-07T18:14:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.203+0000 7f9a56d1d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a500d0060 con 0x7f9a500cf910 2023-07-07T18:14:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.203+0000 7f9a56d1d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500cd9d0 con 0x7f9a500b5a70 2023-07-07T18:14:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a552ba700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9a500cf910 0x7f9a500d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a552ba700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9a500cf910 0x7f9a500d2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56512/0 (socket says 172.21.15.12:56512) 2023-07-07T18:14:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a552ba700 1 -- 172.21.15.12:0/506808227 learned_addr learned my addr 172.21.15.12:0/506808227 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:39.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a4ffff700 1 --2- 172.21.15.12:0/506808227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500b5a70 0x7f9a500b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a552ba700 1 -- 172.21.15.12:0/506808227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500b5a70 msgr2=0x7f9a500b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a552ba700 1 --2- 172.21.15.12:0/506808227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500b5a70 0x7f9a500b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a552ba700 1 -- 172.21.15.12:0/506808227 >> v1:172.21.15.160:6789/0 conn(0x7f9a500d0a60 legacy=0x7f9a500d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a552ba700 1 -- 172.21.15.12:0/506808227 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a500cfd90 con 0x7f9a500cf910 2023-07-07T18:14:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a552ba700 1 --2- 172.21.15.12:0/506808227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 0x7f9a500d2e00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009e50 tx=0x7f9a4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93dc8b2818f814c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a4f7fe700 1 -- 172.21.15.12:0/506808227 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4800e070 con 0x7f9a500cf910 2023-07-07T18:14:39.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a4f7fe700 1 -- 172.21.15.12:0/506808227 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4800b910 con 0x7f9a500cf910 2023-07-07T18:14:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.204+0000 7f9a4f7fe700 1 -- 172.21.15.12:0/506808227 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4800bcc0 con 0x7f9a500cf910 2023-07-07T18:14:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.205+0000 7f9a56d1d700 1 -- 172.21.15.12:0/506808227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 msgr2=0x7f9a500d2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.205+0000 7f9a56d1d700 1 --2- 172.21.15.12:0/506808227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 0x7f9a500d2e00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a48009e50 tx=0x7f9a4800b330 comp rx=0 tx=0).stop 2023-07-07T18:14:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.205+0000 7f9a56d1d700 1 -- 172.21.15.12:0/506808227 shutdown_connections 2023-07-07T18:14:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.205+0000 7f9a56d1d700 1 --2- 172.21.15.12:0/506808227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 0x7f9a500d2e00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.205+0000 7f9a56d1d700 1 --2- 172.21.15.12:0/506808227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500b5a70 0x7f9a500b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.205+0000 7f9a56d1d700 1 -- 172.21.15.12:0/506808227 >> 172.21.15.12:0/506808227 conn(0x7f9a50071620 msgr2=0x7f9a500719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.205+0000 7f9a56d1d700 1 -- 172.21.15.12:0/506808227 shutdown_connections 2023-07-07T18:14:39.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.205+0000 7f9a56d1d700 1 -- 172.21.15.12:0/506808227 wait complete. 2023-07-07T18:14:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.206+0000 7f9a56d1d700 1 Processor -- start 2023-07-07T18:14:39.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.206+0000 7f9a56d1d700 1 -- start start 2023-07-07T18:14:39.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a56d1d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a500b5a70 0x7f9a5015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a56d1d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 0x7f9a5015ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a56d1d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500d0a60 0x7f9a500cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a56d1d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5015d010 con 0x7f9a500cf910 2023-07-07T18:14:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a56d1d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5015c0d0 con 0x7f9a500b5a70 2023-07-07T18:14:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a56d1d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5015d970 con 0x7f9a500d0a60 2023-07-07T18:14:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 0x7f9a5015ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 0x7f9a5015ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56516/0 (socket says 172.21.15.12:56516) 2023-07-07T18:14:39.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a4ffff700 1 -- 172.21.15.12:0/2452894250 learned_addr learned my addr 172.21.15.12:0/2452894250 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:39.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a552ba700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500d0a60 0x7f9a500cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a4ffff700 1 -- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500d0a60 msgr2=0x7f9a500cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a4ffff700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500d0a60 0x7f9a500cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a4ffff700 1 -- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a500b5a70 msgr2=0x7f9a5015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a54ab9700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a500b5a70 0x7f9a5015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a4ffff700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a500b5a70 0x7f9a5015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.207+0000 7f9a4ffff700 1 -- 172.21.15.12:0/2452894250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a48009b30 con 0x7f9a500cf910 2023-07-07T18:14:39.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.208+0000 7f9a4ffff700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 0x7f9a5015ece0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00e9b0 tx=0x7f9a3c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:39.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.208+0000 7f9a4d7fa700 1 -- 172.21.15.12:0/2452894250 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c009710 con 0x7f9a500cf910 2023-07-07T18:14:39.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.208+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5015c390 con 0x7f9a500cf910 2023-07-07T18:14:39.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.208+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5015c950 con 0x7f9a500cf910 2023-07-07T18:14:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.208+0000 7f9a4d7fa700 1 -- 172.21.15.12:0/2452894250 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c00c850 con 0x7f9a500cf910 2023-07-07T18:14:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.208+0000 7f9a4d7fa700 1 -- 172.21.15.12:0/2452894250 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00cbc0 con 0x7f9a500cf910 2023-07-07T18:14:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.209+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a300052f0 con 0x7f9a500cf910 2023-07-07T18:14:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.209+0000 7f9a4d7fa700 1 -- 172.21.15.12:0/2452894250 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a3c00cd20 con 0x7f9a500cf910 2023-07-07T18:14:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.210+0000 7f9a4d7fa700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9a3406ace0 0x7f9a3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.210+0000 7f9a4d7fa700 1 -- 172.21.15.12:0/2452894250 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a3c0897e0 con 0x7f9a500cf910 2023-07-07T18:14:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.210+0000 7f9a54ab9700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9a3406ace0 0x7f9a3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.211+0000 7f9a54ab9700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9a3406ace0 0x7f9a3406d190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a44000f60 tx=0x7f9a44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:39.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.214+0000 7f9a4d7fa700 1 -- 172.21.15.12:0/2452894250 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a3c058860 con 0x7f9a500cf910 2023-07-07T18:14:39.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.413+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f9a30005b20 con 0x7f9a500cf910 2023-07-07T18:14:39.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.643+0000 7f9a4d7fa700 1 -- 172.21.15.12:0/2452894250 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v19) v1 ==== 109+0+0 (secure 0 0 0) 0x7f9a3c0583f0 con 0x7f9a500cf910 2023-07-07T18:14:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9a3406ace0 msgr2=0x7f9a3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9a3406ace0 0x7f9a3406d190 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a44000f60 tx=0x7f9a44009040 comp rx=0 tx=0).stop 2023-07-07T18:14:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 msgr2=0x7f9a5015ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 0x7f9a5015ece0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00e9b0 tx=0x7f9a3c00ed70 comp rx=0 tx=0).stop 2023-07-07T18:14:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 shutdown_connections 2023-07-07T18:14:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9a3406ace0 0x7f9a3406d190 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a500d0a60 0x7f9a500cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a500b5a70 0x7f9a5015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 --2- 172.21.15.12:0/2452894250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a500cf910 0x7f9a5015ece0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 >> 172.21.15.12:0/2452894250 conn(0x7f9a50071620 msgr2=0x7f9a500d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.646+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 shutdown_connections 2023-07-07T18:14:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.647+0000 7f9a56d1d700 1 -- 172.21.15.12:0/2452894250 wait complete. 2023-07-07T18:14:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'rbd' created 2023-07-07T18:14:39.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-07T18:14:39.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.786+0000 7f96a50b0700 1 Processor -- start 2023-07-07T18:14:39.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.786+0000 7f96a50b0700 1 -- start start 2023-07-07T18:14:39.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.787+0000 7f96a50b0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96a00cd5e0 0x7f96a00cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.787+0000 7f96a50b0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 0x7f96a006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.787+0000 7f96a50b0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a006f0e0 con 0x7f96a006e030 2023-07-07T18:14:39.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.787+0000 7f96a50b0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a00ce2c0 con 0x7f96a00cd5e0 2023-07-07T18:14:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.787+0000 7f96a50b0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00cdef0 con 0x7f96a00adf40 2023-07-07T18:14:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.787+0000 7f969ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96a00cd5e0 0x7f96a00cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.787+0000 7f969e59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f96a006e030 0x7f96a015cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53720/0 (socket says 172.21.15.12:53720) 2023-07-07T18:14:39.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.787+0000 7f969ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96a00cd5e0 0x7f96a00cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56522/0 (socket says 172.21.15.12:56522) 2023-07-07T18:14:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.787+0000 7f969e59c700 1 -- 172.21.15.12:0/9548991 learned_addr learned my addr 172.21.15.12:0/9548991 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969f59e700 1 --2- 172.21.15.12:0/9548991 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 0x7f96a006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969ed9d700 1 -- 172.21.15.12:0/9548991 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 msgr2=0x7f96a006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:39.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969ed9d700 1 --2- 172.21.15.12:0/9548991 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 0x7f96a006e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969ed9d700 1 -- 172.21.15.12:0/9548991 >> v1:172.21.15.12:6789/0 conn(0x7f96a006e030 legacy=0x7f96a015cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969ed9d700 1 -- 172.21.15.12:0/9548991 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a006eb20 con 0x7f96a00cd5e0 2023-07-07T18:14:39.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969dd9b700 1 -- 172.21.15.12:0/9548991 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3478811570 0 0) 0x7f96a006f0e0 con 0x7f96a006e030 2023-07-07T18:14:39.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969ed9d700 1 --2- 172.21.15.12:0/9548991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 0x7f96a00cd9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f969400bac0 tx=0x7f969400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef522fb03c2ca07e server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:39.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969dd9b700 1 -- 172.21.15.12:0/9548991 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694005e30 con 0x7f96a00cd5e0 2023-07-07T18:14:39.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969dd9b700 1 -- 172.21.15.12:0/9548991 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969400d920 con 0x7f96a00cd5e0 2023-07-07T18:14:39.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.788+0000 7f969dd9b700 1 -- 172.21.15.12:0/9548991 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400dcb0 con 0x7f96a00cd5e0 2023-07-07T18:14:39.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.789+0000 7f96a50b0700 1 -- 172.21.15.12:0/9548991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 msgr2=0x7f96a00cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.789+0000 7f96a50b0700 1 --2- 172.21.15.12:0/9548991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 0x7f96a00cd9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f969400bac0 tx=0x7f969400bdd0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.789+0000 7f96a50b0700 1 -- 172.21.15.12:0/9548991 shutdown_connections 2023-07-07T18:14:39.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.789+0000 7f96a50b0700 1 --2- 172.21.15.12:0/9548991 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 0x7f96a006e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.789+0000 7f96a50b0700 1 --2- 172.21.15.12:0/9548991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 0x7f96a00cd9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.789+0000 7f96a50b0700 1 -- 172.21.15.12:0/9548991 >> 172.21.15.12:0/9548991 conn(0x7f96a006b920 msgr2=0x7f96a00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:39.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.789+0000 7f96a50b0700 1 -- 172.21.15.12:0/9548991 shutdown_connections 2023-07-07T18:14:39.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.789+0000 7f96a50b0700 1 -- 172.21.15.12:0/9548991 wait complete. 2023-07-07T18:14:39.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.790+0000 7f96a50b0700 1 Processor -- start 2023-07-07T18:14:39.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.790+0000 7f96a50b0700 1 -- start start 2023-07-07T18:14:39.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f96a50b0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96a006e030 0x7f96a00c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f96a50b0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 0x7f96a015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f96a50b0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 0x7f96a00af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f96a50b0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00c45f0 con 0x7f96a00cd5e0 2023-07-07T18:14:39.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f96a50b0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a015c560 con 0x7f96a006e030 2023-07-07T18:14:39.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f96a50b0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a00c3970 con 0x7f96a00adf40 2023-07-07T18:14:39.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 0x7f96a00af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 0x7f96a00af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56532/0 (socket says 172.21.15.12:56532) 2023-07-07T18:14:39.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969f59e700 1 -- 172.21.15.12:0/3528671825 learned_addr learned my addr 172.21.15.12:0/3528671825 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:39.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969e59c700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 0x7f96a015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969ed9d700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96a006e030 0x7f96a00c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969f59e700 1 -- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 msgr2=0x7f96a015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969f59e700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 0x7f96a015c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969f59e700 1 -- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96a006e030 msgr2=0x7f96a00c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:39.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969f59e700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96a006e030 0x7f96a00c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:39.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969f59e700 1 -- 172.21.15.12:0/3528671825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969400b6d0 con 0x7f96a00cd5e0 2023-07-07T18:14:39.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.791+0000 7f969e59c700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 0x7f96a015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:39.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.792+0000 7f969f59e700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 0x7f96a00af770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9698007e70 tx=0x7f969800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:39.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.792+0000 7f96877fe700 1 -- 172.21.15.12:0/3528671825 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969800ee50 con 0x7f96a00cd5e0 2023-07-07T18:14:39.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.792+0000 7f96877fe700 1 -- 172.21.15.12:0/3528671825 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9698014420 con 0x7f96a00cd5e0 2023-07-07T18:14:39.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.792+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a00c3c50 con 0x7f96a00cd5e0 2023-07-07T18:14:39.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.792+0000 7f96877fe700 1 -- 172.21.15.12:0/3528671825 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980147d0 con 0x7f96a00cd5e0 2023-07-07T18:14:39.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.792+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a00c4210 con 0x7f96a00cd5e0 2023-07-07T18:14:39.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.793+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a00c4730 con 0x7f96a00cd5e0 2023-07-07T18:14:39.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.793+0000 7f96877fe700 1 -- 172.21.15.12:0/3528671825 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9698014930 con 0x7f96a00cd5e0 2023-07-07T18:14:39.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.794+0000 7f96877fe700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f968c06ace0 0x7f968c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:39.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.794+0000 7f96877fe700 1 -- 172.21.15.12:0/3528671825 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f96980898f0 con 0x7f96a00cd5e0 2023-07-07T18:14:39.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.794+0000 7f969ed9d700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f968c06ace0 0x7f968c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:39.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.794+0000 7f969ed9d700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f968c06ace0 0x7f968c06d190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f969400bfd0 tx=0x7f969401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:39.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.798+0000 7f96877fe700 1 -- 172.21.15.12:0/3528671825 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9698054d00 con 0x7f96a00cd5e0 2023-07-07T18:14:39.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:39.997+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f96a004ea20 con 0x7f96a00cd5e0 2023-07-07T18:14:40.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.647+0000 7f96877fe700 1 -- 172.21.15.12:0/3528671825 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v20) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9698058320 con 0x7f96a00cd5e0 2023-07-07T18:14:40.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f968c06ace0 msgr2=0x7f968c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f968c06ace0 0x7f968c06d190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f969400bfd0 tx=0x7f969401c040 comp rx=0 tx=0).stop 2023-07-07T18:14:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 msgr2=0x7f96a00af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 0x7f96a00af770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9698007e70 tx=0x7f969800e3c0 comp rx=0 tx=0).stop 2023-07-07T18:14:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 shutdown_connections 2023-07-07T18:14:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f968c06ace0 0x7f968c06d190 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f969400bfd0 tx=0x7f969401c040 comp rx=0 tx=0).stop 2023-07-07T18:14:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96a00cd5e0 0x7f96a00af770 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96a006e030 0x7f96a00c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 --2- 172.21.15.12:0/3528671825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96a00adf40 0x7f96a015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.651+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 >> 172.21.15.12:0/3528671825 conn(0x7f96a006b920 msgr2=0x7f96a00b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.652+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 shutdown_connections 2023-07-07T18:14:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.653+0000 7f96a50b0700 1 -- 172.21.15.12:0/3528671825 wait complete. 2023-07-07T18:14:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-07T18:14:40.669 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-07T18:14:40.669 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-07T18:14:40.669 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-07T18:14:40.672 INFO:tasks.ceph.mds.a:Started 2023-07-07T18:14:40.672 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-07T18:14:40.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-07T18:14:40.674 INFO:tasks.ceph.mds.c:Started 2023-07-07T18:14:40.675 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-07T18:14:40.675 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-07T18:14:40.678 INFO:tasks.ceph.mds.b:Started 2023-07-07T18:14:40.678 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-07T18:14:40.678 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-07T18:14:40.680 INFO:tasks.ceph.mds.d:Started 2023-07-07T18:14:40.681 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-07T18:14:40.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:40.760 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-07-07T18:14:40.760 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-07-07T18:14:40.762 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-07-07T18:14:40.762 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-07-07T18:14:40.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.817+0000 7fb452db1700 1 Processor -- start 2023-07-07T18:14:40.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.817+0000 7fb452db1700 1 -- start start 2023-07-07T18:14:40.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb452db1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb44c156880 0x7fb44c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:40.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb452db1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb44c0cc1d0 0x7fb44c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:40.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb452db1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb44c0ccb50 con 0x7fb44c0aed30 2023-07-07T18:14:40.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb452db1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c0cee80 con 0x7fb44c0cc1d0 2023-07-07T18:14:40.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb452db1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb44c0cf100 con 0x7fb44c156880 2023-07-07T18:14:40.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb45134e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb44c0cc1d0 0x7fb44c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:40.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb45134e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb44c0cc1d0 0x7fb44c0cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56564/0 (socket says 172.21.15.12:56564) 2023-07-07T18:14:40.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb44bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb44c0aed30 0x7fb44c160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53760/0 (socket says 172.21.15.12:53760) 2023-07-07T18:14:40.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb45134e700 1 -- 172.21.15.12:0/811063639 learned_addr learned my addr 172.21.15.12:0/811063639 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:40.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb450b4d700 1 --2- 172.21.15.12:0/811063639 >> v2:172.21.15.160:3300/0 conn(0x7fb44c156880 0x7fb44c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:40.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb45134e700 1 -- 172.21.15.12:0/811063639 >> v2:172.21.15.160:3300/0 conn(0x7fb44c156880 msgr2=0x7fb44c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:40.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb45134e700 1 --2- 172.21.15.12:0/811063639 >> v2:172.21.15.160:3300/0 conn(0x7fb44c156880 0x7fb44c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:40.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb45134e700 1 -- 172.21.15.12:0/811063639 >> v1:172.21.15.12:6789/0 conn(0x7fb44c0aed30 legacy=0x7fb44c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:40.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb44b7fe700 1 -- 172.21.15.12:0/811063639 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979591000 0 0) 0x7fb44c0ccb50 con 0x7fb44c0aed30 2023-07-07T18:14:40.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb45134e700 1 -- 172.21.15.12:0/811063639 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0cf3e0 con 0x7fb44c0cc1d0 2023-07-07T18:14:40.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.818+0000 7fb45134e700 1 --2- 172.21.15.12:0/811063639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0cc1d0 0x7fb44c0cc610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0cf720 tx=0x7fb44400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd96b1466a4a2822 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:40.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb44b7fe700 1 -- 172.21.15.12:0/811063639 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400e070 con 0x7fb44c0cc1d0 2023-07-07T18:14:40.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb44b7fe700 1 -- 172.21.15.12:0/811063639 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44400b910 con 0x7fb44c0cc1d0 2023-07-07T18:14:40.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb44b7fe700 1 -- 172.21.15.12:0/811063639 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44400bcc0 con 0x7fb44c0cc1d0 2023-07-07T18:14:40.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb452db1700 1 -- 172.21.15.12:0/811063639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0cc1d0 msgr2=0x7fb44c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:40.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb452db1700 1 --2- 172.21.15.12:0/811063639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0cc1d0 0x7fb44c0cc610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0cf720 tx=0x7fb44400b330 comp rx=0 tx=0).stop 2023-07-07T18:14:40.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb452db1700 1 -- 172.21.15.12:0/811063639 shutdown_connections 2023-07-07T18:14:40.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb452db1700 1 --2- 172.21.15.12:0/811063639 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0cc1d0 0x7fb44c0cc610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:40.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb452db1700 1 --2- 172.21.15.12:0/811063639 >> v2:172.21.15.160:3300/0 conn(0x7fb44c156880 0x7fb44c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb452db1700 1 -- 172.21.15.12:0/811063639 >> 172.21.15.12:0/811063639 conn(0x7fb44c06d4a0 msgr2=0x7fb44c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb452db1700 1 -- 172.21.15.12:0/811063639 shutdown_connections 2023-07-07T18:14:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.819+0000 7fb452db1700 1 -- 172.21.15.12:0/811063639 wait complete. 2023-07-07T18:14:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.820+0000 7fb452db1700 1 Processor -- start 2023-07-07T18:14:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb452db1700 1 -- start start 2023-07-07T18:14:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb452db1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0aed30 0x7fb44c0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb452db1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb44c0cc1d0 0x7fb44c14d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb452db1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb44c156880 0x7fb44c0c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:40.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb452db1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0abe10 con 0x7fb44c0aed30 2023-07-07T18:14:40.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb452db1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0ac000 con 0x7fb44c0cc1d0 2023-07-07T18:14:40.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb452db1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c0c43c0 con 0x7fb44c156880 2023-07-07T18:14:40.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb450b4d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0aed30 0x7fb44c0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:40.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb450b4d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0aed30 0x7fb44c0ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56566/0 (socket says 172.21.15.12:56566) 2023-07-07T18:14:40.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.821+0000 7fb450b4d700 1 -- 172.21.15.12:0/326059662 learned_addr learned my addr 172.21.15.12:0/326059662 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:40.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb45134e700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb44c156880 0x7fb44c0c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:40.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb44bfff700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb44c0cc1d0 0x7fb44c14d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:40.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb450b4d700 1 -- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb44c156880 msgr2=0x7fb44c0c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:40.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb450b4d700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb44c156880 0x7fb44c0c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:40.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb450b4d700 1 -- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb44c0cc1d0 msgr2=0x7fb44c14d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:40.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb450b4d700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb44c0cc1d0 0x7fb44c14d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:40.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb450b4d700 1 -- 172.21.15.12:0/326059662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb444009b30 con 0x7fb44c0aed30 2023-07-07T18:14:40.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb44bfff700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb44c0cc1d0 0x7fb44c14d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:40.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb450b4d700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0aed30 0x7fb44c0ab8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb44000e870 tx=0x7fb44000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:40.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb4497fa700 1 -- 172.21.15.12:0/326059662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440009590 con 0x7fb44c0aed30 2023-07-07T18:14:40.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb4497fa700 1 -- 172.21.15.12:0/326059662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb440013680 con 0x7fb44c0aed30 2023-07-07T18:14:40.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c0c46a0 con 0x7fb44c0aed30 2023-07-07T18:14:40.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb4497fa700 1 -- 172.21.15.12:0/326059662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4400139f0 con 0x7fb44c0aed30 2023-07-07T18:14:40.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.822+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c0c4c60 con 0x7fb44c0aed30 2023-07-07T18:14:40.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.823+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c073910 con 0x7fb44c0aed30 2023-07-07T18:14:40.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.824+0000 7fb4497fa700 1 -- 172.21.15.12:0/326059662 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb440013b50 con 0x7fb44c0aed30 2023-07-07T18:14:40.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.824+0000 7fb4497fa700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb43006ace0 0x7fb43006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:40.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.824+0000 7fb4497fa700 1 -- 172.21.15.12:0/326059662 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb440089040 con 0x7fb44c0aed30 2023-07-07T18:14:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.824+0000 7fb44bfff700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb43006ace0 0x7fb43006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.825+0000 7fb44bfff700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb43006ace0 0x7fb43006d190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb44c156150 tx=0x7fb438007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:40.828+0000 7fb4497fa700 1 -- 172.21.15.12:0/326059662 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb440054440 con 0x7fb44c0aed30 2023-07-07T18:14:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.030+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb44c071cf0 con 0x7fb44c0aed30 2023-07-07T18:14:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.031+0000 7fb4497fa700 1 -- 172.21.15.12:0/326059662 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14649 (secure 0 0 0) 0x7fb440057a60 con 0x7fb44c0aed30 2023-07-07T18:14:41.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:41.033 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:40.641267+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb43006ace0 msgr2=0x7fb43006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb43006ace0 0x7fb43006d190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb44c156150 tx=0x7fb438007ca0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0aed30 msgr2=0x7fb44c0ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0aed30 0x7fb44c0ab8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb44000e870 tx=0x7fb44000eb80 comp rx=0 tx=0).stop 2023-07-07T18:14:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 shutdown_connections 2023-07-07T18:14:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb43006ace0 0x7fb43006d190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb44c156880 0x7fb44c0c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb44c0aed30 0x7fb44c0ab8d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 --2- 172.21.15.12:0/326059662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb44c0cc1d0 0x7fb44c14d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 >> 172.21.15.12:0/326059662 conn(0x7fb44c06d4a0 msgr2=0x7fb44c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:41.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 shutdown_connections 2023-07-07T18:14:41.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.033+0000 7fb452db1700 1 -- 172.21.15.12:0/326059662 wait complete. 2023-07-07T18:14:41.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-07T18:14:41.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:14:41.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.174+0000 7f893b369700 1 Processor -- start 2023-07-07T18:14:41.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.174+0000 7f893b369700 1 -- start start 2023-07-07T18:14:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f893b369700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8934158960 0x7f8934158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f893b369700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8934070dc0 0x7f893415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f893b369700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f893415d100 0x7f893406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f893b369700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893406b8f0 con 0x7f8934158960 2023-07-07T18:14:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f893b369700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893415c450 con 0x7f8934070dc0 2023-07-07T18:14:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f893b369700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8934159640 con 0x7f893415d100 2023-07-07T18:14:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f8939105700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8934158960 0x7f8934158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f8939105700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8934158960 0x7f8934158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56574/0 (socket says 172.21.15.12:56574) 2023-07-07T18:14:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f8939105700 1 -- 172.21.15.12:0/3233246677 learned_addr learned my addr 172.21.15.12:0/3233246677 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f8939906700 1 --2- 172.21.15.12:0/3233246677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f893415d100 0x7f893406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.175+0000 7f8938904700 1 --2- 172.21.15.12:0/3233246677 >> v2:172.21.15.160:3300/0 conn(0x7f8934070dc0 0x7f893415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f8939105700 1 -- 172.21.15.12:0/3233246677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f893415d100 msgr2=0x7f893406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f8939105700 1 --2- 172.21.15.12:0/3233246677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f893415d100 0x7f893406ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f8939105700 1 -- 172.21.15.12:0/3233246677 >> v2:172.21.15.160:3300/0 conn(0x7f8934070dc0 msgr2=0x7f893415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f8939105700 1 --2- 172.21.15.12:0/3233246677 >> v2:172.21.15.160:3300/0 conn(0x7f8934070dc0 0x7f893415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f8939105700 1 -- 172.21.15.12:0/3233246677 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934159920 con 0x7f8934158960 2023-07-07T18:14:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f8938904700 1 --2- 172.21.15.12:0/3233246677 >> v2:172.21.15.160:3300/0 conn(0x7f8934070dc0 0x7f893415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f8939906700 1 --2- 172.21.15.12:0/3233246677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f893415d100 0x7f893406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f8939105700 1 --2- 172.21.15.12:0/3233246677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8934158960 0x7f8934158d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8934072260 tx=0x7f892400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467c867f98d36e41 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f892bfff700 1 -- 172.21.15.12:0/3233246677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400dc20 con 0x7f8934158960 2023-07-07T18:14:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f892bfff700 1 -- 172.21.15.12:0/3233246677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892400dd80 con 0x7f8934158960 2023-07-07T18:14:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f892bfff700 1 -- 172.21.15.12:0/3233246677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924017630 con 0x7f8934158960 2023-07-07T18:14:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f893b369700 1 -- 172.21.15.12:0/3233246677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8934158960 msgr2=0x7f8934158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f893b369700 1 --2- 172.21.15.12:0/3233246677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8934158960 0x7f8934158d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8934072260 tx=0x7f892400be70 comp rx=0 tx=0).stop 2023-07-07T18:14:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f893b369700 1 -- 172.21.15.12:0/3233246677 shutdown_connections 2023-07-07T18:14:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f893b369700 1 --2- 172.21.15.12:0/3233246677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f893415d100 0x7f893406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f893b369700 1 --2- 172.21.15.12:0/3233246677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8934158960 0x7f8934158d30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f893b369700 1 --2- 172.21.15.12:0/3233246677 >> v2:172.21.15.160:3300/0 conn(0x7f8934070dc0 0x7f893415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.176+0000 7f893b369700 1 -- 172.21.15.12:0/3233246677 >> 172.21.15.12:0/3233246677 conn(0x7f89340b1990 msgr2=0x7f89340cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.177+0000 7f893b369700 1 -- 172.21.15.12:0/3233246677 shutdown_connections 2023-07-07T18:14:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.177+0000 7f893b369700 1 -- 172.21.15.12:0/3233246677 wait complete. 2023-07-07T18:14:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.178+0000 7f893b369700 1 Processor -- start 2023-07-07T18:14:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.178+0000 7f893b369700 1 -- start start 2023-07-07T18:14:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f893b369700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8934070dc0 0x7f8934147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f893b369700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8934158960 0x7f8934145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f893b369700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f893415d100 0x7f89340c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f893b369700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89340b3a50 con 0x7f893415d100 2023-07-07T18:14:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f893b369700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8934147590 con 0x7f8934158960 2023-07-07T18:14:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f893b369700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89340b3120 con 0x7f8934070dc0 2023-07-07T18:14:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939906700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f893415d100 0x7f89340c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939906700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f893415d100 0x7f89340c27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56584/0 (socket says 172.21.15.12:56584) 2023-07-07T18:14:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939906700 1 -- 172.21.15.12:0/1817409542 learned_addr learned my addr 172.21.15.12:0/1817409542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939105700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8934070dc0 0x7f8934147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8938904700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8934158960 0x7f8934145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939906700 1 -- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8934070dc0 msgr2=0x7f8934147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939906700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8934070dc0 0x7f8934147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939906700 1 -- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8934158960 msgr2=0x7f8934145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939906700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8934158960 0x7f8934145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939906700 1 -- 172.21.15.12:0/1817409542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892400b7f0 con 0x7f893415d100 2023-07-07T18:14:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8939906700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f893415d100 0x7f89340c27b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f892c007ef0 tx=0x7f892c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8929ffb700 1 -- 172.21.15.12:0/1817409542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c00dde0 con 0x7f893415d100 2023-07-07T18:14:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8929ffb700 1 -- 172.21.15.12:0/1817409542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c00f040 con 0x7f893415d100 2023-07-07T18:14:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89340b3400 con 0x7f893415d100 2023-07-07T18:14:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.179+0000 7f8929ffb700 1 -- 172.21.15.12:0/1817409542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c015640 con 0x7f893415d100 2023-07-07T18:14:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.180+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89340c5690 con 0x7f893415d100 2023-07-07T18:14:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.181+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89340b3c00 con 0x7f893415d100 2023-07-07T18:14:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.181+0000 7f8929ffb700 1 -- 172.21.15.12:0/1817409542 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f892c0143a0 con 0x7f893415d100 2023-07-07T18:14:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.181+0000 7f8929ffb700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f891806ace0 0x7f891806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.182+0000 7f8929ffb700 1 -- 172.21.15.12:0/1817409542 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f892c089110 con 0x7f893415d100 2023-07-07T18:14:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.182+0000 7f8939105700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f891806ace0 0x7f891806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.182+0000 7f8939105700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f891806ace0 0x7f891806d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8924019040 tx=0x7f892400bf90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.186+0000 7f8929ffb700 1 -- 172.21.15.12:0/1817409542 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89340b3c00 con 0x7f893415d100 2023-07-07T18:14:41.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.382+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f893404ea20 con 0x7f893415d100 2023-07-07T18:14:41.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.383+0000 7f8929ffb700 1 -- 172.21.15.12:0/1817409542 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f892c054510 con 0x7f893415d100 2023-07-07T18:14:41.384 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:14:41.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f891806ace0 msgr2=0x7f891806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f891806ace0 0x7f891806d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8924019040 tx=0x7f892400bf90 comp rx=0 tx=0).stop 2023-07-07T18:14:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f893415d100 msgr2=0x7f89340c27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f893415d100 0x7f89340c27b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f892c007ef0 tx=0x7f892c00d3b0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 shutdown_connections 2023-07-07T18:14:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f891806ace0 0x7f891806d190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f893415d100 0x7f89340c27b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8934070dc0 0x7f8934147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 --2- 172.21.15.12:0/1817409542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8934158960 0x7f8934145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 >> 172.21.15.12:0/1817409542 conn(0x7f89340b1990 msgr2=0x7f89341566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 shutdown_connections 2023-07-07T18:14:41.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.385+0000 7f893b369700 1 -- 172.21.15.12:0/1817409542 wait complete. 2023-07-07T18:14:41.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:14:41.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.524+0000 7f207ec23700 1 Processor -- start 2023-07-07T18:14:41.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.525+0000 7f207ec23700 1 -- start start 2023-07-07T18:14:41.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.525+0000 7f207ec23700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207806e970 0x7f207806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.525+0000 7f207ec23700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20780ce620 con 0x7f207815fc60 2023-07-07T18:14:41.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.525+0000 7f207ec23700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2078160580 con 0x7f20780aecc0 2023-07-07T18:14:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.525+0000 7f207ec23700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2078160860 con 0x7f207806e970 2023-07-07T18:14:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.525+0000 7f207c9bf700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f207815fc60 0x7f207806e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53786/0 (socket says 172.21.15.12:53786) 2023-07-07T18:14:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.525+0000 7f207c9bf700 1 -- 172.21.15.12:0/1294887243 learned_addr learned my addr 172.21.15.12:0/1294887243 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f207d1c0700 1 --2- 172.21.15.12:0/1294887243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207806e970 0x7f207806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f20777fe700 1 -- 172.21.15.12:0/1294887243 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982827704 0 0) 0x7f20780ce620 con 0x7f207815fc60 2023-07-07T18:14:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f20777fe700 1 -- 172.21.15.12:0/1294887243 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20680035b0 con 0x7f207815fc60 2023-07-07T18:14:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f20777fe700 1 -- 172.21.15.12:0/1294887243 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940290213 0 0) 0x7f2078160580 con 0x7f20780aecc0 2023-07-07T18:14:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f20777fe700 1 -- 172.21.15.12:0/1294887243 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20780ce620 con 0x7f20780aecc0 2023-07-07T18:14:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f20777fe700 1 -- 172.21.15.12:0/1294887243 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2269561089 0 0) 0x7f20680035b0 con 0x7f207815fc60 2023-07-07T18:14:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f207d1c0700 1 -- 172.21.15.12:0/1294887243 >> v1:172.21.15.160:6789/0 conn(0x7f20780aecc0 legacy=0x7f20780cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f207d1c0700 1 -- 172.21.15.12:0/1294887243 >> v1:172.21.15.12:6789/0 conn(0x7f207815fc60 legacy=0x7f207806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f207d1c0700 1 -- 172.21.15.12:0/1294887243 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2078160b40 con 0x7f207806e970 2023-07-07T18:14:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f207d1c0700 1 --2- 172.21.15.12:0/1294887243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207806e970 0x7f207806a900 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2070009dc0 tx=0x7f207000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a8f991bc8dd09ff server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f20777fe700 1 -- 172.21.15.12:0/1294887243 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207000e070 con 0x7f207806e970 2023-07-07T18:14:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f20777fe700 1 -- 172.21.15.12:0/1294887243 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2070003a20 con 0x7f207806e970 2023-07-07T18:14:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.526+0000 7f20777fe700 1 -- 172.21.15.12:0/1294887243 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206c0017f0 con 0x7f207806e970 2023-07-07T18:14:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.527+0000 7f207ec23700 1 -- 172.21.15.12:0/1294887243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207806e970 msgr2=0x7f207806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.527+0000 7f207ec23700 1 --2- 172.21.15.12:0/1294887243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207806e970 0x7f207806a900 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2070009dc0 tx=0x7f207000b330 comp rx=0 tx=0).stop 2023-07-07T18:14:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.527+0000 7f207ec23700 1 -- 172.21.15.12:0/1294887243 shutdown_connections 2023-07-07T18:14:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.527+0000 7f207ec23700 1 --2- 172.21.15.12:0/1294887243 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207806e970 0x7f207806a900 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.527+0000 7f207ec23700 1 -- 172.21.15.12:0/1294887243 >> 172.21.15.12:0/1294887243 conn(0x7f207806b920 msgr2=0x7f20780cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.527+0000 7f207ec23700 1 -- 172.21.15.12:0/1294887243 shutdown_connections 2023-07-07T18:14:41.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.527+0000 7f207ec23700 1 -- 172.21.15.12:0/1294887243 wait complete. 2023-07-07T18:14:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.528+0000 7f207ec23700 1 Processor -- start 2023-07-07T18:14:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.528+0000 7f207ec23700 1 -- start start 2023-07-07T18:14:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f207ec23700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f207806e970 0x7f20780b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f207ec23700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20780aecc0 0x7f20780b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f207ec23700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207815fc60 0x7f20781e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f207ec23700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20781e6460 con 0x7f20780aecc0 2023-07-07T18:14:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f207ec23700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20781e6740 con 0x7f207806e970 2023-07-07T18:14:41.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f207ec23700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20781e6a20 con 0x7f207815fc60 2023-07-07T18:14:41.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f2077fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20780aecc0 0x7f20780b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f2077fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20780aecc0 0x7f20780b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56596/0 (socket says 172.21.15.12:56596) 2023-07-07T18:14:41.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f2077fff700 1 -- 172.21.15.12:0/1450038252 learned_addr learned my addr 172.21.15.12:0/1450038252 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:41.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f207d1c0700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207815fc60 0x7f20781e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f207c9bf700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f207806e970 0x7f20780b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.529+0000 7f2077fff700 1 -- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207815fc60 msgr2=0x7f20781e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f2077fff700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207815fc60 0x7f20781e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f2077fff700 1 -- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f207806e970 msgr2=0x7f20780b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f2077fff700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f207806e970 0x7f20780b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f2077fff700 1 -- 172.21.15.12:0/1450038252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2070009a70 con 0x7f20780aecc0 2023-07-07T18:14:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f207d1c0700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207815fc60 0x7f20781e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f2077fff700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20780aecc0 0x7f20780b0300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f206400c520 tx=0x7f206400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f20757fa700 1 -- 172.21.15.12:0/1450038252 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640052d0 con 0x7f20780aecc0 2023-07-07T18:14:41.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f20757fa700 1 -- 172.21.15.12:0/1450038252 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2064005430 con 0x7f20780aecc0 2023-07-07T18:14:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f20757fa700 1 -- 172.21.15.12:0/1450038252 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20640038c0 con 0x7f20780aecc0 2023-07-07T18:14:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20781e6d00 con 0x7f20780aecc0 2023-07-07T18:14:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.530+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20780b5690 con 0x7f20780aecc0 2023-07-07T18:14:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.531+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20781e7220 con 0x7f20780aecc0 2023-07-07T18:14:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.531+0000 7f20757fa700 1 -- 172.21.15.12:0/1450038252 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2064003a20 con 0x7f20780aecc0 2023-07-07T18:14:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.532+0000 7f20757fa700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205c06ad10 0x7f205c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.532+0000 7f20757fa700 1 -- 172.21.15.12:0/1450038252 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f20640886b0 con 0x7f20780aecc0 2023-07-07T18:14:41.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.532+0000 7f207c9bf700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205c06ad10 0x7f205c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.532+0000 7f207c9bf700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205c06ad10 0x7f205c06d1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f206c001360 tx=0x7f206c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.536+0000 7f20757fa700 1 -- 172.21.15.12:0/1450038252 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f20781e7220 con 0x7f20780aecc0 2023-07-07T18:14:41.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.734+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f20781e7220 con 0x7f20780aecc0 2023-07-07T18:14:41.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.734+0000 7f20757fa700 1 -- 172.21.15.12:0/1450038252 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f20781e7220 con 0x7f20780aecc0 2023-07-07T18:14:41.736 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:14:41.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.736+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205c06ad10 msgr2=0x7f205c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.736+0000 7f207ec23700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205c06ad10 0x7f205c06d1c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f206c001360 tx=0x7f206c009040 comp rx=0 tx=0).stop 2023-07-07T18:14:41.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.736+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20780aecc0 msgr2=0x7f20780b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.736+0000 7f207ec23700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20780aecc0 0x7f20780b0300 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f206400c520 tx=0x7f206400c8e0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.737+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 shutdown_connections 2023-07-07T18:14:41.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.737+0000 7f207ec23700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205c06ad10 0x7f205c06d1c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.737+0000 7f207ec23700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f207815fc60 0x7f20781e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.737+0000 7f207ec23700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f207806e970 0x7f20780b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.737+0000 7f207ec23700 1 --2- 172.21.15.12:0/1450038252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20780aecc0 0x7f20780b0300 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.737+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 >> 172.21.15.12:0/1450038252 conn(0x7f207806b920 msgr2=0x7f20780acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.737+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 shutdown_connections 2023-07-07T18:14:41.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.737+0000 7f207ec23700 1 -- 172.21.15.12:0/1450038252 wait complete. 2023-07-07T18:14:41.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:14:41.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.874+0000 7fe0074cc700 1 Processor -- start 2023-07-07T18:14:41.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.874+0000 7fe0074cc700 1 -- start start 2023-07-07T18:14:41.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.875+0000 7fe0074cc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0000cc1d0 0x7fe0000cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.875+0000 7fe0074cc700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0000ccb50 con 0x7fe0000aed30 2023-07-07T18:14:41.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.875+0000 7fe0074cc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0000cee80 con 0x7fe000156880 2023-07-07T18:14:41.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.875+0000 7fe0074cc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000cf100 con 0x7fe0000cc1d0 2023-07-07T18:14:41.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.875+0000 7fe005a69700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0000cc1d0 0x7fe0000cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.875+0000 7fe004a67700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe0000aed30 0x7fe000160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53804/0 (socket says 172.21.15.12:53804) 2023-07-07T18:14:41.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.875+0000 7fe004a67700 1 -- 172.21.15.12:0/829920848 learned_addr learned my addr 172.21.15.12:0/829920848 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:41.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fe005a69700 1 -- 172.21.15.12:0/829920848 >> v1:172.21.15.160:6789/0 conn(0x7fe000156880 legacy=0x7fe000069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:41.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fe005a69700 1 -- 172.21.15.12:0/829920848 >> v1:172.21.15.12:6789/0 conn(0x7fe0000aed30 legacy=0x7fe000160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fdff7fff700 1 -- 172.21.15.12:0/829920848 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810952293 0 0) 0x7fe0000ccb50 con 0x7fe0000aed30 2023-07-07T18:14:41.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fe005a69700 1 -- 172.21.15.12:0/829920848 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000cf3e0 con 0x7fe0000cc1d0 2023-07-07T18:14:41.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fe005a69700 1 --2- 172.21.15.12:0/829920848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 0x7fe0000cc610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009d90 tx=0x7fdff800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b1c1f5bba34b04 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:41.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fdff7fff700 1 -- 172.21.15.12:0/829920848 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800e070 con 0x7fe0000cc1d0 2023-07-07T18:14:41.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fdff7fff700 1 -- 172.21.15.12:0/829920848 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff800bb90 con 0x7fe0000cc1d0 2023-07-07T18:14:41.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fdff7fff700 1 -- 172.21.15.12:0/829920848 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8003a20 con 0x7fe0000cc1d0 2023-07-07T18:14:41.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fe0074cc700 1 -- 172.21.15.12:0/829920848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 msgr2=0x7fe0000cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fe0074cc700 1 --2- 172.21.15.12:0/829920848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 0x7fe0000cc610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdff8009d90 tx=0x7fdff800b330 comp rx=0 tx=0).stop 2023-07-07T18:14:41.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fe0074cc700 1 -- 172.21.15.12:0/829920848 shutdown_connections 2023-07-07T18:14:41.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fe0074cc700 1 --2- 172.21.15.12:0/829920848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 0x7fe0000cc610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.876+0000 7fe0074cc700 1 -- 172.21.15.12:0/829920848 >> 172.21.15.12:0/829920848 conn(0x7fe00006d4a0 msgr2=0x7fe00006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:41.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.877+0000 7fe0074cc700 1 -- 172.21.15.12:0/829920848 shutdown_connections 2023-07-07T18:14:41.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.877+0000 7fe0074cc700 1 -- 172.21.15.12:0/829920848 wait complete. 2023-07-07T18:14:41.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.878+0000 7fe0074cc700 1 Processor -- start 2023-07-07T18:14:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.878+0000 7fe0074cc700 1 -- start start 2023-07-07T18:14:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.878+0000 7fe0074cc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0000aed30 0x7fe0001500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.878+0000 7fe0074cc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 0x7fe0001e7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.878+0000 7fe0074cc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe000156880 0x7fe0001e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.878+0000 7fe0074cc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000ae6f0 con 0x7fe0000cc1d0 2023-07-07T18:14:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.878+0000 7fe0074cc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000b5460 con 0x7fe000156880 2023-07-07T18:14:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.878+0000 7fe0074cc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000ad890 con 0x7fe0000aed30 2023-07-07T18:14:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe004a67700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 0x7fe0001e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe004a67700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 0x7fe0001e7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56614/0 (socket says 172.21.15.12:56614) 2023-07-07T18:14:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe004a67700 1 -- 172.21.15.12:0/1036373970 learned_addr learned my addr 172.21.15.12:0/1036373970 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe005a69700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe000156880 0x7fe0001e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe005268700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0000aed30 0x7fe0001500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe004a67700 1 -- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0000aed30 msgr2=0x7fe0001500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe004a67700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0000aed30 0x7fe0001500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe004a67700 1 -- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe000156880 msgr2=0x7fe0001e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe004a67700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe000156880 0x7fe0001e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:41.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe004a67700 1 -- 172.21.15.12:0/1036373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8009a70 con 0x7fe0000cc1d0 2023-07-07T18:14:41.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe004a67700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 0x7fe0001e7260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00c750 tx=0x7fdffc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:41.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fdff5ffb700 1 -- 172.21.15.12:0/1036373970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc004c80 con 0x7fe0000cc1d0 2023-07-07T18:14:41.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fdff5ffb700 1 -- 172.21.15.12:0/1036373970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdffc004e00 con 0x7fe0000cc1d0 2023-07-07T18:14:41.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fdff5ffb700 1 -- 172.21.15.12:0/1036373970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdffc007310 con 0x7fe0000cc1d0 2023-07-07T18:14:41.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0000adae0 con 0x7fe0000cc1d0 2023-07-07T18:14:41.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.879+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0000ae0a0 con 0x7fe0000cc1d0 2023-07-07T18:14:41.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.880+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000073910 con 0x7fe0000cc1d0 2023-07-07T18:14:41.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.881+0000 7fdff5ffb700 1 -- 172.21.15.12:0/1036373970 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdffc007470 con 0x7fe0000cc1d0 2023-07-07T18:14:41.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.881+0000 7fdff5ffb700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfe406ace0 0x7fdfe406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:41.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.881+0000 7fdff5ffb700 1 -- 172.21.15.12:0/1036373970 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdffc088e80 con 0x7fe0000cc1d0 2023-07-07T18:14:41.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.881+0000 7fe005268700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfe406ace0 0x7fdfe406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:41.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.882+0000 7fe005268700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfe406ace0 0x7fdfe406d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe0000b5610 tx=0x7fdff0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:41.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:41.885+0000 7fdff5ffb700 1 -- 172.21.15.12:0/1036373970 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdffc054310 con 0x7fe0000cc1d0 2023-07-07T18:14:42.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.131+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0001e7e00 con 0x7fe0000cc1d0 2023-07-07T18:14:42.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.131+0000 7fdff5ffb700 1 -- 172.21.15.12:0/1036373970 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fdffc057930 con 0x7fe0000cc1d0 2023-07-07T18:14:42.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:42.133 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4296,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-07T18:14:42.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfe406ace0 msgr2=0x7fdfe406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfe406ace0 0x7fdfe406d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe0000b5610 tx=0x7fdff0008040 comp rx=0 tx=0).stop 2023-07-07T18:14:42.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 msgr2=0x7fe0001e7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 0x7fe0001e7260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdffc00c750 tx=0x7fdffc00cb10 comp rx=0 tx=0).stop 2023-07-07T18:14:42.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 shutdown_connections 2023-07-07T18:14:42.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfe406ace0 0x7fdfe406d190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe000156880 0x7fe0001e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0000aed30 0x7fe0001500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 --2- 172.21.15.12:0/1036373970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0000cc1d0 0x7fe0001e7260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 >> 172.21.15.12:0/1036373970 conn(0x7fe00006d4a0 msgr2=0x7fe00015d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:42.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 shutdown_connections 2023-07-07T18:14:42.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.133+0000 7fe0074cc700 1 -- 172.21.15.12:0/1036373970 wait complete. 2023-07-07T18:14:42.136 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2023-07-07T18:14:42.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:42.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.270+0000 7f0fc0ac1700 1 Processor -- start 2023-07-07T18:14:42.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.270+0000 7f0fc0ac1700 1 -- start start 2023-07-07T18:14:42.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fc0ac1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 0x7f0fbc15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fc0ac1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0fbc15d700 0x7f0fbc06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fc0ac1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0fbc0caea0 0x7f0fbc0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fc0ac1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc06f220 con 0x7f0fbc0caea0 2023-07-07T18:14:42.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fc0ac1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c9e60 con 0x7f0fbc15d700 2023-07-07T18:14:42.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fc0ac1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc15d470 con 0x7f0fbc15cb60 2023-07-07T18:14:42.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fbad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0fbc0caea0 0x7f0fbc0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fbad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0fbc0caea0 0x7f0fbc0cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56624/0 (socket says 172.21.15.12:56624) 2023-07-07T18:14:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fbad9d700 1 -- 172.21.15.12:0/2453800059 learned_addr learned my addr 172.21.15.12:0/2453800059 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fba59c700 1 --2- 172.21.15.12:0/2453800059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 0x7f0fbc15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fb9d9b700 1 --2- 172.21.15.12:0/2453800059 >> v2:172.21.15.160:3300/0 conn(0x7f0fbc15d700 0x7f0fbc06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fbad9d700 1 -- 172.21.15.12:0/2453800059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 msgr2=0x7f0fbc15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fbad9d700 1 --2- 172.21.15.12:0/2453800059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 0x7f0fbc15cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fbad9d700 1 -- 172.21.15.12:0/2453800059 >> v2:172.21.15.160:3300/0 conn(0x7f0fbc15d700 msgr2=0x7f0fbc06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fbad9d700 1 --2- 172.21.15.12:0/2453800059 >> v2:172.21.15.160:3300/0 conn(0x7f0fbc15d700 0x7f0fbc06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.271+0000 7f0fbad9d700 1 -- 172.21.15.12:0/2453800059 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0ca0e0 con 0x7f0fbc0caea0 2023-07-07T18:14:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fbad9d700 1 --2- 172.21.15.12:0/2453800059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0cb320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc066b40 tx=0x7f0fb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217923e1aa616951 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fb959a700 1 -- 172.21.15.12:0/2453800059 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400e070 con 0x7f0fbc0caea0 2023-07-07T18:14:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fb959a700 1 -- 172.21.15.12:0/2453800059 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb400b9c0 con 0x7f0fbc0caea0 2023-07-07T18:14:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fb959a700 1 -- 172.21.15.12:0/2453800059 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400bd70 con 0x7f0fbc0caea0 2023-07-07T18:14:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/2453800059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 msgr2=0x7f0fbc0cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/2453800059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0cb320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc066b40 tx=0x7f0fb400b330 comp rx=0 tx=0).stop 2023-07-07T18:14:42.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/2453800059 shutdown_connections 2023-07-07T18:14:42.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/2453800059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 0x7f0fbc15cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/2453800059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0cb320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/2453800059 >> v2:172.21.15.160:3300/0 conn(0x7f0fbc15d700 0x7f0fbc06e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/2453800059 >> 172.21.15.12:0/2453800059 conn(0x7f0fbc0b1740 msgr2=0x7f0fbc06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:42.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/2453800059 shutdown_connections 2023-07-07T18:14:42.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.272+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/2453800059 wait complete. 2023-07-07T18:14:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.274+0000 7f0fc0ac1700 1 Processor -- start 2023-07-07T18:14:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.274+0000 7f0fc0ac1700 1 -- start start 2023-07-07T18:14:42.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.275+0000 7f0fc0ac1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.275+0000 7f0fc0ac1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 0x7f0fbc0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.275+0000 7f0fc0ac1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fbc15d700 0x7f0fbc14da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.275+0000 7f0fc0ac1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0b31d0 con 0x7f0fbc0caea0 2023-07-07T18:14:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.275+0000 7f0fc0ac1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0b2130 con 0x7f0fbc15d700 2023-07-07T18:14:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.275+0000 7f0fc0ac1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc0b2410 con 0x7f0fbc15cb60 2023-07-07T18:14:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.275+0000 7f0fba59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.275+0000 7f0fba59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56626/0 (socket says 172.21.15.12:56626) 2023-07-07T18:14:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.275+0000 7f0fba59c700 1 -- 172.21.15.12:0/4114730240 learned_addr learned my addr 172.21.15.12:0/4114730240 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fb9d9b700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 0x7f0fbc0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fbad9d700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fbc15d700 0x7f0fbc14da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fba59c700 1 -- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 msgr2=0x7f0fbc0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fba59c700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 0x7f0fbc0c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fba59c700 1 -- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fbc15d700 msgr2=0x7f0fbc14da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fba59c700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fbc15d700 0x7f0fbc14da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fba59c700 1 -- 172.21.15.12:0/4114730240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb4009b30 con 0x7f0fbc0caea0 2023-07-07T18:14:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fbad9d700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fbc15d700 0x7f0fbc14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:42.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fb9d9b700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 0x7f0fbc0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fba59c700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0afe60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000e810 tx=0x7f0fb000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0faaffd700 1 -- 172.21.15.12:0/4114730240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0013610 con 0x7f0fbc0caea0 2023-07-07T18:14:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0faaffd700 1 -- 172.21.15.12:0/4114730240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb0013770 con 0x7f0fbc0caea0 2023-07-07T18:14:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0faaffd700 1 -- 172.21.15.12:0/4114730240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0013b20 con 0x7f0fbc0caea0 2023-07-07T18:14:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc0b26f0 con 0x7f0fbc0caea0 2023-07-07T18:14:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.276+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc0b2cb0 con 0x7f0fbc0caea0 2023-07-07T18:14:42.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.277+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc073910 con 0x7f0fbc0caea0 2023-07-07T18:14:42.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.277+0000 7f0faaffd700 1 -- 172.21.15.12:0/4114730240 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fb0013c80 con 0x7f0fbc0caea0 2023-07-07T18:14:42.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.278+0000 7f0faaffd700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0f9c06ace0 0x7f0f9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.278+0000 7f0faaffd700 1 -- 172.21.15.12:0/4114730240 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0fb0088e60 con 0x7f0fbc0caea0 2023-07-07T18:14:42.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.278+0000 7f0fb9d9b700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0f9c06ace0 0x7f0f9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.278+0000 7f0fb9d9b700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0f9c06ace0 0x7f0f9c06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0b3540 tx=0x7f0fac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:42.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.282+0000 7f0faaffd700 1 -- 172.21.15.12:0/4114730240 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0fb0054270 con 0x7f0fbc0caea0 2023-07-07T18:14:42.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.479+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fbc06b1b0 con 0x7f0fbc0caea0 2023-07-07T18:14:42.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.480+0000 7f0faaffd700 1 -- 172.21.15.12:0/4114730240 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14636 (secure 0 0 0) 0x7f0fb0057890 con 0x7f0fbc0caea0 2023-07-07T18:14:42.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:42.482 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:41.650549+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:42.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0f9c06ace0 msgr2=0x7f0f9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0f9c06ace0 0x7f0f9c06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0b3540 tx=0x7f0fac008040 comp rx=0 tx=0).stop 2023-07-07T18:14:42.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 msgr2=0x7f0fbc0afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0afe60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000e810 tx=0x7f0fb000ebd0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 shutdown_connections 2023-07-07T18:14:42.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0f9c06ace0 0x7f0f9c06d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fbc15d700 0x7f0fbc14da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0fbc0caea0 0x7f0fbc0afe60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 --2- 172.21.15.12:0/4114730240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fbc15cb60 0x7f0fbc0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 >> 172.21.15.12:0/4114730240 conn(0x7f0fbc0b1740 msgr2=0x7f0fbc0cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:42.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 shutdown_connections 2023-07-07T18:14:42.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.482+0000 7f0fc0ac1700 1 -- 172.21.15.12:0/4114730240 wait complete. 2023-07-07T18:14:42.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-07T18:14:42.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:14:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.623+0000 7f8225961700 1 Processor -- start 2023-07-07T18:14:42.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.624+0000 7f8225961700 1 -- start start 2023-07-07T18:14:42.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.624+0000 7f8225961700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 0x7f82200b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.624+0000 7f8225961700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f82200b51d0 0x7f82200cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.624+0000 7f8225961700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82200d0e30 0x7f82200d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.624+0000 7f8225961700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200d0060 con 0x7f82200d0e30 2023-07-07T18:14:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.624+0000 7f8225961700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200cfe50 con 0x7f82200b51d0 2023-07-07T18:14:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.624+0000 7f8225961700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82200cd9d0 con 0x7f82200d0a60 2023-07-07T18:14:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.624+0000 7f821f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82200d0e30 0x7f82200d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f82200d0e30 0x7f82200d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56638/0 (socket says 172.21.15.12:56638) 2023-07-07T18:14:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821f7fe700 1 -- 172.21.15.12:0/2062347153 learned_addr learned my addr 172.21.15.12:0/2062347153 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821effd700 1 --2- 172.21.15.12:0/2062347153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 0x7f82200b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821e7fc700 1 --2- 172.21.15.12:0/2062347153 >> v2:172.21.15.160:3300/0 conn(0x7f82200b51d0 0x7f82200cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821f7fe700 1 -- 172.21.15.12:0/2062347153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 msgr2=0x7f82200b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821f7fe700 1 --2- 172.21.15.12:0/2062347153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 0x7f82200b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821f7fe700 1 -- 172.21.15.12:0/2062347153 >> v2:172.21.15.160:3300/0 conn(0x7f82200b51d0 msgr2=0x7f82200cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821f7fe700 1 --2- 172.21.15.12:0/2062347153 >> v2:172.21.15.160:3300/0 conn(0x7f82200b51d0 0x7f82200cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821f7fe700 1 -- 172.21.15.12:0/2062347153 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200b5640 con 0x7f82200d0e30 2023-07-07T18:14:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821e7fc700 1 --2- 172.21.15.12:0/2062347153 >> v2:172.21.15.160:3300/0 conn(0x7f82200b51d0 0x7f82200cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821f7fe700 1 --2- 172.21.15.12:0/2062347153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200d0e30 0x7f82200d12b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f82200d3cf0 tx=0x7f821800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5868739b015b1d16 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821dffb700 1 -- 172.21.15.12:0/2062347153 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800e070 con 0x7f82200d0e30 2023-07-07T18:14:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821dffb700 1 -- 172.21.15.12:0/2062347153 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821800b9c0 con 0x7f82200d0e30 2023-07-07T18:14:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.625+0000 7f821dffb700 1 -- 172.21.15.12:0/2062347153 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821800bd70 con 0x7f82200d0e30 2023-07-07T18:14:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.626+0000 7f8225961700 1 -- 172.21.15.12:0/2062347153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200d0e30 msgr2=0x7f82200d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.626+0000 7f8225961700 1 --2- 172.21.15.12:0/2062347153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200d0e30 0x7f82200d12b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f82200d3cf0 tx=0x7f821800b330 comp rx=0 tx=0).stop 2023-07-07T18:14:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.626+0000 7f8225961700 1 -- 172.21.15.12:0/2062347153 shutdown_connections 2023-07-07T18:14:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.626+0000 7f8225961700 1 --2- 172.21.15.12:0/2062347153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 0x7f82200b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.626+0000 7f8225961700 1 --2- 172.21.15.12:0/2062347153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200d0e30 0x7f82200d12b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.626+0000 7f8225961700 1 --2- 172.21.15.12:0/2062347153 >> v2:172.21.15.160:3300/0 conn(0x7f82200b51d0 0x7f82200cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.626+0000 7f8225961700 1 -- 172.21.15.12:0/2062347153 >> 172.21.15.12:0/2062347153 conn(0x7f8220071620 msgr2=0x7f82200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.626+0000 7f8225961700 1 -- 172.21.15.12:0/2062347153 shutdown_connections 2023-07-07T18:14:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.626+0000 7f8225961700 1 -- 172.21.15.12:0/2062347153 wait complete. 2023-07-07T18:14:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.627+0000 7f8225961700 1 Processor -- start 2023-07-07T18:14:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.627+0000 7f8225961700 1 -- start start 2023-07-07T18:14:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f8225961700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200b51d0 0x7f822015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f8225961700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 0x7f82200b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f8225961700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82200d0e30 0x7f82200b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f8225961700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200ac080 con 0x7f82200b51d0 2023-07-07T18:14:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f8225961700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200ace50 con 0x7f82200d0e30 2023-07-07T18:14:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f8225961700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822015b0f0 con 0x7f82200d0a60 2023-07-07T18:14:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200b51d0 0x7f822015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200b51d0 0x7f822015abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56640/0 (socket says 172.21.15.12:56640) 2023-07-07T18:14:42.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821effd700 1 -- 172.21.15.12:0/997551835 learned_addr learned my addr 172.21.15.12:0/997551835 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821effd700 1 -- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 msgr2=0x7f82200b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821e7fc700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 0x7f82200b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821effd700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 0x7f82200b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821f7fe700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82200d0e30 0x7f82200b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821effd700 1 -- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82200d0e30 msgr2=0x7f82200b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821effd700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82200d0e30 0x7f82200b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821effd700 1 -- 172.21.15.12:0/997551835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009b30 con 0x7f82200b51d0 2023-07-07T18:14:42.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.628+0000 7f821effd700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200b51d0 0x7f822015abb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f821400e810 tx=0x7f821400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.629+0000 7f8207fff700 1 -- 172.21.15.12:0/997551835 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214013610 con 0x7f82200b51d0 2023-07-07T18:14:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.629+0000 7f8207fff700 1 -- 172.21.15.12:0/997551835 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8214013770 con 0x7f82200b51d0 2023-07-07T18:14:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.629+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82200ac2d0 con 0x7f82200b51d0 2023-07-07T18:14:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.629+0000 7f8207fff700 1 -- 172.21.15.12:0/997551835 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214013b20 con 0x7f82200b51d0 2023-07-07T18:14:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.629+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82200ac890 con 0x7f82200b51d0 2023-07-07T18:14:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.630+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822004ea20 con 0x7f82200b51d0 2023-07-07T18:14:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.630+0000 7f8207fff700 1 -- 172.21.15.12:0/997551835 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8214013c80 con 0x7f82200b51d0 2023-07-07T18:14:42.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.630+0000 7f8207fff700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f820c06ace0 0x7f820c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.631+0000 7f8207fff700 1 -- 172.21.15.12:0/997551835 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8214088e60 con 0x7f82200b51d0 2023-07-07T18:14:42.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.631+0000 7f821e7fc700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f820c06ace0 0x7f820c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.631+0000 7f821e7fc700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f820c06ace0 0x7f820c06d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82201f55f0 tx=0x7f8210008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:42.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.635+0000 7f8207fff700 1 -- 172.21.15.12:0/997551835 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8214054270 con 0x7f82200b51d0 2023-07-07T18:14:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.833+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82200d1a30 con 0x7f82200b51d0 2023-07-07T18:14:42.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.833+0000 7f8207fff700 1 -- 172.21.15.12:0/997551835 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8214057890 con 0x7f82200b51d0 2023-07-07T18:14:42.834 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:14:42.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f820c06ace0 msgr2=0x7f820c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f820c06ace0 0x7f820c06d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f82201f55f0 tx=0x7f8210008040 comp rx=0 tx=0).stop 2023-07-07T18:14:42.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200b51d0 msgr2=0x7f822015abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200b51d0 0x7f822015abb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f821400e810 tx=0x7f821400ebd0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 shutdown_connections 2023-07-07T18:14:42.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f820c06ace0 0x7f820c06d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82200d0e30 0x7f82200b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82200b51d0 0x7f822015abb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 --2- 172.21.15.12:0/997551835 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82200d0a60 0x7f82200b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 >> 172.21.15.12:0/997551835 conn(0x7f8220071620 msgr2=0x7f82200c9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:42.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 shutdown_connections 2023-07-07T18:14:42.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.835+0000 7f8225961700 1 -- 172.21.15.12:0/997551835 wait complete. 2023-07-07T18:14:42.848 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:14:42.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.974+0000 7f141113b700 1 Processor -- start 2023-07-07T18:14:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.974+0000 7f141113b700 1 -- start start 2023-07-07T18:14:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.975+0000 7f141113b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06d7b0 0x7f140c160800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.975+0000 7f141113b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f140c160d40 0x7f140c0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.975+0000 7f141113b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c0cce30 con 0x7f140c069ef0 2023-07-07T18:14:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.975+0000 7f141113b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c0cd360 con 0x7f140c160d40 2023-07-07T18:14:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.975+0000 7f141113b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c160370 con 0x7f140c06d7b0 2023-07-07T18:14:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.975+0000 7f140b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f140c160d40 0x7f140c0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.975+0000 7f140b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f140c160d40 0x7f140c0ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56652/0 (socket says 172.21.15.12:56652) 2023-07-07T18:14:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.975+0000 7f140b59e700 1 -- 172.21.15.12:0/1481319717 learned_addr learned my addr 172.21.15.12:0/1481319717 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f140a59c700 1 --2- 172.21.15.12:0/1481319717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06d7b0 0x7f140c160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f140b59e700 1 -- 172.21.15.12:0/1481319717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06d7b0 msgr2=0x7f140c160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f140b59e700 1 --2- 172.21.15.12:0/1481319717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06d7b0 0x7f140c160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f140b59e700 1 -- 172.21.15.12:0/1481319717 >> v1:172.21.15.160:6789/0 conn(0x7f140c069ef0 legacy=0x7f140c06a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f140b59e700 1 -- 172.21.15.12:0/1481319717 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c15ca50 con 0x7f140c160d40 2023-07-07T18:14:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f140a59c700 1 --2- 172.21.15.12:0/1481319717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06d7b0 0x7f140c160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f140b59e700 1 --2- 172.21.15.12:0/1481319717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c160d40 0x7f140c0ce3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1404009e50 tx=0x7f140400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21100da1c59e3a65 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f1409d9b700 1 -- 172.21.15.12:0/1481319717 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400e070 con 0x7f140c160d40 2023-07-07T18:14:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f1409d9b700 1 -- 172.21.15.12:0/1481319717 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140400b9c0 con 0x7f140c160d40 2023-07-07T18:14:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f1409d9b700 1 -- 172.21.15.12:0/1481319717 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140400bd70 con 0x7f140c160d40 2023-07-07T18:14:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f141113b700 1 -- 172.21.15.12:0/1481319717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c160d40 msgr2=0x7f140c0ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.976+0000 7f141113b700 1 --2- 172.21.15.12:0/1481319717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c160d40 0x7f140c0ce3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1404009e50 tx=0x7f140400b330 comp rx=0 tx=0).stop 2023-07-07T18:14:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.977+0000 7f141113b700 1 -- 172.21.15.12:0/1481319717 shutdown_connections 2023-07-07T18:14:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.977+0000 7f141113b700 1 --2- 172.21.15.12:0/1481319717 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c160d40 0x7f140c0ce3d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.977+0000 7f141113b700 1 --2- 172.21.15.12:0/1481319717 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c06d7b0 0x7f140c160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.977+0000 7f141113b700 1 -- 172.21.15.12:0/1481319717 >> 172.21.15.12:0/1481319717 conn(0x7f140c06b920 msgr2=0x7f140c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.977+0000 7f141113b700 1 -- 172.21.15.12:0/1481319717 shutdown_connections 2023-07-07T18:14:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.977+0000 7f141113b700 1 -- 172.21.15.12:0/1481319717 wait complete. 2023-07-07T18:14:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.978+0000 7f141113b700 1 Processor -- start 2023-07-07T18:14:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.978+0000 7f141113b700 1 -- start start 2023-07-07T18:14:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f141113b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c069ef0 0x7f140c15f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f141113b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c06d7b0 0x7f140c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f141113b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c160d40 0x7f140c1f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f141113b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15e170 con 0x7f140c06d7b0 2023-07-07T18:14:42.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f141113b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15e450 con 0x7f140c160d40 2023-07-07T18:14:42.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f141113b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c15e730 con 0x7f140c069ef0 2023-07-07T18:14:42.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c06d7b0 0x7f140c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c06d7b0 0x7f140c0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56656/0 (socket says 172.21.15.12:56656) 2023-07-07T18:14:42.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140a59c700 1 -- 172.21.15.12:0/1034200674 learned_addr learned my addr 172.21.15.12:0/1034200674 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:42.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140b59e700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c160d40 0x7f140c1f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140ad9d700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c069ef0 0x7f140c15f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140a59c700 1 -- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c069ef0 msgr2=0x7f140c15f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140a59c700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c069ef0 0x7f140c15f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140a59c700 1 -- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c160d40 msgr2=0x7f140c1f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:42.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140a59c700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c160d40 0x7f140c1f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:42.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.979+0000 7f140a59c700 1 -- 172.21.15.12:0/1034200674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009b30 con 0x7f140c06d7b0 2023-07-07T18:14:42.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.980+0000 7f140a59c700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c06d7b0 0x7f140c0c57c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c7f0 tx=0x7f13fc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:42.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.980+0000 7f14037fe700 1 -- 172.21.15.12:0/1034200674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011800 con 0x7f140c06d7b0 2023-07-07T18:14:42.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.980+0000 7f14037fe700 1 -- 172.21.15.12:0/1034200674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc011960 con 0x7f140c06d7b0 2023-07-07T18:14:42.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.980+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c15ea10 con 0x7f140c06d7b0 2023-07-07T18:14:42.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.980+0000 7f14037fe700 1 -- 172.21.15.12:0/1034200674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011cf0 con 0x7f140c06d7b0 2023-07-07T18:14:42.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.980+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c15f710 con 0x7f140c06d7b0 2023-07-07T18:14:42.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.981+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c15f900 con 0x7f140c06d7b0 2023-07-07T18:14:42.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.981+0000 7f14037fe700 1 -- 172.21.15.12:0/1034200674 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f13fc018360 con 0x7f140c06d7b0 2023-07-07T18:14:42.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.981+0000 7f14037fe700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f13ec06ace0 0x7f13ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:42.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.982+0000 7f14037fe700 1 -- 172.21.15.12:0/1034200674 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f13fc088f90 con 0x7f140c06d7b0 2023-07-07T18:14:42.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.982+0000 7f140ad9d700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f13ec06ace0 0x7f13ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:42.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.982+0000 7f140ad9d700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f13ec06ace0 0x7f13ec06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f140c0d0380 tx=0x7f13f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:42.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:42.986+0000 7f14037fe700 1 -- 172.21.15.12:0/1034200674 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f13fc0bb310 con 0x7f140c06d7b0 2023-07-07T18:14:43.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.182+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f140c0741b0 con 0x7f140c06d7b0 2023-07-07T18:14:43.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.183+0000 7f14037fe700 1 -- 172.21.15.12:0/1034200674 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f13fc057e30 con 0x7f140c06d7b0 2023-07-07T18:14:43.184 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:14:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f13ec06ace0 msgr2=0x7f13ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f13ec06ace0 0x7f13ec06d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f140c0d0380 tx=0x7f13f4009040 comp rx=0 tx=0).stop 2023-07-07T18:14:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c06d7b0 msgr2=0x7f140c0c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c06d7b0 0x7f140c0c57c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00c7f0 tx=0x7f13fc00cb00 comp rx=0 tx=0).stop 2023-07-07T18:14:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 shutdown_connections 2023-07-07T18:14:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f13ec06ace0 0x7f13ec06d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f140c160d40 0x7f140c1f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f140c069ef0 0x7f140c15f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 --2- 172.21.15.12:0/1034200674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f140c06d7b0 0x7f140c0c57c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 >> 172.21.15.12:0/1034200674 conn(0x7f140c06b920 msgr2=0x7f140c15bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 shutdown_connections 2023-07-07T18:14:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.185+0000 7f141113b700 1 -- 172.21.15.12:0/1034200674 wait complete. 2023-07-07T18:14:43.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-07T18:14:43.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.321+0000 7fceb4592700 1 Processor -- start 2023-07-07T18:14:43.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.321+0000 7fceb4592700 1 -- start start 2023-07-07T18:14:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb4592700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fceac15a640 0x7fceac06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb4592700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac0cec80 0x7fceac0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb4592700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac0ae580 con 0x7fceac0d05d0 2023-07-07T18:14:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb4592700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac06f610 con 0x7fceac15a640 2023-07-07T18:14:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb4592700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0adf70 con 0x7fceac0cec80 2023-07-07T18:14:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb232e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fceac15a640 0x7fceac06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb232e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fceac15a640 0x7fceac06fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56662/0 (socket says 172.21.15.12:56662) 2023-07-07T18:14:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb232e700 1 -- 172.21.15.12:0/2812205705 learned_addr learned my addr 172.21.15.12:0/2812205705 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb2b2f700 1 --2- 172.21.15.12:0/2812205705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac0cec80 0x7fceac0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb232e700 1 -- 172.21.15.12:0/2812205705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac0cec80 msgr2=0x7fceac0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb232e700 1 --2- 172.21.15.12:0/2812205705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac0cec80 0x7fceac0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb232e700 1 -- 172.21.15.12:0/2812205705 >> v1:172.21.15.160:6789/0 conn(0x7fceac0d05d0 legacy=0x7fceac0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb232e700 1 -- 172.21.15.12:0/2812205705 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac06f860 con 0x7fceac15a640 2023-07-07T18:14:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb2b2f700 1 --2- 172.21.15.12:0/2812205705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac0cec80 0x7fceac0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb232e700 1 --2- 172.21.15.12:0/2812205705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac15a640 0x7fceac06fe80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcea80098f0 tx=0x7fcea8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a062ad6a5b461058 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:43.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.322+0000 7fceb132c700 1 -- 172.21.15.12:0/2812205705 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea800b8a0 con 0x7fceac15a640 2023-07-07T18:14:43.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb132c700 1 -- 172.21.15.12:0/2812205705 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea800ba00 con 0x7fceac15a640 2023-07-07T18:14:43.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb132c700 1 -- 172.21.15.12:0/2812205705 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea800bd90 con 0x7fceac15a640 2023-07-07T18:14:43.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb4592700 1 -- 172.21.15.12:0/2812205705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac15a640 msgr2=0x7fceac06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb4592700 1 --2- 172.21.15.12:0/2812205705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac15a640 0x7fceac06fe80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcea80098f0 tx=0x7fcea8009c00 comp rx=0 tx=0).stop 2023-07-07T18:14:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb4592700 1 -- 172.21.15.12:0/2812205705 shutdown_connections 2023-07-07T18:14:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb4592700 1 --2- 172.21.15.12:0/2812205705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac0cec80 0x7fceac0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb4592700 1 --2- 172.21.15.12:0/2812205705 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac15a640 0x7fceac06fe80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb4592700 1 -- 172.21.15.12:0/2812205705 >> 172.21.15.12:0/2812205705 conn(0x7fceac089fe0 msgr2=0x7fceac0d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:43.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb4592700 1 -- 172.21.15.12:0/2812205705 shutdown_connections 2023-07-07T18:14:43.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.323+0000 7fceb4592700 1 -- 172.21.15.12:0/2812205705 wait complete. 2023-07-07T18:14:43.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.324+0000 7fceb4592700 1 Processor -- start 2023-07-07T18:14:43.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.324+0000 7fceb4592700 1 -- start start 2023-07-07T18:14:43.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb4592700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac0cec80 0x7fceac1f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb4592700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fceac0d05d0 0x7fceac14bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb4592700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac15a640 0x7fceac0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb4592700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0b4880 con 0x7fceac0cec80 2023-07-07T18:14:43.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb4592700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0b4b60 con 0x7fceac0d05d0 2023-07-07T18:14:43.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb4592700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0b4e40 con 0x7fceac15a640 2023-07-07T18:14:43.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb232e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac0cec80 0x7fceac1f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb232e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac0cec80 0x7fceac1f03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56668/0 (socket says 172.21.15.12:56668) 2023-07-07T18:14:43.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb232e700 1 -- 172.21.15.12:0/3207432233 learned_addr learned my addr 172.21.15.12:0/3207432233 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:43.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb2b2f700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac15a640 0x7fceac0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb1b2d700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fceac0d05d0 0x7fceac14bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb232e700 1 -- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac15a640 msgr2=0x7fceac0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb232e700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac15a640 0x7fceac0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb232e700 1 -- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fceac0d05d0 msgr2=0x7fceac14bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb232e700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fceac0d05d0 0x7fceac14bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb232e700 1 -- 172.21.15.12:0/3207432233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea8009550 con 0x7fceac0cec80 2023-07-07T18:14:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.325+0000 7fceb1b2d700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fceac0d05d0 0x7fceac14bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.326+0000 7fceb232e700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac0cec80 0x7fceac1f03e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000c00 tx=0x7fcea8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:43.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.326+0000 7fcea2ffd700 1 -- 172.21.15.12:0/3207432233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea8004480 con 0x7fceac0cec80 2023-07-07T18:14:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.326+0000 7fcea2ffd700 1 -- 172.21.15.12:0/3207432233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea801f070 con 0x7fceac0cec80 2023-07-07T18:14:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.326+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac0b5120 con 0x7fceac0cec80 2023-07-07T18:14:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.326+0000 7fcea2ffd700 1 -- 172.21.15.12:0/3207432233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea80038c0 con 0x7fceac0cec80 2023-07-07T18:14:43.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.326+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac14c330 con 0x7fceac0cec80 2023-07-07T18:14:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.327+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac14c4c0 con 0x7fceac0cec80 2023-07-07T18:14:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.327+0000 7fcea2ffd700 1 -- 172.21.15.12:0/3207432233 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcea8021030 con 0x7fceac0cec80 2023-07-07T18:14:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.328+0000 7fcea2ffd700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce9006ace0 0x7fce9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.328+0000 7fcea2ffd700 1 -- 172.21.15.12:0/3207432233 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcea808a650 con 0x7fceac0cec80 2023-07-07T18:14:43.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.328+0000 7fceb1b2d700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce9006ace0 0x7fce9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.328+0000 7fceb1b2d700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce9006ace0 0x7fce9006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b05e0 tx=0x7fce9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:43.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.332+0000 7fcea2ffd700 1 -- 172.21.15.12:0/3207432233 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcea8055c00 con 0x7fceac0cec80 2023-07-07T18:14:43.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.533+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fceac0b55e0 con 0x7fceac0cec80 2023-07-07T18:14:43.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.533+0000 7fcea2ffd700 1 -- 172.21.15.12:0/3207432233 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+126 (secure 0 0 0) 0x7fcea8059220 con 0x7fceac0cec80 2023-07-07T18:14:43.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:43.535 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-07-07T18:14:43.535 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:14:43.535 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-07-07T18:14:43.536 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-07-07T18:14:43.536 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:14:43.536 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:14:43.536 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2023-07-07T18:14:43.536 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2023-07-07T18:14:43.536 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:14:43.536 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-07-07T18:14:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce9006ace0 msgr2=0x7fce9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce9006ace0 0x7fce9006d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fceac0b05e0 tx=0x7fce9c009040 comp rx=0 tx=0).stop 2023-07-07T18:14:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac0cec80 msgr2=0x7fceac1f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac0cec80 0x7fceac1f03e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcea8000c00 tx=0x7fcea8004750 comp rx=0 tx=0).stop 2023-07-07T18:14:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 shutdown_connections 2023-07-07T18:14:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce9006ace0 0x7fce9006d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fceac15a640 0x7fceac0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fceac0cec80 0x7fceac1f03e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 --2- 172.21.15.12:0/3207432233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fceac0d05d0 0x7fceac14bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 >> 172.21.15.12:0/3207432233 conn(0x7fceac089fe0 msgr2=0x7fceac0c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:43.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 shutdown_connections 2023-07-07T18:14:43.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.535+0000 7fceb4592700 1 -- 172.21.15.12:0/3207432233 wait complete. 2023-07-07T18:14:43.548 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-07T18:14:43.548 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-07T18:14:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.676+0000 7f0dcd679700 1 Processor -- start 2023-07-07T18:14:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.676+0000 7f0dcd679700 1 -- start start 2023-07-07T18:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dcd679700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0dc80cd5e0 0x7f0dc80cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dcd679700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc806f0e0 con 0x7f0dc80adf40 2023-07-07T18:14:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dcd679700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc815dd90 con 0x7f0dc806e030 2023-07-07T18:14:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dcd679700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc80ce2c0 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc77fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0dc80adf40 0x7f0dc815d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53878/0 (socket says 172.21.15.12:53878) 2023-07-07T18:14:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc77fe700 1 -- 172.21.15.12:0/1629808059 learned_addr learned my addr 172.21.15.12:0/1629808059 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc6ffd700 1 --2- 172.21.15.12:0/1629808059 >> v2:172.21.15.160:3300/0 conn(0x7f0dc80cd5e0 0x7f0dc80cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc5ffb700 1 -- 172.21.15.12:0/1629808059 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661561027 0 0) 0x7f0dc806f0e0 con 0x7f0dc80adf40 2023-07-07T18:14:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc5ffb700 1 -- 172.21.15.12:0/1629808059 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db40035b0 con 0x7f0dc80adf40 2023-07-07T18:14:43.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc6ffd700 1 -- 172.21.15.12:0/1629808059 >> v1:172.21.15.160:6789/0 conn(0x7f0dc806e030 legacy=0x7f0dc815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc6ffd700 1 -- 172.21.15.12:0/1629808059 >> v1:172.21.15.12:6789/0 conn(0x7f0dc80adf40 legacy=0x7f0dc815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc5ffb700 1 -- 172.21.15.12:0/1629808059 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601894576 0 0) 0x7f0db40035b0 con 0x7f0dc80adf40 2023-07-07T18:14:43.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc6ffd700 1 -- 172.21.15.12:0/1629808059 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc80cdef0 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.678+0000 7f0dc6ffd700 1 --2- 172.21.15.12:0/1629808059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dc80cd5e0 0x7f0dc80cd9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009820 tx=0x7f0db0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beda940e04f508a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:43.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dc5ffb700 1 -- 172.21.15.12:0/1629808059 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00019f0 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dc5ffb700 1 -- 172.21.15.12:0/1629808059 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0005c30 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dc5ffb700 1 -- 172.21.15.12:0/1629808059 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0004030 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dcd679700 1 -- 172.21.15.12:0/1629808059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dc80cd5e0 msgr2=0x7f0dc80cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dcd679700 1 --2- 172.21.15.12:0/1629808059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dc80cd5e0 0x7f0dc80cd9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009820 tx=0x7f0db0009b30 comp rx=0 tx=0).stop 2023-07-07T18:14:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dcd679700 1 -- 172.21.15.12:0/1629808059 shutdown_connections 2023-07-07T18:14:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dcd679700 1 --2- 172.21.15.12:0/1629808059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dc80cd5e0 0x7f0dc80cd9b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dcd679700 1 -- 172.21.15.12:0/1629808059 >> 172.21.15.12:0/1629808059 conn(0x7f0dc806b920 msgr2=0x7f0dc80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dcd679700 1 -- 172.21.15.12:0/1629808059 shutdown_connections 2023-07-07T18:14:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.679+0000 7f0dcd679700 1 -- 172.21.15.12:0/1629808059 wait complete. 2023-07-07T18:14:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dcd679700 1 Processor -- start 2023-07-07T18:14:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dcd679700 1 -- start start 2023-07-07T18:14:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dcd679700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dc806e030 0x7f0dc80c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dcd679700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dc80adf40 0x7f0dc80af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dcd679700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dc80cd5e0 0x7f0dc80afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dcd679700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc81582f0 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dcd679700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc81576e0 con 0x7f0dc806e030 2023-07-07T18:14:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dcd679700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc81579c0 con 0x7f0dc80adf40 2023-07-07T18:14:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dc80cd5e0 0x7f0dc80afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dc80cd5e0 0x7f0dc80afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56686/0 (socket says 172.21.15.12:56686) 2023-07-07T18:14:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.681+0000 7f0dc77fe700 1 -- 172.21.15.12:0/3817898064 learned_addr learned my addr 172.21.15.12:0/3817898064 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dc6ffd700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dc806e030 0x7f0dc80c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dc67fc700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dc80adf40 0x7f0dc80af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dc77fe700 1 -- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dc80adf40 msgr2=0x7f0dc80af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dc77fe700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dc80adf40 0x7f0dc80af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dc77fe700 1 -- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dc806e030 msgr2=0x7f0dc80c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dc77fe700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dc806e030 0x7f0dc80c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dc77fe700 1 -- 172.21.15.12:0/3817898064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0009430 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dc77fe700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dc80cd5e0 0x7f0dc80afc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0001ba0 tx=0x7f0dc000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dbf7fe700 1 -- 172.21.15.12:0/3817898064 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000ac20 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dbf7fe700 1 -- 172.21.15.12:0/3817898064 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000ad80 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc8157ca0 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dbf7fe700 1 -- 172.21.15.12:0/3817898064 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0007310 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.682+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc80c2db0 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.683+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc804ea20 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.683+0000 7f0dbf7fe700 1 -- 172.21.15.12:0/3817898064 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dc0007470 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.684+0000 7f0dbf7fe700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0da806ace0 0x7f0da806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.684+0000 7f0dbf7fe700 1 -- 172.21.15.12:0/3817898064 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0dc0089150 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.684+0000 7f0dc6ffd700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0da806ace0 0x7f0da806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.685+0000 7f0dc6ffd700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0da806ace0 0x7f0da806d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009b70 tx=0x7f0db0008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.688+0000 7f0dbf7fe700 1 -- 172.21.15.12:0/3817898064 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0dc0054550 con 0x7f0dc80cd5e0 2023-07-07T18:14:43.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:43.884+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0dc8158430 con 0x7f0dc80cd5e0 2023-07-07T18:14:44.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:14:44.278 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:14:44.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.800+0000 7f0dbf7fe700 1 -- 172.21.15.12:0/3817898064 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0dc0057b70 con 0x7f0dc80cd5e0 2023-07-07T18:14:44.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0da806ace0 msgr2=0x7f0da806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0da806ace0 0x7f0da806d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009b70 tx=0x7f0db0008070 comp rx=0 tx=0).stop 2023-07-07T18:14:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dc80cd5e0 msgr2=0x7f0dc80afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dc80cd5e0 0x7f0dc80afc90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0001ba0 tx=0x7f0dc000a060 comp rx=0 tx=0).stop 2023-07-07T18:14:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 shutdown_connections 2023-07-07T18:14:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0da806ace0 0x7f0da806d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dc80cd5e0 0x7f0dc80afc90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:44.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dc806e030 0x7f0dc80c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:44.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 --2- 172.21.15.12:0/3817898064 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dc80adf40 0x7f0dc80af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:44.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.804+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 >> 172.21.15.12:0/3817898064 conn(0x7f0dc806b920 msgr2=0x7f0dc80b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:44.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.805+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 shutdown_connections 2023-07-07T18:14:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.805+0000 7f0dcd679700 1 -- 172.21.15.12:0/3817898064 wait complete. 2023-07-07T18:14:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-07-07T18:14:44.823 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-07T18:14:44.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.961+0000 7f234b2ca700 1 Processor -- start 2023-07-07T18:14:44.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.961+0000 7f234b2ca700 1 -- start start 2023-07-07T18:14:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f234b2ca700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23440cd5e0 0x7f23440cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f234b2ca700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234406f0e0 con 0x7f23440adf40 2023-07-07T18:14:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f234b2ca700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234415dd90 con 0x7f234406e030 2023-07-07T18:14:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f234b2ca700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440ce2c0 con 0x7f23440cd5e0 2023-07-07T18:14:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f2349066700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23440cd5e0 0x7f23440cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f2349066700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23440cd5e0 0x7f23440cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56690/0 (socket says 172.21.15.12:56690) 2023-07-07T18:14:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f2349066700 1 -- 172.21.15.12:0/3973986823 learned_addr learned my addr 172.21.15.12:0/3973986823 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f2349066700 1 -- 172.21.15.12:0/3973986823 >> v1:172.21.15.160:6789/0 conn(0x7f234406e030 legacy=0x7f234415cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f2349066700 1 -- 172.21.15.12:0/3973986823 >> v1:172.21.15.12:6789/0 conn(0x7f23440adf40 legacy=0x7f234415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f2349066700 1 -- 172.21.15.12:0/3973986823 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23440cdef0 con 0x7f23440cd5e0 2023-07-07T18:14:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f2349066700 1 --2- 172.21.15.12:0/3973986823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440cd5e0 0x7f23440cd9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2334006fd0 tx=0x7f2334009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d017e636e1ba16d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.962+0000 7f233bfff700 1 -- 172.21.15.12:0/3973986823 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334005e30 con 0x7f23440cd5e0 2023-07-07T18:14:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.963+0000 7f233bfff700 1 -- 172.21.15.12:0/3973986823 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2334006030 con 0x7f23440cd5e0 2023-07-07T18:14:44.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.963+0000 7f233bfff700 1 -- 172.21.15.12:0/3973986823 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340063c0 con 0x7f23440cd5e0 2023-07-07T18:14:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.963+0000 7f234b2ca700 1 -- 172.21.15.12:0/3973986823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440cd5e0 msgr2=0x7f23440cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.963+0000 7f234b2ca700 1 --2- 172.21.15.12:0/3973986823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440cd5e0 0x7f23440cd9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2334006fd0 tx=0x7f2334009bd0 comp rx=0 tx=0).stop 2023-07-07T18:14:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.963+0000 7f234b2ca700 1 -- 172.21.15.12:0/3973986823 shutdown_connections 2023-07-07T18:14:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.963+0000 7f234b2ca700 1 --2- 172.21.15.12:0/3973986823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440cd5e0 0x7f23440cd9b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:44.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.963+0000 7f234b2ca700 1 -- 172.21.15.12:0/3973986823 >> 172.21.15.12:0/3973986823 conn(0x7f234406b920 msgr2=0x7f23440cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:44.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.963+0000 7f234b2ca700 1 -- 172.21.15.12:0/3973986823 shutdown_connections 2023-07-07T18:14:44.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.963+0000 7f234b2ca700 1 -- 172.21.15.12:0/3973986823 wait complete. 2023-07-07T18:14:44.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.965+0000 7f234b2ca700 1 Processor -- start 2023-07-07T18:14:44.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.965+0000 7f234b2ca700 1 -- start start 2023-07-07T18:14:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f234b2ca700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234406e030 0x7f2344152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f234b2ca700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440adf40 0x7f23440cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f234b2ca700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23440cd5e0 0x7f2344156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f234b2ca700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23441565a0 con 0x7f23440adf40 2023-07-07T18:14:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f234b2ca700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344152d80 con 0x7f234406e030 2023-07-07T18:14:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f234b2ca700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2344155990 con 0x7f23440cd5e0 2023-07-07T18:14:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2348865700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440adf40 0x7f23440cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2348865700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440adf40 0x7f23440cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56698/0 (socket says 172.21.15.12:56698) 2023-07-07T18:14:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2348865700 1 -- 172.21.15.12:0/1079098145 learned_addr learned my addr 172.21.15.12:0/1079098145 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2349066700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234406e030 0x7f2344152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2349867700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23440cd5e0 0x7f2344156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2348865700 1 -- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23440cd5e0 msgr2=0x7f2344156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2348865700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23440cd5e0 0x7f2344156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2348865700 1 -- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234406e030 msgr2=0x7f2344152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2348865700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234406e030 0x7f2344152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2348865700 1 -- 172.21.15.12:0/1079098145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009500 con 0x7f23440adf40 2023-07-07T18:14:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2349867700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23440cd5e0 0x7f2344156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2348865700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440adf40 0x7f23440cb900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f234000b4d0 tx=0x7f234000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.966+0000 7f2339ffb700 1 -- 172.21.15.12:0/1079098145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340011830 con 0x7f23440adf40 2023-07-07T18:14:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.967+0000 7f2339ffb700 1 -- 172.21.15.12:0/1079098145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340011990 con 0x7f23440adf40 2023-07-07T18:14:44.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.967+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2344155c70 con 0x7f23440adf40 2023-07-07T18:14:44.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.967+0000 7f2339ffb700 1 -- 172.21.15.12:0/1079098145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340011d40 con 0x7f23440adf40 2023-07-07T18:14:44.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.967+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2344156230 con 0x7f23440adf40 2023-07-07T18:14:44.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.968+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234404ea20 con 0x7f23440adf40 2023-07-07T18:14:44.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.968+0000 7f2339ffb700 1 -- 172.21.15.12:0/1079098145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f234001a400 con 0x7f23440adf40 2023-07-07T18:14:44.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.969+0000 7f2339ffb700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f232806ace0 0x7f232806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:44.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.969+0000 7f2339ffb700 1 -- 172.21.15.12:0/1079098145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2340088f40 con 0x7f23440adf40 2023-07-07T18:14:44.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.969+0000 7f2349066700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f232806ace0 0x7f232806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:44.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.969+0000 7f2349066700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f232806ace0 0x7f232806d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2334013040 tx=0x7f2334008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:44.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:44.973+0000 7f2339ffb700 1 -- 172.21.15.12:0/1079098145 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2340054310 con 0x7f23440adf40 2023-07-07T18:14:45.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.170+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f23441566e0 con 0x7f23440adf40 2023-07-07T18:14:45.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.802+0000 7f2339ffb700 1 -- 172.21.15.12:0/1079098145 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v23) v1 ==== 171+0+0 (secure 0 0 0) 0x7f23400150d0 con 0x7f23440adf40 2023-07-07T18:14:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.808+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f232806ace0 msgr2=0x7f232806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.808+0000 7f234b2ca700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f232806ace0 0x7f232806d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2334013040 tx=0x7f2334008070 comp rx=0 tx=0).stop 2023-07-07T18:14:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.808+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440adf40 msgr2=0x7f23440cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.808+0000 7f234b2ca700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440adf40 0x7f23440cb900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f234000b4d0 tx=0x7f234000b890 comp rx=0 tx=0).stop 2023-07-07T18:14:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.810+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 shutdown_connections 2023-07-07T18:14:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.810+0000 7f234b2ca700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f232806ace0 0x7f232806d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.810+0000 7f234b2ca700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23440cd5e0 0x7f2344156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.810+0000 7f234b2ca700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234406e030 0x7f2344152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.810+0000 7f234b2ca700 1 --2- 172.21.15.12:0/1079098145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23440adf40 0x7f23440cb900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.810+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 >> 172.21.15.12:0/1079098145 conn(0x7f234406b920 msgr2=0x7f23440af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.811+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 shutdown_connections 2023-07-07T18:14:45.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.811+0000 7f234b2ca700 1 -- 172.21.15.12:0/1079098145 wait complete. 2023-07-07T18:14:45.821 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-07-07T18:14:45.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-07T18:14:45.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.970+0000 7feae287a700 1 Processor -- start 2023-07-07T18:14:45.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.970+0000 7feae287a700 1 -- start start 2023-07-07T18:14:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.970+0000 7feae287a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feadc070dc0 0x7feadc071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.970+0000 7feae287a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 0x7feadc0cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:45.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.970+0000 7feae287a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7feadc069ef0 0x7feadc06a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:45.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.970+0000 7feae287a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc15dca0 con 0x7feadc070dc0 2023-07-07T18:14:45.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.970+0000 7feae287a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc0cac60 con 0x7feadc069ef0 2023-07-07T18:14:45.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.970+0000 7feae287a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc0ca370 con 0x7feadc0cb0f0 2023-07-07T18:14:45.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feadc070dc0 0x7feadc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feadc070dc0 0x7feadc071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56704/0 (socket says 172.21.15.12:56704) 2023-07-07T18:14:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadbfff700 1 -- 172.21.15.12:0/509521964 learned_addr learned my addr 172.21.15.12:0/509521964 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:45.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadb7fe700 1 --2- 172.21.15.12:0/509521964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 0x7feadc0cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feae0e17700 1 --2- 172.21.15.12:0/509521964 >> v2:172.21.15.160:3300/0 conn(0x7feadc069ef0 0x7feadc06a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadbfff700 1 -- 172.21.15.12:0/509521964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 msgr2=0x7feadc0cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:45.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadbfff700 1 --2- 172.21.15.12:0/509521964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 0x7feadc0cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadbfff700 1 -- 172.21.15.12:0/509521964 >> v2:172.21.15.160:3300/0 conn(0x7feadc069ef0 msgr2=0x7feadc06a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadbfff700 1 --2- 172.21.15.12:0/509521964 >> v2:172.21.15.160:3300/0 conn(0x7feadc069ef0 0x7feadc06a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadbfff700 1 -- 172.21.15.12:0/509521964 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0716d0 con 0x7feadc070dc0 2023-07-07T18:14:45.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feae0e17700 1 --2- 172.21.15.12:0/509521964 >> v2:172.21.15.160:3300/0 conn(0x7feadc069ef0 0x7feadc06a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadbfff700 1 --2- 172.21.15.12:0/509521964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 0x7feadc071190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feadc06ba70 tx=0x7feacc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd189c4741189253 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadaffd700 1 -- 172.21.15.12:0/509521964 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00f8a0 con 0x7feadc070dc0 2023-07-07T18:14:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadaffd700 1 -- 172.21.15.12:0/509521964 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc00fa00 con 0x7feadc070dc0 2023-07-07T18:14:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.971+0000 7feadaffd700 1 -- 172.21.15.12:0/509521964 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00fd90 con 0x7feadc070dc0 2023-07-07T18:14:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.972+0000 7feae287a700 1 -- 172.21.15.12:0/509521964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 msgr2=0x7feadc071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:45.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.972+0000 7feae287a700 1 --2- 172.21.15.12:0/509521964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 0x7feadc071190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feadc06ba70 tx=0x7feacc009bd0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.972+0000 7feae287a700 1 -- 172.21.15.12:0/509521964 shutdown_connections 2023-07-07T18:14:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.972+0000 7feae287a700 1 --2- 172.21.15.12:0/509521964 >> v2:172.21.15.160:3300/0 conn(0x7feadc069ef0 0x7feadc06a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.972+0000 7feae287a700 1 --2- 172.21.15.12:0/509521964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 0x7feadc071190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.972+0000 7feae287a700 1 --2- 172.21.15.12:0/509521964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 0x7feadc0cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.972+0000 7feae287a700 1 -- 172.21.15.12:0/509521964 >> 172.21.15.12:0/509521964 conn(0x7feadc0b1990 msgr2=0x7feadc0cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.972+0000 7feae287a700 1 -- 172.21.15.12:0/509521964 shutdown_connections 2023-07-07T18:14:45.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.972+0000 7feae287a700 1 -- 172.21.15.12:0/509521964 wait complete. 2023-07-07T18:14:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.973+0000 7feae287a700 1 Processor -- start 2023-07-07T18:14:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.973+0000 7feae287a700 1 -- start start 2023-07-07T18:14:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feae287a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feadc069ef0 0x7feadc0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feae287a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 0x7feadc149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:45.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feae287a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 0x7feadc0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feae287a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc156730 con 0x7feadc070dc0 2023-07-07T18:14:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feae287a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc157fb0 con 0x7feadc069ef0 2023-07-07T18:14:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feae287a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc1534b0 con 0x7feadc0cb0f0 2023-07-07T18:14:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 0x7feadc149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 0x7feadc149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56712/0 (socket says 172.21.15.12:56712) 2023-07-07T18:14:45.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadb7fe700 1 -- 172.21.15.12:0/4189304527 learned_addr learned my addr 172.21.15.12:0/4189304527 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feae0e17700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 0x7feadc0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadbfff700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feadc069ef0 0x7feadc0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadb7fe700 1 -- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 msgr2=0x7feadc0b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadb7fe700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 0x7feadc0b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadb7fe700 1 -- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feadc069ef0 msgr2=0x7feadc0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:45.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadb7fe700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feadc069ef0 0x7feadc0c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:45.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadb7fe700 1 -- 172.21.15.12:0/4189304527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc009550 con 0x7feadc070dc0 2023-07-07T18:14:45.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feae0e17700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 0x7feadc0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:45.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.974+0000 7feadbfff700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feadc069ef0 0x7feadc0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.975+0000 7feadb7fe700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 0x7feadc149700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fead000e9b0 tx=0x7fead000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.975+0000 7fead8ff9700 1 -- 172.21.15.12:0/4189304527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0009710 con 0x7feadc070dc0 2023-07-07T18:14:45.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.975+0000 7fead8ff9700 1 -- 172.21.15.12:0/4189304527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead000c850 con 0x7feadc070dc0 2023-07-07T18:14:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.975+0000 7fead8ff9700 1 -- 172.21.15.12:0/4189304527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead000cbc0 con 0x7feadc070dc0 2023-07-07T18:14:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.975+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc0b3ca0 con 0x7feadc070dc0 2023-07-07T18:14:45.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.975+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc1539e0 con 0x7feadc070dc0 2023-07-07T18:14:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.976+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc04ea20 con 0x7feadc070dc0 2023-07-07T18:14:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.976+0000 7fead8ff9700 1 -- 172.21.15.12:0/4189304527 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fead000cd20 con 0x7feadc070dc0 2023-07-07T18:14:45.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.977+0000 7fead8ff9700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7feac806ace0 0x7feac806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.977+0000 7fead8ff9700 1 -- 172.21.15.12:0/4189304527 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fead0089bd0 con 0x7feadc070dc0 2023-07-07T18:14:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.977+0000 7feadbfff700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7feac806ace0 0x7feac806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:45.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.978+0000 7feadbfff700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7feac806ace0 0x7feac806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feacc009840 tx=0x7feacc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:45.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:45.981+0000 7fead8ff9700 1 -- 172.21.15.12:0/4189304527 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fead0058850 con 0x7feadc070dc0 2023-07-07T18:14:46.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.225+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feadc153bd0 con 0x7feadc070dc0 2023-07-07T18:14:46.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.230+0000 7fead8ff9700 1 -- 172.21.15.12:0/4189304527 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fead00583e0 con 0x7feadc070dc0 2023-07-07T18:14:46.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7feac806ace0 msgr2=0x7feac806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:46.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7feac806ace0 0x7feac806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feacc009840 tx=0x7feacc008030 comp rx=0 tx=0).stop 2023-07-07T18:14:46.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 msgr2=0x7feadc149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:46.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 0x7feadc149700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fead000e9b0 tx=0x7fead000ed70 comp rx=0 tx=0).stop 2023-07-07T18:14:46.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 shutdown_connections 2023-07-07T18:14:46.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7feac806ace0 0x7feac806d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:46.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feadc0cb0f0 0x7feadc0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:46.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feadc069ef0 0x7feadc0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:46.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 --2- 172.21.15.12:0/4189304527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feadc070dc0 0x7feadc149700 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fead000e9b0 tx=0x7fead000ed70 comp rx=0 tx=0).stop 2023-07-07T18:14:46.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 >> 172.21.15.12:0/4189304527 conn(0x7feadc0b1990 msgr2=0x7feadc06ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:46.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.234+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 shutdown_connections 2023-07-07T18:14:46.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.235+0000 7feae287a700 1 -- 172.21.15.12:0/4189304527 wait complete. 2023-07-07T18:14:46.239 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 3 and data pool 4 2023-07-07T18:14:46.260 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-07T18:14:46.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-07T18:14:46.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.389+0000 7fc3e9bd3700 1 Processor -- start 2023-07-07T18:14:46.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.389+0000 7fc3e9bd3700 1 -- start start 2023-07-07T18:14:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e9bd3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e415a430 0x7fc3e406e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e9bd3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3e40ae8b0 0x7fc3e40ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:46.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e9bd3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e40aee00 con 0x7fc3e40acb40 2023-07-07T18:14:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e9bd3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40af330 con 0x7fc3e40ae8b0 2023-07-07T18:14:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e9bd3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e406e340 con 0x7fc3e415a430 2023-07-07T18:14:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3e40ae8b0 0x7fc3e40ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3e40ae8b0 0x7fc3e40ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56718/0 (socket says 172.21.15.12:56718) 2023-07-07T18:14:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e2ffd700 1 -- 172.21.15.12:0/920322576 learned_addr learned my addr 172.21.15.12:0/920322576 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e3fff700 1 --1- 172.21.15.12:0/920322576 >> v1:172.21.15.12:6789/0 conn(0x7fc3e40acb40 0x7fc3e4069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53920/0 (socket says 172.21.15.12:53920) 2023-07-07T18:14:46.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e37fe700 1 --2- 172.21.15.12:0/920322576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e415a430 0x7fc3e406e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e2ffd700 1 -- 172.21.15.12:0/920322576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e415a430 msgr2=0x7fc3e406e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e2ffd700 1 --2- 172.21.15.12:0/920322576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e415a430 0x7fc3e406e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e2ffd700 1 -- 172.21.15.12:0/920322576 >> v1:172.21.15.12:6789/0 conn(0x7fc3e40acb40 legacy=0x7fc3e4069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e2ffd700 1 -- 172.21.15.12:0/920322576 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e40af050 con 0x7fc3e40ae8b0 2023-07-07T18:14:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e27fc700 1 -- 172.21.15.12:0/920322576 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841618785 0 0) 0x7fc3e40aee00 con 0x7fc3e40acb40 2023-07-07T18:14:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.390+0000 7fc3e2ffd700 1 --2- 172.21.15.12:0/920322576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e40ae8b0 0x7fc3e40ac600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0098f0 tx=0x7fc3cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9c170a30ec067 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:46.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e27fc700 1 -- 172.21.15.12:0/920322576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00b8a0 con 0x7fc3e40ae8b0 2023-07-07T18:14:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e27fc700 1 -- 172.21.15.12:0/920322576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00ba00 con 0x7fc3e40ae8b0 2023-07-07T18:14:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e27fc700 1 -- 172.21.15.12:0/920322576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00bd90 con 0x7fc3e40ae8b0 2023-07-07T18:14:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/920322576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e40ae8b0 msgr2=0x7fc3e40ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e9bd3700 1 --2- 172.21.15.12:0/920322576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e40ae8b0 0x7fc3e40ac600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0098f0 tx=0x7fc3cc009c00 comp rx=0 tx=0).stop 2023-07-07T18:14:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/920322576 shutdown_connections 2023-07-07T18:14:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e9bd3700 1 --2- 172.21.15.12:0/920322576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e415a430 0x7fc3e406e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e9bd3700 1 --2- 172.21.15.12:0/920322576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e40ae8b0 0x7fc3e40ac600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:46.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/920322576 >> 172.21.15.12:0/920322576 conn(0x7fc3e406b920 msgr2=0x7fc3e40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/920322576 shutdown_connections 2023-07-07T18:14:46.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.391+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/920322576 wait complete. 2023-07-07T18:14:46.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.392+0000 7fc3e9bd3700 1 Processor -- start 2023-07-07T18:14:46.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e9bd3700 1 -- start start 2023-07-07T18:14:46.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e9bd3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3e40acb40 0x7fc3e40b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:46.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e9bd3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e40ae8b0 0x7fc3e4156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:46.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e9bd3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e415a430 0x7fc3e4157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:46.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e9bd3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e4156f10 con 0x7fc3e415a430 2023-07-07T18:14:46.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e9bd3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e41571f0 con 0x7fc3e40acb40 2023-07-07T18:14:46.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e9bd3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e41574d0 con 0x7fc3e40ae8b0 2023-07-07T18:14:46.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e415a430 0x7fc3e4157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:46.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e415a430 0x7fc3e4157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56728/0 (socket says 172.21.15.12:56728) 2023-07-07T18:14:46.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.393+0000 7fc3e3fff700 1 -- 172.21.15.12:0/4047641235 learned_addr learned my addr 172.21.15.12:0/4047641235 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:46.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e37fe700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3e40acb40 0x7fc3e40b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e2ffd700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e40ae8b0 0x7fc3e4156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e3fff700 1 -- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e40ae8b0 msgr2=0x7fc3e4156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:46.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e3fff700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e40ae8b0 0x7fc3e4156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e3fff700 1 -- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3e40acb40 msgr2=0x7fc3e40b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e3fff700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3e40acb40 0x7fc3e40b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e3fff700 1 -- 172.21.15.12:0/4047641235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc009550 con 0x7fc3e415a430 2023-07-07T18:14:46.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e3fff700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e415a430 0x7fc3e4157fb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00cca0 tx=0x7fc3dc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3dbfff700 1 -- 172.21.15.12:0/4047641235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00ab70 con 0x7fc3e415a430 2023-07-07T18:14:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3dbfff700 1 -- 172.21.15.12:0/4047641235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc00acd0 con 0x7fc3e415a430 2023-07-07T18:14:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e41577b0 con 0x7fc3e415a430 2023-07-07T18:14:46.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3dbfff700 1 -- 172.21.15.12:0/4047641235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc007310 con 0x7fc3e415a430 2023-07-07T18:14:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.394+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e40b22f0 con 0x7fc3e415a430 2023-07-07T18:14:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.395+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e4157cd0 con 0x7fc3e415a430 2023-07-07T18:14:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.396+0000 7fc3dbfff700 1 -- 172.21.15.12:0/4047641235 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3dc007470 con 0x7fc3e415a430 2023-07-07T18:14:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.396+0000 7fc3dbfff700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc3c406ace0 0x7fc3c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.396+0000 7fc3dbfff700 1 -- 172.21.15.12:0/4047641235 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc3dc0891c0 con 0x7fc3e415a430 2023-07-07T18:14:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.396+0000 7fc3e37fe700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc3c406ace0 0x7fc3c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.397+0000 7fc3e37fe700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc3c406ace0 0x7fc3c406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4006fd0 tx=0x7fc3d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:46.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.401+0000 7fc3dbfff700 1 -- 172.21.15.12:0/4047641235 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc3e4157cd0 con 0x7fc3e415a430 2023-07-07T18:14:46.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:46.611+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fc3e4157cd0 con 0x7fc3e415a430 2023-07-07T18:14:47.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.235+0000 7fc3dbfff700 1 -- 172.21.15.12:0/4047641235 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7fc3e4157cd0 con 0x7fc3e415a430 2023-07-07T18:14:47.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc3c406ace0 msgr2=0x7fc3c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:47.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc3c406ace0 0x7fc3c406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4006fd0 tx=0x7fc3d4008040 comp rx=0 tx=0).stop 2023-07-07T18:14:47.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e415a430 msgr2=0x7fc3e4157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:47.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e415a430 0x7fc3e4157fb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00cca0 tx=0x7fc3dc00a060 comp rx=0 tx=0).stop 2023-07-07T18:14:47.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 shutdown_connections 2023-07-07T18:14:47.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc3c406ace0 0x7fc3c406d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:47.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3e415a430 0x7fc3e4157fb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:47.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3e40acb40 0x7fc3e40b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:47.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 --2- 172.21.15.12:0/4047641235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc3e40ae8b0 0x7fc3e4156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:47.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.238+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 >> 172.21.15.12:0/4047641235 conn(0x7fc3e406b920 msgr2=0x7fc3e40b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:47.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.239+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 shutdown_connections 2023-07-07T18:14:47.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.239+0000 7fc3e9bd3700 1 -- 172.21.15.12:0/4047641235 wait complete. 2023-07-07T18:14:47.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-07T18:14:47.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.389+0000 7f192c52e700 1 Processor -- start 2023-07-07T18:14:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.389+0000 7f192c52e700 1 -- start start 2023-07-07T18:14:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.390+0000 7f192c52e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f192406cc60 0x7f192406b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.390+0000 7f192c52e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192415c720 con 0x7f192415d2d0 2023-07-07T18:14:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.390+0000 7f192c52e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19240d03a0 con 0x7f19240b23a0 2023-07-07T18:14:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.390+0000 7f192c52e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192415d820 con 0x7f192406cc60 2023-07-07T18:14:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.390+0000 7f192aacb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f192406cc60 0x7f192406b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.390+0000 7f192aacb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f192406cc60 0x7f192406b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56736/0 (socket says 172.21.15.12:56736) 2023-07-07T18:14:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.390+0000 7f1929ac9700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f192415d2d0 0x7f192406b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53930/0 (socket says 172.21.15.12:53930) 2023-07-07T18:14:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.390+0000 7f192aacb700 1 -- 172.21.15.12:0/2100744142 learned_addr learned my addr 172.21.15.12:0/2100744142 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.391+0000 7f192aacb700 1 -- 172.21.15.12:0/2100744142 >> v1:172.21.15.160:6789/0 conn(0x7f19240b23a0 legacy=0x7f19240b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.391+0000 7f192aacb700 1 -- 172.21.15.12:0/2100744142 >> v1:172.21.15.12:6789/0 conn(0x7f192415d2d0 legacy=0x7f192406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.391+0000 7f192aacb700 1 -- 172.21.15.12:0/2100744142 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240ce690 con 0x7f192406cc60 2023-07-07T18:14:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.391+0000 7f19292c8700 1 -- 172.21.15.12:0/2100744142 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560088437 0 0) 0x7f1920001110 con 0x7f192415d2d0 2023-07-07T18:14:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.391+0000 7f192aacb700 1 --2- 172.21.15.12:0/2100744142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192406cc60 0x7f192406b710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f191c009e50 tx=0x7f191c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199d1fb44ea4e39a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.391+0000 7f19292c8700 1 -- 172.21.15.12:0/2100744142 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00e070 con 0x7f192406cc60 2023-07-07T18:14:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.391+0000 7f19292c8700 1 -- 172.21.15.12:0/2100744142 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00b9c0 con 0x7f192406cc60 2023-07-07T18:14:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.391+0000 7f19292c8700 1 -- 172.21.15.12:0/2100744142 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c00bd70 con 0x7f192406cc60 2023-07-07T18:14:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.392+0000 7f192c52e700 1 -- 172.21.15.12:0/2100744142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192406cc60 msgr2=0x7f192406b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.392+0000 7f192c52e700 1 --2- 172.21.15.12:0/2100744142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192406cc60 0x7f192406b710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f191c009e50 tx=0x7f191c00b330 comp rx=0 tx=0).stop 2023-07-07T18:14:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.392+0000 7f192c52e700 1 -- 172.21.15.12:0/2100744142 shutdown_connections 2023-07-07T18:14:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.392+0000 7f192c52e700 1 --2- 172.21.15.12:0/2100744142 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192406cc60 0x7f192406b710 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.392+0000 7f192c52e700 1 -- 172.21.15.12:0/2100744142 >> 172.21.15.12:0/2100744142 conn(0x7f192406e5c0 msgr2=0x7f192406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.392+0000 7f192c52e700 1 -- 172.21.15.12:0/2100744142 shutdown_connections 2023-07-07T18:14:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.392+0000 7f192c52e700 1 -- 172.21.15.12:0/2100744142 wait complete. 2023-07-07T18:14:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.393+0000 7f192c52e700 1 Processor -- start 2023-07-07T18:14:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.393+0000 7f192c52e700 1 -- start start 2023-07-07T18:14:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192c52e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192406cc60 0x7f19240b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192c52e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19240b23a0 0x7f1924150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192c52e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192415d2d0 0x7f19241f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192c52e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924150c80 con 0x7f192415d2d0 2023-07-07T18:14:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192c52e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b5c10 con 0x7f19240b23a0 2023-07-07T18:14:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192c52e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19241e8050 con 0x7f192406cc60 2023-07-07T18:14:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192aacb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192415d2d0 0x7f19241f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192aacb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192415d2d0 0x7f19241f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56742/0 (socket says 172.21.15.12:56742) 2023-07-07T18:14:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192aacb700 1 -- 172.21.15.12:0/2258356456 learned_addr learned my addr 172.21.15.12:0/2258356456 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:47.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f1929ac9700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19240b23a0 0x7f1924150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:47.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192a2ca700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192406cc60 0x7f19240b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:47.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192aacb700 1 -- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192406cc60 msgr2=0x7f19240b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:47.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192aacb700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192406cc60 0x7f19240b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:47.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192aacb700 1 -- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19240b23a0 msgr2=0x7f1924150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:47.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192aacb700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19240b23a0 0x7f1924150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:47.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192aacb700 1 -- 172.21.15.12:0/2258356456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c009b30 con 0x7f192415d2d0 2023-07-07T18:14:47.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f1929ac9700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19240b23a0 0x7f1924150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192aacb700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192415d2d0 0x7f19241f5a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f192406fb20 tx=0x7f191c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f191affd700 1 -- 172.21.15.12:0/2258356456 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c0099b0 con 0x7f192415d2d0 2023-07-07T18:14:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f191affd700 1 -- 172.21.15.12:0/2258356456 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c0092e0 con 0x7f192415d2d0 2023-07-07T18:14:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19240b55e0 con 0x7f192415d2d0 2023-07-07T18:14:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f191affd700 1 -- 172.21.15.12:0/2258356456 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c01b630 con 0x7f192415d2d0 2023-07-07T18:14:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.394+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19241f6810 con 0x7f192415d2d0 2023-07-07T18:14:47.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.395+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19240b5d80 con 0x7f192415d2d0 2023-07-07T18:14:47.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.396+0000 7f191affd700 1 -- 172.21.15.12:0/2258356456 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f191c01b790 con 0x7f192415d2d0 2023-07-07T18:14:47.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.396+0000 7f191affd700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f190806ace0 0x7f190806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:47.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.396+0000 7f191affd700 1 -- 172.21.15.12:0/2258356456 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f191c08afb0 con 0x7f192415d2d0 2023-07-07T18:14:47.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.397+0000 7f192a2ca700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f190806ace0 0x7f190806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:47.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.397+0000 7f192a2ca700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f190806ace0 0x7f190806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1914000f60 tx=0x7f1914009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:47.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.401+0000 7f191affd700 1 -- 172.21.15.12:0/2258356456 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f191c0bd310 con 0x7f192415d2d0 2023-07-07T18:14:47.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:47.600+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f192404ea20 con 0x7f192415d2d0 2023-07-07T18:14:49.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.248+0000 7f191affd700 1 -- 172.21.15.12:0/2258356456 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7f191c056010 con 0x7f192415d2d0 2023-07-07T18:14:49.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.253+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f190806ace0 msgr2=0x7f190806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:49.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.253+0000 7f192c52e700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f190806ace0 0x7f190806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1914000f60 tx=0x7f1914009040 comp rx=0 tx=0).stop 2023-07-07T18:14:49.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.253+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192415d2d0 msgr2=0x7f19241f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:49.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.253+0000 7f192c52e700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192415d2d0 0x7f19241f5a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f192406fb20 tx=0x7f191c004ad0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.255+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 shutdown_connections 2023-07-07T18:14:49.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.255+0000 7f192c52e700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f190806ace0 0x7f190806d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.255+0000 7f192c52e700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f192415d2d0 0x7f19241f5a70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.255+0000 7f192c52e700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f192406cc60 0x7f19240b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.255+0000 7f192c52e700 1 --2- 172.21.15.12:0/2258356456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f19240b23a0 0x7f1924150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.255+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 >> 172.21.15.12:0/2258356456 conn(0x7f192406e5c0 msgr2=0x7f192415efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:49.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.256+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 shutdown_connections 2023-07-07T18:14:49.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.257+0000 7f192c52e700 1 -- 172.21.15.12:0/2258356456 wait complete. 2023-07-07T18:14:49.260 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data_ec' created 2023-07-07T18:14:49.274 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-07T18:14:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.408+0000 7fdb7b534700 1 Processor -- start 2023-07-07T18:14:49.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.408+0000 7fdb7b534700 1 -- start start 2023-07-07T18:14:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.409+0000 7fdb7b534700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdb7415fc60 0x7fdb7406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.409+0000 7fdb7b534700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb740aecc0 0x7fdb740ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:49.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.409+0000 7fdb7b534700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740ce620 con 0x7fdb7406e260 2023-07-07T18:14:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.409+0000 7fdb7b534700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb74160580 con 0x7fdb7415fc60 2023-07-07T18:14:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.409+0000 7fdb7b534700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb74160860 con 0x7fdb740aecc0 2023-07-07T18:14:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.409+0000 7fdb79ad1700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdb7406e260 0x7fdb740cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53946/0 (socket says 172.21.15.12:53946) 2023-07-07T18:14:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.409+0000 7fdb79ad1700 1 -- 172.21.15.12:0/973076171 learned_addr learned my addr 172.21.15.12:0/973076171 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb792d0700 1 --2- 172.21.15.12:0/973076171 >> v2:172.21.15.160:3300/0 conn(0x7fdb7415fc60 0x7fdb7406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb78acf700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb740aecc0 0x7fdb740ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:49.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906434324 0 0) 0x7fdb740ce620 con 0x7fdb7406e260 2023-07-07T18:14:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb600035b0 con 0x7fdb7406e260 2023-07-07T18:14:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3037388054 0 0) 0x7fdb600035b0 con 0x7fdb7406e260 2023-07-07T18:14:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb740aecc0 msgr2=0x7fdb740ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb740aecc0 0x7fdb740ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 >> v2:172.21.15.160:3300/0 conn(0x7fdb7415fc60 msgr2=0x7fdb7406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 --2- 172.21.15.12:0/973076171 >> v2:172.21.15.160:3300/0 conn(0x7fdb7415fc60 0x7fdb7406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb74160b40 con 0x7fdb7406e260 2023-07-07T18:14:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fdb6c0019f0 con 0x7fdb7406e260 2023-07-07T18:14:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 >> v1:172.21.15.12:6789/0 conn(0x7fdb7406e260 legacy=0x7fdb740cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb60003a00 0x7fdb60003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb740aecc0 0x7fdb60004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb60004d90 0x7fdb60005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb74160580 con 0x7fdb60004d90 2023-07-07T18:14:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb74160860 con 0x7fdb60003a00 2023-07-07T18:14:49.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6000ba10 con 0x7fdb740aecc0 2023-07-07T18:14:49.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb79ad1700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb60004d90 0x7fdb60005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:49.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb78acf700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb740aecc0 0x7fdb60004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:49.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb792d0700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb60003a00 0x7fdb60003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:49.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb79ad1700 1 -- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb740aecc0 msgr2=0x7fdb60004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:49.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb79ad1700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb740aecc0 0x7fdb60004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb79ad1700 1 -- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb60003a00 msgr2=0x7fdb60003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:49.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.410+0000 7fdb79ad1700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb60003a00 0x7fdb60003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb79ad1700 1 -- 172.21.15.12:0/973076171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb600035b0 con 0x7fdb60004d90 2023-07-07T18:14:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb79ad1700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb60004d90 0x7fdb60005200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00a8d0 tx=0x7fdb60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861b1df8a42f286f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c00a340 con 0x7fdb60004d90 2023-07-07T18:14:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c012600 con 0x7fdb60004d90 2023-07-07T18:14:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb6bfff700 1 -- 172.21.15.12:0/973076171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0129b0 con 0x7fdb60004d90 2023-07-07T18:14:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb7b534700 1 -- 172.21.15.12:0/973076171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb60004d90 msgr2=0x7fdb60005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:49.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb7b534700 1 --2- 172.21.15.12:0/973076171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb60004d90 0x7fdb60005200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c00a8d0 tx=0x7fdb60005880 comp rx=0 tx=0).stop 2023-07-07T18:14:49.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb79ad1700 1 -- 172.21.15.12:0/973076171 reap_dead start 2023-07-07T18:14:49.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb7b534700 1 -- 172.21.15.12:0/973076171 shutdown_connections 2023-07-07T18:14:49.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb7b534700 1 -- 172.21.15.12:0/973076171 >> 172.21.15.12:0/973076171 conn(0x7fdb7406b920 msgr2=0x7fdb740cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:49.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb7b534700 1 -- 172.21.15.12:0/973076171 shutdown_connections 2023-07-07T18:14:49.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.411+0000 7fdb7b534700 1 -- 172.21.15.12:0/973076171 wait complete. 2023-07-07T18:14:49.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.413+0000 7fdb7b534700 1 Processor -- start 2023-07-07T18:14:49.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.413+0000 7fdb7b534700 1 -- start start 2023-07-07T18:14:49.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.413+0000 7fdb7b534700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb60004d90 0x7fdb740b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.413+0000 7fdb7b534700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb740b2840 0x7fdb7415d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.413+0000 7fdb7b534700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb7406d140 0x7fdb7406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.413+0000 7fdb7b534700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740b4fd0 con 0x7fdb740b2840 2023-07-07T18:14:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.413+0000 7fdb7b534700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7406daf0 con 0x7fdb60004d90 2023-07-07T18:14:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.413+0000 7fdb7b534700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740b2cb0 con 0x7fdb7406d140 2023-07-07T18:14:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb78acf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb740b2840 0x7fdb7415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb78acf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb740b2840 0x7fdb7415d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56758/0 (socket says 172.21.15.12:56758) 2023-07-07T18:14:49.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb78acf700 1 -- 172.21.15.12:0/3000261655 learned_addr learned my addr 172.21.15.12:0/3000261655 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb792d0700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb60004d90 0x7fdb740b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb79ad1700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb7406d140 0x7fdb7406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb78acf700 1 -- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb7406d140 msgr2=0x7fdb7406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb78acf700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb7406d140 0x7fdb7406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb78acf700 1 -- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb60004d90 msgr2=0x7fdb740b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb78acf700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb60004d90 0x7fdb740b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:49.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb78acf700 1 -- 172.21.15.12:0/3000261655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740b2f70 con 0x7fdb740b2840 2023-07-07T18:14:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb78acf700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb740b2840 0x7fdb7415d120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdb700119b0 tx=0x7fdb70011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb69ffb700 1 -- 172.21.15.12:0/3000261655 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70011e40 con 0x7fdb740b2840 2023-07-07T18:14:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb69ffb700 1 -- 172.21.15.12:0/3000261655 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70004240 con 0x7fdb740b2840 2023-07-07T18:14:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb69ffb700 1 -- 172.21.15.12:0/3000261655 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7000f730 con 0x7fdb740b2840 2023-07-07T18:14:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb740b3250 con 0x7fdb740b2840 2023-07-07T18:14:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.414+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb740b3810 con 0x7fdb740b2840 2023-07-07T18:14:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.415+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7406a600 con 0x7fdb740b2840 2023-07-07T18:14:49.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.416+0000 7fdb69ffb700 1 -- 172.21.15.12:0/3000261655 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb7000f890 con 0x7fdb740b2840 2023-07-07T18:14:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.416+0000 7fdb69ffb700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdb5806ace0 0x7fdb5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.416+0000 7fdb69ffb700 1 -- 172.21.15.12:0/3000261655 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fdb70089c40 con 0x7fdb740b2840 2023-07-07T18:14:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.416+0000 7fdb792d0700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdb5806ace0 0x7fdb5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.417+0000 7fdb792d0700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdb5806ace0 0x7fdb5806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009c40 tx=0x7fdb640091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:49.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.421+0000 7fdb69ffb700 1 -- 172.21.15.12:0/3000261655 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb700548f0 con 0x7fdb740b2840 2023-07-07T18:14:49.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:49.615+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fdb740cdca0 con 0x7fdb740b2840 2023-07-07T18:14:50.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.256+0000 7fdb69ffb700 1 -- 172.21.15.12:0/3000261655 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdb70023020 con 0x7fdb740b2840 2023-07-07T18:14:50.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.261+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdb5806ace0 msgr2=0x7fdb5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.261+0000 7fdb7b534700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdb5806ace0 0x7fdb5806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009c40 tx=0x7fdb640091c0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.261+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb740b2840 msgr2=0x7fdb7415d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.261+0000 7fdb7b534700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb740b2840 0x7fdb7415d120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdb700119b0 tx=0x7fdb70011cc0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.262+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 shutdown_connections 2023-07-07T18:14:50.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.262+0000 7fdb7b534700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdb5806ace0 0x7fdb5806d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.262+0000 7fdb7b534700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdb7406d140 0x7fdb7406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.262+0000 7fdb7b534700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdb60004d90 0x7fdb740b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.262+0000 7fdb7b534700 1 --2- 172.21.15.12:0/3000261655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb740b2840 0x7fdb7415d120 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdb700119b0 tx=0x7fdb70011cc0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.262+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 >> 172.21.15.12:0/3000261655 conn(0x7fdb7406b920 msgr2=0x7fdb74069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:50.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.268+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 shutdown_connections 2023-07-07T18:14:50.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.269+0000 7fdb7b534700 1 -- 172.21.15.12:0/3000261655 wait complete. 2023-07-07T18:14:50.273 INFO:teuthology.orchestra.run.smithi012.stderr:set pool 5 allow_ec_overwrites to true 2023-07-07T18:14:50.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-07T18:14:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.427+0000 7f634a45c700 1 Processor -- start 2023-07-07T18:14:50.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.427+0000 7f634a45c700 1 -- start start 2023-07-07T18:14:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.427+0000 7f634a45c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f63440cd1d0 0x7f63440d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.427+0000 7f634a45c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63440cd6d0 con 0x7f634415d280 2023-07-07T18:14:50.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f634a45c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63440d2b20 con 0x7f63440cf590 2023-07-07T18:14:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f634a45c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440cd9b0 con 0x7f63440cd1d0 2023-07-07T18:14:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f63489f9700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f634415d280 0x7f63440d0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53966/0 (socket says 172.21.15.12:53966) 2023-07-07T18:14:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f63489f9700 1 -- 172.21.15.12:0/1250854456 learned_addr learned my addr 172.21.15.12:0/1250854456 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f63437fe700 1 --2- 172.21.15.12:0/1250854456 >> v2:172.21.15.160:3300/0 conn(0x7f63440cd1d0 0x7f63440d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f6342ffd700 1 -- 172.21.15.12:0/1250854456 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461093581 0 0) 0x7f63440cd6d0 con 0x7f634415d280 2023-07-07T18:14:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f6342ffd700 1 -- 172.21.15.12:0/1250854456 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f632c0035b0 con 0x7f634415d280 2023-07-07T18:14:50.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f63437fe700 1 -- 172.21.15.12:0/1250854456 >> v1:172.21.15.160:6789/0 conn(0x7f63440cf590 legacy=0x7f63440cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f63437fe700 1 -- 172.21.15.12:0/1250854456 >> v1:172.21.15.12:6789/0 conn(0x7f634415d280 legacy=0x7f63440d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f63437fe700 1 -- 172.21.15.12:0/1250854456 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440d2e00 con 0x7f63440cd1d0 2023-07-07T18:14:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f63437fe700 1 --2- 172.21.15.12:0/1250854456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63440cd1d0 0x7f63440d3600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6338009840 tx=0x7f6338009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=686b4ff818f2b90a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.428+0000 7f6342ffd700 1 -- 172.21.15.12:0/1250854456 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338011830 con 0x7f63440cd1d0 2023-07-07T18:14:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.429+0000 7f6342ffd700 1 -- 172.21.15.12:0/1250854456 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6338011990 con 0x7f63440cd1d0 2023-07-07T18:14:50.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.429+0000 7f6342ffd700 1 -- 172.21.15.12:0/1250854456 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338011d20 con 0x7f63440cd1d0 2023-07-07T18:14:50.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.429+0000 7f634a45c700 1 -- 172.21.15.12:0/1250854456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63440cd1d0 msgr2=0x7f63440d3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.429+0000 7f634a45c700 1 --2- 172.21.15.12:0/1250854456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63440cd1d0 0x7f63440d3600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6338009840 tx=0x7f6338009b50 comp rx=0 tx=0).stop 2023-07-07T18:14:50.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.429+0000 7f634a45c700 1 -- 172.21.15.12:0/1250854456 shutdown_connections 2023-07-07T18:14:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.429+0000 7f634a45c700 1 --2- 172.21.15.12:0/1250854456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63440cd1d0 0x7f63440d3600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.429+0000 7f634a45c700 1 -- 172.21.15.12:0/1250854456 >> 172.21.15.12:0/1250854456 conn(0x7f634406b3b0 msgr2=0x7f634406b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.429+0000 7f634a45c700 1 -- 172.21.15.12:0/1250854456 shutdown_connections 2023-07-07T18:14:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.429+0000 7f634a45c700 1 -- 172.21.15.12:0/1250854456 wait complete. 2023-07-07T18:14:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.431+0000 7f634a45c700 1 Processor -- start 2023-07-07T18:14:50.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.431+0000 7f634a45c700 1 -- start start 2023-07-07T18:14:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f634a45c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63440cd1d0 0x7f6344152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f634a45c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63440cf590 0x7f6344153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f634a45c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f634415d280 0x7f634415ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f634a45c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344152c70 con 0x7f63440cd1d0 2023-07-07T18:14:50.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f634a45c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344151d00 con 0x7f63440cf590 2023-07-07T18:14:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f634a45c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6344153970 con 0x7f634415d280 2023-07-07T18:14:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f6343fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63440cd1d0 0x7f6344152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f6343fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63440cd1d0 0x7f6344152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56770/0 (socket says 172.21.15.12:56770) 2023-07-07T18:14:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f6343fff700 1 -- 172.21.15.12:0/2100576269 learned_addr learned my addr 172.21.15.12:0/2100576269 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f63437fe700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63440cf590 0x7f6344153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f63489f9700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f634415d280 0x7f634415ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f6343fff700 1 -- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f634415d280 msgr2=0x7f634415ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f6343fff700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f634415d280 0x7f634415ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f6343fff700 1 -- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63440cf590 msgr2=0x7f6344153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f6343fff700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63440cf590 0x7f6344153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f6343fff700 1 -- 172.21.15.12:0/2100576269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380094a0 con 0x7f63440cd1d0 2023-07-07T18:14:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.432+0000 7f6343fff700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63440cd1d0 0x7f6344152730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f633400c700 tx=0x7f633400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.433+0000 7f6340ff9700 1 -- 172.21.15.12:0/2100576269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340052d0 con 0x7f63440cd1d0 2023-07-07T18:14:50.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.433+0000 7f6340ff9700 1 -- 172.21.15.12:0/2100576269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6334005430 con 0x7f63440cd1d0 2023-07-07T18:14:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.433+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6344153c50 con 0x7f63440cd1d0 2023-07-07T18:14:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.433+0000 7f6340ff9700 1 -- 172.21.15.12:0/2100576269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334003880 con 0x7f63440cd1d0 2023-07-07T18:14:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.433+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6344152230 con 0x7f63440cd1d0 2023-07-07T18:14:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.434+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634404ea20 con 0x7f63440cd1d0 2023-07-07T18:14:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.434+0000 7f6340ff9700 1 -- 172.21.15.12:0/2100576269 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f63340039e0 con 0x7f63440cd1d0 2023-07-07T18:14:50.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.434+0000 7f6340ff9700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f633006ace0 0x7f633006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.435+0000 7f6340ff9700 1 -- 172.21.15.12:0/2100576269 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f6334088b90 con 0x7f63440cd1d0 2023-07-07T18:14:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.435+0000 7f63437fe700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f633006ace0 0x7f633006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.435+0000 7f63437fe700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f633006ace0 0x7f633006d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f63440b2210 tx=0x7f6338008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:50.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.439+0000 7f6340ff9700 1 -- 172.21.15.12:0/2100576269 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63340539a0 con 0x7f63440cd1d0 2023-07-07T18:14:50.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.684+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f63440b22c0 con 0x7f63440cd1d0 2023-07-07T18:14:50.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.693+0000 7f6340ff9700 1 -- 172.21.15.12:0/2100576269 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f6334056fc0 con 0x7f63440cd1d0 2023-07-07T18:14:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f633006ace0 msgr2=0x7f633006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f633006ace0 0x7f633006d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f63440b2210 tx=0x7f6338008030 comp rx=0 tx=0).stop 2023-07-07T18:14:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63440cd1d0 msgr2=0x7f6344152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63440cd1d0 0x7f6344152730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f633400c700 tx=0x7f633400cac0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 shutdown_connections 2023-07-07T18:14:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f633006ace0 0x7f633006d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f634415d280 0x7f634415ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63440cd1d0 0x7f6344152730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 --2- 172.21.15.12:0/2100576269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63440cf590 0x7f6344153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 >> 172.21.15.12:0/2100576269 conn(0x7f634406b3b0 msgr2=0x7f63440cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 shutdown_connections 2023-07-07T18:14:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.695+0000 7f634a45c700 1 -- 172.21.15.12:0/2100576269 wait complete. 2023-07-07T18:14:50.698 INFO:teuthology.orchestra.run.smithi012.stderr:added data pool 5 to fsmap 2023-07-07T18:14:50.708 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:14:50.773 INFO:tasks.ceph.mds.b.smithi160.stderr:2023-07-07T18:14:50.771+0000 7fbc50459700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-07T18:14:50.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.833+0000 7efcddca0700 1 Processor -- start 2023-07-07T18:14:50.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.833+0000 7efcddca0700 1 -- start start 2023-07-07T18:14:50.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcddca0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efcd80d05d0 0x7efcd806fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcddca0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 0x7efcd80aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcddca0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80ae580 con 0x7efcd815a640 2023-07-07T18:14:50.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcddca0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd806f610 con 0x7efcd80d05d0 2023-07-07T18:14:50.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcddca0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80adf70 con 0x7efcd80cec80 2023-07-07T18:14:50.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efcd80d05d0 0x7efcd806fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd77fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efcd815a640 0x7efcd80ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53976/0 (socket says 172.21.15.12:53976) 2023-07-07T18:14:50.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efcd80d05d0 0x7efcd806fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56780/0 (socket says 172.21.15.12:56780) 2023-07-07T18:14:50.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd77fe700 1 -- 172.21.15.12:0/236911945 learned_addr learned my addr 172.21.15.12:0/236911945 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:50.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd7fff700 1 --2- 172.21.15.12:0/236911945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 0x7efcd80aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd6ffd700 1 -- 172.21.15.12:0/236911945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 msgr2=0x7efcd80aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd6ffd700 1 --2- 172.21.15.12:0/236911945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 0x7efcd80aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd6ffd700 1 -- 172.21.15.12:0/236911945 >> v1:172.21.15.12:6789/0 conn(0x7efcd815a640 legacy=0x7efcd80ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd6ffd700 1 -- 172.21.15.12:0/236911945 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd806f860 con 0x7efcd80d05d0 2023-07-07T18:14:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd67fc700 1 -- 172.21.15.12:0/236911945 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690234473 0 0) 0x7efcd80ae580 con 0x7efcd815a640 2023-07-07T18:14:50.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd6ffd700 1 --2- 172.21.15.12:0/236911945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80d05d0 0x7efcd806fe80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009840 tx=0x7efcc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d84cd26bd748f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:50.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd67fc700 1 -- 172.21.15.12:0/236911945 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8011830 con 0x7efcd80d05d0 2023-07-07T18:14:50.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd67fc700 1 -- 172.21.15.12:0/236911945 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc8011990 con 0x7efcd80d05d0 2023-07-07T18:14:50.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.834+0000 7efcd67fc700 1 -- 172.21.15.12:0/236911945 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8011d20 con 0x7efcd80d05d0 2023-07-07T18:14:50.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.835+0000 7efcddca0700 1 -- 172.21.15.12:0/236911945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80d05d0 msgr2=0x7efcd806fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.835+0000 7efcddca0700 1 --2- 172.21.15.12:0/236911945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80d05d0 0x7efcd806fe80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009840 tx=0x7efcc8009b50 comp rx=0 tx=0).stop 2023-07-07T18:14:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.835+0000 7efcddca0700 1 -- 172.21.15.12:0/236911945 shutdown_connections 2023-07-07T18:14:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.835+0000 7efcddca0700 1 --2- 172.21.15.12:0/236911945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 0x7efcd80aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.835+0000 7efcddca0700 1 --2- 172.21.15.12:0/236911945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd80d05d0 0x7efcd806fe80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.835+0000 7efcddca0700 1 -- 172.21.15.12:0/236911945 >> 172.21.15.12:0/236911945 conn(0x7efcd8089fe0 msgr2=0x7efcd80d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.835+0000 7efcddca0700 1 -- 172.21.15.12:0/236911945 shutdown_connections 2023-07-07T18:14:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.835+0000 7efcddca0700 1 -- 172.21.15.12:0/236911945 wait complete. 2023-07-07T18:14:50.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.836+0000 7efcddca0700 1 Processor -- start 2023-07-07T18:14:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.836+0000 7efcddca0700 1 -- start start 2023-07-07T18:14:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcddca0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 0x7efcd81e2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcddca0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcd80d05d0 0x7efcd8155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcddca0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd815a640 0x7efcd81effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcddca0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b66a0 con 0x7efcd815a640 2023-07-07T18:14:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcddca0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b5b20 con 0x7efcd80d05d0 2023-07-07T18:14:50.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcddca0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b5e00 con 0x7efcd80cec80 2023-07-07T18:14:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcd7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd815a640 0x7efcd81effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcd7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd815a640 0x7efcd81effb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56788/0 (socket says 172.21.15.12:56788) 2023-07-07T18:14:50.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcd7fff700 1 -- 172.21.15.12:0/3770015740 learned_addr learned my addr 172.21.15.12:0/3770015740 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:50.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcd7fff700 1 -- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 msgr2=0x7efcd81e2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcd6ffd700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcd80d05d0 0x7efcd8155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.837+0000 7efcd77fe700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 0x7efcd81e2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcd7fff700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 0x7efcd81e2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcd7fff700 1 -- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcd80d05d0 msgr2=0x7efcd8155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:50.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcd7fff700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcd80d05d0 0x7efcd8155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcd7fff700 1 -- 172.21.15.12:0/3770015740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc80094a0 con 0x7efcd815a640 2023-07-07T18:14:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcd6ffd700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcd80d05d0 0x7efcd8155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcd77fe700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 0x7efcd81e2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:50.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcd7fff700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd815a640 0x7efcd81effb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efcd0007d40 tx=0x7efcd000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcbffff700 1 -- 172.21.15.12:0/3770015740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000ede0 con 0x7efcd815a640 2023-07-07T18:14:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcbffff700 1 -- 172.21.15.12:0/3770015740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd0014420 con 0x7efcd815a640 2023-07-07T18:14:50.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd80b60e0 con 0x7efcd815a640 2023-07-07T18:14:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcbffff700 1 -- 172.21.15.12:0/3770015740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd00147d0 con 0x7efcd815a640 2023-07-07T18:14:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.838+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd81e3380 con 0x7efcd815a640 2023-07-07T18:14:50.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.839+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd80d0210 con 0x7efcd815a640 2023-07-07T18:14:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.839+0000 7efcbffff700 1 -- 172.21.15.12:0/3770015740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efcd0014930 con 0x7efcd815a640 2023-07-07T18:14:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.840+0000 7efcbffff700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efcc406ace0 0x7efcc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.840+0000 7efcbffff700 1 -- 172.21.15.12:0/3770015740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efcd0089ea0 con 0x7efcd815a640 2023-07-07T18:14:50.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.840+0000 7efcd77fe700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efcc406ace0 0x7efcc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:50.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.840+0000 7efcd77fe700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efcc406ace0 0x7efcc406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efccc000f60 tx=0x7efccc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:50.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:50.844+0000 7efcbffff700 1 -- 172.21.15.12:0/3770015740 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efcd0054c60 con 0x7efcd815a640 2023-07-07T18:14:51.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.089+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcd81e3510 con 0x7efcd815a640 2023-07-07T18:14:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.089+0000 7efcbffff700 1 -- 172.21.15.12:0/3770015740 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7efcd81e3510 con 0x7efcd815a640 2023-07-07T18:14:51.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:51.092 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:14:50.685777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-07T18:14:51.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efcc406ace0 msgr2=0x7efcc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efcc406ace0 0x7efcc406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efccc000f60 tx=0x7efccc009040 comp rx=0 tx=0).stop 2023-07-07T18:14:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd815a640 msgr2=0x7efcd81effb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd815a640 0x7efcd81effb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efcd0007d40 tx=0x7efcd000e3c0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 shutdown_connections 2023-07-07T18:14:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efcc406ace0 0x7efcc406d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcd815a640 0x7efcd81effb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcd80cec80 0x7efcd81e2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 --2- 172.21.15.12:0/3770015740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcd80d05d0 0x7efcd8155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.091+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 >> 172.21.15.12:0/3770015740 conn(0x7efcd8089fe0 msgr2=0x7efcd80c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.092+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 shutdown_connections 2023-07-07T18:14:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.092+0000 7efcddca0700 1 -- 172.21.15.12:0/3770015740 wait complete. 2023-07-07T18:14:51.095 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2023-07-07T18:14:51.105 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:51.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.228+0000 7f18d14fa700 1 Processor -- start 2023-07-07T18:14:51.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.228+0000 7f18d14fa700 1 -- start start 2023-07-07T18:14:51.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.229+0000 7f18d14fa700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f18cc15c570 0x7f18cc0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.229+0000 7f18d14fa700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc160a50 0x7f18cc0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.229+0000 7f18d14fa700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc1610a0 con 0x7f18cc0cd660 2023-07-07T18:14:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.229+0000 7f18d14fa700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc15d670 con 0x7f18cc15c570 2023-07-07T18:14:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.229+0000 7f18d14fa700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc160eb0 con 0x7f18cc160a50 2023-07-07T18:14:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.229+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc160a50 0x7f18cc0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.229+0000 7f18caffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f18cc15c570 0x7f18cc0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.229+0000 7f18cb7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc160a50 0x7f18cc0d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:45886/0 (socket says 172.21.15.12:45886) 2023-07-07T18:14:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.229+0000 7f18cb7fe700 1 -- 172.21.15.12:0/1753989358 learned_addr learned my addr 172.21.15.12:0/1753989358 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18cb7fe700 1 -- 172.21.15.12:0/1753989358 >> v2:172.21.15.160:3300/0 conn(0x7f18cc15c570 msgr2=0x7f18cc0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/1753989358 >> v2:172.21.15.160:3300/0 conn(0x7f18cc15c570 0x7f18cc0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18cb7fe700 1 -- 172.21.15.12:0/1753989358 >> v1:172.21.15.160:6789/0 conn(0x7f18cc0cd660 legacy=0x7f18cc160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18cb7fe700 1 -- 172.21.15.12:0/1753989358 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc15da90 con 0x7f18cc160a50 2023-07-07T18:14:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18caffd700 1 --2- 172.21.15.12:0/1753989358 >> v2:172.21.15.160:3300/0 conn(0x7f18cc15c570 0x7f18cc0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:14:51.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/1753989358 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc160a50 0x7f18cc0d0bb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009e50 tx=0x7f18c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b8a077197b9b3a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18c9ffb700 1 -- 172.21.15.12:0/1753989358 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400e070 con 0x7f18cc160a50 2023-07-07T18:14:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18c9ffb700 1 -- 172.21.15.12:0/1753989358 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c400b910 con 0x7f18cc160a50 2023-07-07T18:14:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18c9ffb700 1 -- 172.21.15.12:0/1753989358 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400bcc0 con 0x7f18cc160a50 2023-07-07T18:14:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18d14fa700 1 -- 172.21.15.12:0/1753989358 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc160a50 msgr2=0x7f18cc0d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.230+0000 7f18d14fa700 1 --2- 172.21.15.12:0/1753989358 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc160a50 0x7f18cc0d0bb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009e50 tx=0x7f18c400b330 comp rx=0 tx=0).stop 2023-07-07T18:14:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.231+0000 7f18d14fa700 1 -- 172.21.15.12:0/1753989358 shutdown_connections 2023-07-07T18:14:51.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.231+0000 7f18d14fa700 1 --2- 172.21.15.12:0/1753989358 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc160a50 0x7f18cc0d0bb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.231+0000 7f18d14fa700 1 --2- 172.21.15.12:0/1753989358 >> v2:172.21.15.160:3300/0 conn(0x7f18cc15c570 0x7f18cc0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.231+0000 7f18d14fa700 1 -- 172.21.15.12:0/1753989358 >> 172.21.15.12:0/1753989358 conn(0x7f18cc071620 msgr2=0x7f18cc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:51.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.231+0000 7f18d14fa700 1 -- 172.21.15.12:0/1753989358 shutdown_connections 2023-07-07T18:14:51.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.231+0000 7f18d14fa700 1 -- 172.21.15.12:0/1753989358 wait complete. 2023-07-07T18:14:51.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.232+0000 7f18d14fa700 1 Processor -- start 2023-07-07T18:14:51.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.232+0000 7f18d14fa700 1 -- start start 2023-07-07T18:14:51.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.233+0000 7f18d14fa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc0cd660 0x7f18cc159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.233+0000 7f18d14fa700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc15c570 0x7f18cc0c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.233+0000 7f18d14fa700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18cc160a50 0x7f18cc0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.233+0000 7f18d14fa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0caf90 con 0x7f18cc0cd660 2023-07-07T18:14:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.233+0000 7f18d14fa700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0ca0e0 con 0x7f18cc160a50 2023-07-07T18:14:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.233+0000 7f18d14fa700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0ca310 con 0x7f18cc15c570 2023-07-07T18:14:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.233+0000 7f18caffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc0cd660 0x7f18cc159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.233+0000 7f18caffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc0cd660 0x7f18cc159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56798/0 (socket says 172.21.15.12:56798) 2023-07-07T18:14:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.233+0000 7f18caffd700 1 -- 172.21.15.12:0/1828721190 learned_addr learned my addr 172.21.15.12:0/1828721190 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18cb7fe700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18cc160a50 0x7f18cc0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18ca7fc700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc15c570 0x7f18cc0c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18caffd700 1 -- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc15c570 msgr2=0x7f18cc0c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18caffd700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc15c570 0x7f18cc0c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18caffd700 1 -- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18cc160a50 msgr2=0x7f18cc0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18caffd700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18cc160a50 0x7f18cc0cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18caffd700 1 -- 172.21.15.12:0/1828721190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c00094a0 con 0x7f18cc0cd660 2023-07-07T18:14:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18caffd700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc0cd660 0x7f18cc159fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18c000ebe0 tx=0x7f18c000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:51.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18b37fe700 1 -- 172.21.15.12:0/1828721190 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c000c850 con 0x7f18cc0cd660 2023-07-07T18:14:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18b37fe700 1 -- 172.21.15.12:0/1828721190 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c000c9b0 con 0x7f18cc0cd660 2023-07-07T18:14:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c4009b30 con 0x7f18cc0cd660 2023-07-07T18:14:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18b37fe700 1 -- 172.21.15.12:0/1828721190 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c000cd40 con 0x7f18cc0cd660 2023-07-07T18:14:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.234+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc0ca8d0 con 0x7f18cc0cd660 2023-07-07T18:14:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.235+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc0cb200 con 0x7f18cc0cd660 2023-07-07T18:14:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.236+0000 7f18b37fe700 1 -- 172.21.15.12:0/1828721190 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18c0013470 con 0x7f18cc0cd660 2023-07-07T18:14:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.236+0000 7f18b37fe700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f18b806ace0 0x7f18b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.236+0000 7f18b37fe700 1 -- 172.21.15.12:0/1828721190 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f18c0089c30 con 0x7f18cc0cd660 2023-07-07T18:14:51.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.236+0000 7f18ca7fc700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f18b806ace0 0x7f18b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.237+0000 7f18ca7fc700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f18b806ace0 0x7f18b806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0c98c0 tx=0x7f18bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:51.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.240+0000 7f18b37fe700 1 -- 172.21.15.12:0/1828721190 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f18c0054970 con 0x7f18cc0cd660 2023-07-07T18:14:51.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.440+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18cc073910 con 0x7f18cc0cd660 2023-07-07T18:14:51.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.442+0000 7f18b37fe700 1 -- 172.21.15.12:0/1828721190 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f18c000cea0 con 0x7f18cc0cd660 2023-07-07T18:14:51.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:51.443 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f18b806ace0 msgr2=0x7f18b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f18b806ace0 0x7f18b806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0c98c0 tx=0x7f18bc009040 comp rx=0 tx=0).stop 2023-07-07T18:14:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc0cd660 msgr2=0x7f18cc159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc0cd660 0x7f18cc159fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18c000ebe0 tx=0x7f18c000eef0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 shutdown_connections 2023-07-07T18:14:51.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f18b806ace0 0x7f18b806d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18cc160a50 0x7f18cc0cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc0cd660 0x7f18cc159fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 --2- 172.21.15.12:0/1828721190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18cc15c570 0x7f18cc0c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 >> 172.21.15.12:0/1828721190 conn(0x7f18cc071620 msgr2=0x7f18cc0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:51.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 shutdown_connections 2023-07-07T18:14:51.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.444+0000 7f18d14fa700 1 -- 172.21.15.12:0/1828721190 wait complete. 2023-07-07T18:14:51.457 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:51.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.581+0000 7f4b56d10700 1 Processor -- start 2023-07-07T18:14:51.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.581+0000 7f4b56d10700 1 -- start start 2023-07-07T18:14:51.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.582+0000 7f4b56d10700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b500aed30 0x7f4b50160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.582+0000 7f4b56d10700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4b500cc1d0 0x7f4b500cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.582+0000 7f4b56d10700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b500cee80 con 0x7f4b50156880 2023-07-07T18:14:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.582+0000 7f4b56d10700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b500ccb90 con 0x7f4b500cc1d0 2023-07-07T18:14:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.582+0000 7f4b56d10700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b500cf100 con 0x7f4b500aed30 2023-07-07T18:14:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b552ad700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4b500cc1d0 0x7f4b500cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b4ffff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b500aed30 0x7f4b50160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b4ffff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b500aed30 0x7f4b50160580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:45898/0 (socket says 172.21.15.12:45898) 2023-07-07T18:14:51.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b552ad700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4b500cc1d0 0x7f4b500cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:52416/0 (socket says 172.21.15.12:52416) 2023-07-07T18:14:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b4ffff700 1 -- 172.21.15.12:0/2725477259 learned_addr learned my addr 172.21.15.12:0/2725477259 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b552ad700 1 -- 172.21.15.12:0/2725477259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b500aed30 msgr2=0x7f4b50160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b552ad700 1 --2- 172.21.15.12:0/2725477259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b500aed30 0x7f4b50160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b552ad700 1 -- 172.21.15.12:0/2725477259 >> v1:172.21.15.160:6789/0 conn(0x7f4b50156880 legacy=0x7f4b50069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b552ad700 1 -- 172.21.15.12:0/2725477259 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b500cf3e0 con 0x7f4b500cc1d0 2023-07-07T18:14:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b4ffff700 1 --2- 172.21.15.12:0/2725477259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b500aed30 0x7f4b50160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:14:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b552ad700 1 --2- 172.21.15.12:0/2725477259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b500cc1d0 0x7f4b500cc650 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009d90 tx=0x7f4b4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e3e502bc111500 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b4f7fe700 1 -- 172.21.15.12:0/2725477259 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4800e070 con 0x7f4b500cc1d0 2023-07-07T18:14:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b4f7fe700 1 -- 172.21.15.12:0/2725477259 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4800bb20 con 0x7f4b500cc1d0 2023-07-07T18:14:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.583+0000 7f4b4f7fe700 1 -- 172.21.15.12:0/2725477259 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b48012430 con 0x7f4b500cc1d0 2023-07-07T18:14:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.584+0000 7f4b56d10700 1 -- 172.21.15.12:0/2725477259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b500cc1d0 msgr2=0x7f4b500cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.584+0000 7f4b56d10700 1 --2- 172.21.15.12:0/2725477259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b500cc1d0 0x7f4b500cc650 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009d90 tx=0x7f4b4800b330 comp rx=0 tx=0).stop 2023-07-07T18:14:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.584+0000 7f4b56d10700 1 -- 172.21.15.12:0/2725477259 shutdown_connections 2023-07-07T18:14:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.584+0000 7f4b56d10700 1 --2- 172.21.15.12:0/2725477259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b500cc1d0 0x7f4b500cc650 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.584+0000 7f4b56d10700 1 --2- 172.21.15.12:0/2725477259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b500aed30 0x7f4b50160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.584+0000 7f4b56d10700 1 -- 172.21.15.12:0/2725477259 >> 172.21.15.12:0/2725477259 conn(0x7f4b5006d4a0 msgr2=0x7f4b5006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.584+0000 7f4b56d10700 1 -- 172.21.15.12:0/2725477259 shutdown_connections 2023-07-07T18:14:51.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.584+0000 7f4b56d10700 1 -- 172.21.15.12:0/2725477259 wait complete. 2023-07-07T18:14:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.585+0000 7f4b56d10700 1 Processor -- start 2023-07-07T18:14:51.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.585+0000 7f4b56d10700 1 -- start start 2023-07-07T18:14:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b56d10700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b500aed30 0x7f4b500b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b56d10700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b500cc1d0 0x7f4b501f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b56d10700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b50156880 0x7f4b500b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b56d10700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b501f2350 con 0x7f4b500aed30 2023-07-07T18:14:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b56d10700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b501f2d20 con 0x7f4b500cc1d0 2023-07-07T18:14:51.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b56d10700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b501f1d60 con 0x7f4b50156880 2023-07-07T18:14:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b54aac700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b500aed30 0x7f4b500b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b54aac700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b500aed30 0x7f4b500b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56814/0 (socket says 172.21.15.12:56814) 2023-07-07T18:14:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b54aac700 1 -- 172.21.15.12:0/713492583 learned_addr learned my addr 172.21.15.12:0/713492583 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:51.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b552ad700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b50156880 0x7f4b500b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.586+0000 7f4b4ffff700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b500cc1d0 0x7f4b501f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b54aac700 1 -- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b50156880 msgr2=0x7f4b500b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b54aac700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b50156880 0x7f4b500b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b54aac700 1 -- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b500cc1d0 msgr2=0x7f4b501f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b54aac700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b500cc1d0 0x7f4b501f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b54aac700 1 -- 172.21.15.12:0/713492583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c009550 con 0x7f4b500aed30 2023-07-07T18:14:51.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b54aac700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b500aed30 0x7f4b500b5010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400c510 tx=0x7f4b4400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b4d7fa700 1 -- 172.21.15.12:0/713492583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440052d0 con 0x7f4b500aed30 2023-07-07T18:14:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b4d7fa700 1 -- 172.21.15.12:0/713492583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44005430 con 0x7f4b500aed30 2023-07-07T18:14:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b48009a70 con 0x7f4b500aed30 2023-07-07T18:14:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b4d7fa700 1 -- 172.21.15.12:0/713492583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440038c0 con 0x7f4b500aed30 2023-07-07T18:14:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.587+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b500b3370 con 0x7f4b500aed30 2023-07-07T18:14:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.588+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b50073910 con 0x7f4b500aed30 2023-07-07T18:14:51.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.588+0000 7f4b4d7fa700 1 -- 172.21.15.12:0/713492583 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b44003a20 con 0x7f4b500aed30 2023-07-07T18:14:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.589+0000 7f4b4d7fa700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4b3406ace0 0x7f4b3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.589+0000 7f4b4d7fa700 1 -- 172.21.15.12:0/713492583 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b44088a20 con 0x7f4b500aed30 2023-07-07T18:14:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.589+0000 7f4b4ffff700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4b3406ace0 0x7f4b3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.589+0000 7f4b4ffff700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4b3406ace0 0x7f4b3406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b50155d30 tx=0x7f4b3c0092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:51.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.593+0000 7f4b4d7fa700 1 -- 172.21.15.12:0/713492583 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b44053870 con 0x7f4b500aed30 2023-07-07T18:14:51.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.794+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b500b3500 con 0x7f4b500aed30 2023-07-07T18:14:51.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.796+0000 7f4b4d7fa700 1 -- 172.21.15.12:0/713492583 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f4b44056e90 con 0x7f4b500aed30 2023-07-07T18:14:51.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:51.797 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:51.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4b3406ace0 msgr2=0x7f4b3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4b3406ace0 0x7f4b3406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b50155d30 tx=0x7f4b3c0092c0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b500aed30 msgr2=0x7f4b500b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b500aed30 0x7f4b500b5010 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400c510 tx=0x7f4b4400c820 comp rx=0 tx=0).stop 2023-07-07T18:14:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 shutdown_connections 2023-07-07T18:14:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4b3406ace0 0x7f4b3406d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b50156880 0x7f4b500b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b500aed30 0x7f4b500b5010 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 --2- 172.21.15.12:0/713492583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b500cc1d0 0x7f4b501f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 >> 172.21.15.12:0/713492583 conn(0x7f4b5006d4a0 msgr2=0x7f4b5015de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 shutdown_connections 2023-07-07T18:14:51.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.798+0000 7f4b56d10700 1 -- 172.21.15.12:0/713492583 wait complete. 2023-07-07T18:14:51.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:14:51.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.968+0000 7f3a83edd700 1 Processor -- start 2023-07-07T18:14:51.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.969+0000 7f3a83edd700 1 -- start start 2023-07-07T18:14:51.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.969+0000 7f3a83edd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c0caf00 0x7f3a7c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.969+0000 7f3a83edd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3a7c15b130 0x7f3a7c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.969+0000 7f3a83edd700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a7c0d1210 con 0x7f3a7c15a820 2023-07-07T18:14:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.969+0000 7f3a83edd700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7c15b570 con 0x7f3a7c15b130 2023-07-07T18:14:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.969+0000 7f3a83edd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c154a80 con 0x7f3a7c0caf00 2023-07-07T18:14:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.969+0000 7f3a8247a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3a7c15b130 0x7f3a7c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a8247a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3a7c15b130 0x7f3a7c0ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56824/0 (socket says 172.21.15.12:56824) 2023-07-07T18:14:51.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a8247a700 1 -- 172.21.15.12:0/2521185072 learned_addr learned my addr 172.21.15.12:0/2521185072 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a81478700 1 --2- 172.21.15.12:0/2521185072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c0caf00 0x7f3a7c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a8247a700 1 -- 172.21.15.12:0/2521185072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c0caf00 msgr2=0x7f3a7c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a8247a700 1 --2- 172.21.15.12:0/2521185072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c0caf00 0x7f3a7c15abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a8247a700 1 -- 172.21.15.12:0/2521185072 >> v1:172.21.15.160:6789/0 conn(0x7f3a7c15a820 legacy=0x7f3a7c0d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a8247a700 1 -- 172.21.15.12:0/2521185072 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c0cb350 con 0x7f3a7c15b130 2023-07-07T18:14:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a81478700 1 --2- 172.21.15.12:0/2521185072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c0caf00 0x7f3a7c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:51.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a8247a700 1 --2- 172.21.15.12:0/2521185072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c15b130 0x7f3a7c0ce480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009e50 tx=0x7f3a7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836a1d3bc9a4380a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a80c77700 1 -- 172.21.15.12:0/2521185072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7400e070 con 0x7f3a7c15b130 2023-07-07T18:14:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a80c77700 1 -- 172.21.15.12:0/2521185072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a74003a20 con 0x7f3a7c15b130 2023-07-07T18:14:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.970+0000 7f3a80c77700 1 -- 172.21.15.12:0/2521185072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a74003dd0 con 0x7f3a7c15b130 2023-07-07T18:14:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.971+0000 7f3a83edd700 1 -- 172.21.15.12:0/2521185072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c15b130 msgr2=0x7f3a7c0ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.971+0000 7f3a83edd700 1 --2- 172.21.15.12:0/2521185072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c15b130 0x7f3a7c0ce480 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009e50 tx=0x7f3a7400b330 comp rx=0 tx=0).stop 2023-07-07T18:14:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.971+0000 7f3a83edd700 1 -- 172.21.15.12:0/2521185072 shutdown_connections 2023-07-07T18:14:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.971+0000 7f3a83edd700 1 --2- 172.21.15.12:0/2521185072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c15b130 0x7f3a7c0ce480 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.971+0000 7f3a83edd700 1 --2- 172.21.15.12:0/2521185072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c0caf00 0x7f3a7c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.971+0000 7f3a83edd700 1 -- 172.21.15.12:0/2521185072 >> 172.21.15.12:0/2521185072 conn(0x7f3a7c06e530 msgr2=0x7f3a7c06e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:51.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.971+0000 7f3a83edd700 1 -- 172.21.15.12:0/2521185072 shutdown_connections 2023-07-07T18:14:51.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.971+0000 7f3a83edd700 1 -- 172.21.15.12:0/2521185072 wait complete. 2023-07-07T18:14:51.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.972+0000 7f3a83edd700 1 Processor -- start 2023-07-07T18:14:51.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.972+0000 7f3a83edd700 1 -- start start 2023-07-07T18:14:51.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a83edd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c0caf00 0x7f3a7c0b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a83edd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c15a820 0x7f3a7c147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a83edd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a7c15b130 0x7f3a7c1eea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a83edd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0c7640 con 0x7f3a7c0caf00 2023-07-07T18:14:51.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a83edd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0c65a0 con 0x7f3a7c15b130 2023-07-07T18:14:51.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a83edd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0c6880 con 0x7f3a7c15a820 2023-07-07T18:14:51.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81c79700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c0caf00 0x7f3a7c0b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81c79700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c0caf00 0x7f3a7c0b1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56826/0 (socket says 172.21.15.12:56826) 2023-07-07T18:14:51.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81c79700 1 -- 172.21.15.12:0/2856603156 learned_addr learned my addr 172.21.15.12:0/2856603156 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:51.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81478700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c15a820 0x7f3a7c147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a8247a700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a7c15b130 0x7f3a7c1eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81c79700 1 -- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c15a820 msgr2=0x7f3a7c147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81c79700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c15a820 0x7f3a7c147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81c79700 1 -- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a7c15b130 msgr2=0x7f3a7c1eea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:51.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81c79700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a7c15b130 0x7f3a7c1eea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:51.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81c79700 1 -- 172.21.15.12:0/2856603156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74009b30 con 0x7f3a7c0caf00 2023-07-07T18:14:51.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a8247a700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a7c15b130 0x7f3a7c1eea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:51.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a81c79700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c0caf00 0x7f3a7c0b1960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c4d0 tx=0x7f3a6c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:51.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a727fc700 1 -- 172.21.15.12:0/2856603156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c011790 con 0x7f3a7c0caf00 2023-07-07T18:14:51.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a727fc700 1 -- 172.21.15.12:0/2856603156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0118f0 con 0x7f3a7c0caf00 2023-07-07T18:14:51.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c0c6b60 con 0x7f3a7c0caf00 2023-07-07T18:14:51.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.973+0000 7f3a727fc700 1 -- 172.21.15.12:0/2856603156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c011ca0 con 0x7f3a7c0caf00 2023-07-07T18:14:51.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.974+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7c0c7120 con 0x7f3a7c0caf00 2023-07-07T18:14:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.974+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7c073910 con 0x7f3a7c0caf00 2023-07-07T18:14:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.975+0000 7f3a727fc700 1 -- 172.21.15.12:0/2856603156 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a6c01c460 con 0x7f3a7c0caf00 2023-07-07T18:14:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.975+0000 7f3a727fc700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3a6006ace0 0x7f3a6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.975+0000 7f3a727fc700 1 -- 172.21.15.12:0/2856603156 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3a6c089520 con 0x7f3a7c0caf00 2023-07-07T18:14:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.976+0000 7f3a81478700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3a6006ace0 0x7f3a6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:51.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.976+0000 7f3a81478700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3a6006ace0 0x7f3a6006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0b6740 tx=0x7f3a78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:51.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:51.980+0000 7f3a727fc700 1 -- 172.21.15.12:0/2856603156 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3a6c054370 con 0x7f3a7c0caf00 2023-07-07T18:14:52.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.218+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a7c153250 con 0x7f3a7c0caf00 2023-07-07T18:14:52.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.219+0000 7f3a727fc700 1 -- 172.21.15.12:0/2856603156 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f3a6c057990 con 0x7f3a7c0caf00 2023-07-07T18:14:52.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:52.220 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:14:50.685777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-07T18:14:52.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3a6006ace0 msgr2=0x7f3a6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:52.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3a6006ace0 0x7f3a6006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0b6740 tx=0x7f3a78008040 comp rx=0 tx=0).stop 2023-07-07T18:14:52.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c0caf00 msgr2=0x7f3a7c0b1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:52.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c0caf00 0x7f3a7c0b1960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c4d0 tx=0x7f3a6c00c890 comp rx=0 tx=0).stop 2023-07-07T18:14:52.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 shutdown_connections 2023-07-07T18:14:52.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3a6006ace0 0x7f3a6006d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a7c15b130 0x7f3a7c1eea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a7c0caf00 0x7f3a7c0b1960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 --2- 172.21.15.12:0/2856603156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a7c15a820 0x7f3a7c147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 >> 172.21.15.12:0/2856603156 conn(0x7f3a7c06e530 msgr2=0x7f3a7c153d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 shutdown_connections 2023-07-07T18:14:52.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.221+0000 7f3a83edd700 1 -- 172.21.15.12:0/2856603156 wait complete. 2023-07-07T18:14:52.226 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 7 2023-07-07T18:14:52.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:52.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.358+0000 7f7119ea7700 1 Processor -- start 2023-07-07T18:14:52.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.358+0000 7f7119ea7700 1 -- start start 2023-07-07T18:14:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f7119ea7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f711415c570 0x7f71140cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f7119ea7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7114160a50 0x7f71140d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:52.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f7119ea7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71141610a0 con 0x7f71140cd660 2023-07-07T18:14:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f7119ea7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711415d670 con 0x7f711415c570 2023-07-07T18:14:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f7119ea7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7114160eb0 con 0x7f7114160a50 2023-07-07T18:14:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f71137fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f711415c570 0x7f71140cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:52.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f71137fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f711415c570 0x7f71140cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56834/0 (socket says 172.21.15.12:56834) 2023-07-07T18:14:52.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f71137fe700 1 -- 172.21.15.12:0/4121827336 learned_addr learned my addr 172.21.15.12:0/4121827336 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:52.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f7113fff700 1 --2- 172.21.15.12:0/4121827336 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7114160a50 0x7f71140d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:52.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f71137fe700 1 -- 172.21.15.12:0/4121827336 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7114160a50 msgr2=0x7f71140d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:52.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f71137fe700 1 --2- 172.21.15.12:0/4121827336 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7114160a50 0x7f71140d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f71137fe700 1 -- 172.21.15.12:0/4121827336 >> v1:172.21.15.160:6789/0 conn(0x7f71140cd660 legacy=0x7f7114160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:52.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f71137fe700 1 -- 172.21.15.12:0/4121827336 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711415da90 con 0x7f711415c570 2023-07-07T18:14:52.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.359+0000 7f71137fe700 1 --2- 172.21.15.12:0/4121827336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 0x7f71140cd120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7104009920 tx=0x7f7104009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774b67d791f10d67 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:52.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f71127fc700 1 -- 172.21.15.12:0/4121827336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710400ba20 con 0x7f711415c570 2023-07-07T18:14:52.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f71127fc700 1 -- 172.21.15.12:0/4121827336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710400bb80 con 0x7f711415c570 2023-07-07T18:14:52.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f71127fc700 1 -- 172.21.15.12:0/4121827336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7104009e70 con 0x7f711415c570 2023-07-07T18:14:52.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f7119ea7700 1 -- 172.21.15.12:0/4121827336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 msgr2=0x7f71140cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:52.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f7119ea7700 1 --2- 172.21.15.12:0/4121827336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 0x7f71140cd120 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7104009920 tx=0x7f7104009c30 comp rx=0 tx=0).stop 2023-07-07T18:14:52.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f7119ea7700 1 -- 172.21.15.12:0/4121827336 shutdown_connections 2023-07-07T18:14:52.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f7119ea7700 1 --2- 172.21.15.12:0/4121827336 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7114160a50 0x7f71140d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f7119ea7700 1 --2- 172.21.15.12:0/4121827336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 0x7f71140cd120 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f7119ea7700 1 -- 172.21.15.12:0/4121827336 >> 172.21.15.12:0/4121827336 conn(0x7f7114071620 msgr2=0x7f71140719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:52.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f7119ea7700 1 -- 172.21.15.12:0/4121827336 shutdown_connections 2023-07-07T18:14:52.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.360+0000 7f7119ea7700 1 -- 172.21.15.12:0/4121827336 wait complete. 2023-07-07T18:14:52.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.361+0000 7f7119ea7700 1 Processor -- start 2023-07-07T18:14:52.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7119ea7700 1 -- start start 2023-07-07T18:14:52.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7119ea7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71140cd660 0x7f71140c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:52.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7119ea7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 0x7f7114149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:52.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7119ea7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7114160a50 0x7f71141e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:52.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7119ea7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711414a4b0 con 0x7f711415c570 2023-07-07T18:14:52.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7119ea7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71141e6dd0 con 0x7f7114160a50 2023-07-07T18:14:52.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7119ea7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7114157420 con 0x7f71140cd660 2023-07-07T18:14:52.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7112ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 0x7f7114149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:52.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7112ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 0x7f7114149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56838/0 (socket says 172.21.15.12:56838) 2023-07-07T18:14:52.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.362+0000 7f7112ffd700 1 -- 172.21.15.12:0/489957395 learned_addr learned my addr 172.21.15.12:0/489957395 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:52.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7113fff700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7114160a50 0x7f71141e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:52.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f71137fe700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71140cd660 0x7f71140c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:52.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7112ffd700 1 -- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71140cd660 msgr2=0x7f71140c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:52.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7112ffd700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71140cd660 0x7f71140c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7112ffd700 1 -- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7114160a50 msgr2=0x7f71141e5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7112ffd700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7114160a50 0x7f71141e5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7112ffd700 1 -- 172.21.15.12:0/489957395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104009550 con 0x7f711415c570 2023-07-07T18:14:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7113fff700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7114160a50 0x7f71141e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7112ffd700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 0x7f7114149f70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c4e0 tx=0x7f70fc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f710bfff700 1 -- 172.21.15.12:0/489957395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0052d0 con 0x7f711415c570 2023-07-07T18:14:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f710bfff700 1 -- 172.21.15.12:0/489957395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70fc005430 con 0x7f711415c570 2023-07-07T18:14:52.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71141e6af0 con 0x7f711415c570 2023-07-07T18:14:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f710bfff700 1 -- 172.21.15.12:0/489957395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70fc0038c0 con 0x7f711415c570 2023-07-07T18:14:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.363+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71140c6a10 con 0x7f711415c570 2023-07-07T18:14:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.364+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71140ce3d0 con 0x7f711415c570 2023-07-07T18:14:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.364+0000 7f710bfff700 1 -- 172.21.15.12:0/489957395 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70fc003a20 con 0x7f711415c570 2023-07-07T18:14:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.365+0000 7f710bfff700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f70f406ace0 0x7f70f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.365+0000 7f710bfff700 1 -- 172.21.15.12:0/489957395 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f70fc088b10 con 0x7f711415c570 2023-07-07T18:14:52.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.365+0000 7f71137fe700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f70f406ace0 0x7f70f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:52.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.365+0000 7f71137fe700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f70f406ace0 0x7f70f406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7104000c00 tx=0x7f7104008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:52.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.369+0000 7f710bfff700 1 -- 172.21.15.12:0/489957395 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f70fc053960 con 0x7f711415c570 2023-07-07T18:14:52.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.573+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71140b5150 con 0x7f711415c570 2023-07-07T18:14:52.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.575+0000 7f710bfff700 1 -- 172.21.15.12:0/489957395 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f70fc056f80 con 0x7f711415c570 2023-07-07T18:14:52.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:52.576 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:52.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f70f406ace0 msgr2=0x7f70f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:52.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f70f406ace0 0x7f70f406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7104000c00 tx=0x7f7104008030 comp rx=0 tx=0).stop 2023-07-07T18:14:52.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 msgr2=0x7f7114149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:52.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 0x7f7114149f70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00c4e0 tx=0x7f70fc00c7f0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 shutdown_connections 2023-07-07T18:14:52.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f70f406ace0 0x7f70f406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7114160a50 0x7f71141e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f71140cd660 0x7f71140c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 --2- 172.21.15.12:0/489957395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f711415c570 0x7f7114149f70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:52.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 >> 172.21.15.12:0/489957395 conn(0x7f7114071620 msgr2=0x7f71140d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:52.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 shutdown_connections 2023-07-07T18:14:52.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:52.577+0000 7f7119ea7700 1 -- 172.21.15.12:0/489957395 wait complete. 2023-07-07T18:14:52.994 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-07T18:14:46.226517+0000', 'modified': '2023-07-07T18:14:50.685777+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6837/3361031905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6835', 'nonce': 3361031905}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 3361031905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-07T18:14:52.994 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-07T18:14:52.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-07T18:14:53.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.127+0000 7f5a37ddb700 1 Processor -- start 2023-07-07T18:14:53.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.127+0000 7f5a37ddb700 1 -- start start 2023-07-07T18:14:53.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.128+0000 7f5a37ddb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a30156880 0x7f5a30069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.128+0000 7f5a37ddb700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300cee80 con 0x7f5a300cc1d0 2023-07-07T18:14:53.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.128+0000 7f5a37ddb700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300cf100 con 0x7f5a300aed30 2023-07-07T18:14:53.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.128+0000 7f5a37ddb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300cf3e0 con 0x7f5a30156880 2023-07-07T18:14:53.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.128+0000 7f5a36378700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5a300cc1d0 0x7f5a3015cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54044/0 (socket says 172.21.15.12:54044) 2023-07-07T18:14:53.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.128+0000 7f5a36378700 1 -- 172.21.15.12:0/3213504056 learned_addr learned my addr 172.21.15.12:0/3213504056 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:53.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.128+0000 7f5a35b77700 1 --2- 172.21.15.12:0/3213504056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a30156880 0x7f5a30069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.128+0000 7f5a34b75700 1 -- 172.21.15.12:0/3213504056 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593369397 0 0) 0x7f5a300cee80 con 0x7f5a300cc1d0 2023-07-07T18:14:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.128+0000 7f5a34b75700 1 -- 172.21.15.12:0/3213504056 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a1c0035b0 con 0x7f5a300cc1d0 2023-07-07T18:14:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.129+0000 7f5a34b75700 1 -- 172.21.15.12:0/3213504056 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181124020 0 0) 0x7f5a300cf100 con 0x7f5a300aed30 2023-07-07T18:14:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.129+0000 7f5a35b77700 1 -- 172.21.15.12:0/3213504056 >> v1:172.21.15.160:6789/0 conn(0x7f5a300aed30 legacy=0x7f5a30160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.129+0000 7f5a35b77700 1 -- 172.21.15.12:0/3213504056 >> v1:172.21.15.12:6789/0 conn(0x7f5a300cc1d0 legacy=0x7f5a3015cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.129+0000 7f5a35b77700 1 -- 172.21.15.12:0/3213504056 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300cd390 con 0x7f5a30156880 2023-07-07T18:14:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.129+0000 7f5a35b77700 1 --2- 172.21.15.12:0/3213504056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a30156880 0x7f5a30069ef0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009870 tx=0x7f5a20009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=703b727c5cc688db server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.129+0000 7f5a34b75700 1 -- 172.21.15.12:0/3213504056 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a280019f0 con 0x7f5a30156880 2023-07-07T18:14:53.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.129+0000 7f5a34b75700 1 -- 172.21.15.12:0/3213504056 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20004030 con 0x7f5a30156880 2023-07-07T18:14:53.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.129+0000 7f5a34b75700 1 -- 172.21.15.12:0/3213504056 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a200043a0 con 0x7f5a30156880 2023-07-07T18:14:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.129+0000 7f5a37ddb700 1 -- 172.21.15.12:0/3213504056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a30156880 msgr2=0x7f5a30069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.130+0000 7f5a37ddb700 1 --2- 172.21.15.12:0/3213504056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a30156880 0x7f5a30069ef0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009870 tx=0x7f5a20009b80 comp rx=0 tx=0).stop 2023-07-07T18:14:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.130+0000 7f5a37ddb700 1 -- 172.21.15.12:0/3213504056 shutdown_connections 2023-07-07T18:14:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.130+0000 7f5a37ddb700 1 --2- 172.21.15.12:0/3213504056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a30156880 0x7f5a30069ef0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.130+0000 7f5a37ddb700 1 -- 172.21.15.12:0/3213504056 >> 172.21.15.12:0/3213504056 conn(0x7f5a3006d4a0 msgr2=0x7f5a3006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.130+0000 7f5a37ddb700 1 -- 172.21.15.12:0/3213504056 shutdown_connections 2023-07-07T18:14:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.130+0000 7f5a37ddb700 1 -- 172.21.15.12:0/3213504056 wait complete. 2023-07-07T18:14:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.131+0000 7f5a37ddb700 1 Processor -- start 2023-07-07T18:14:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.131+0000 7f5a37ddb700 1 -- start start 2023-07-07T18:14:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a37ddb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a300aed30 0x7f5a300ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a37ddb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a300cc1d0 0x7f5a3015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a37ddb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30156880 0x7f5a300ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a37ddb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3015ace0 con 0x7f5a30156880 2023-07-07T18:14:53.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a37ddb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3015afc0 con 0x7f5a300aed30 2023-07-07T18:14:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a37ddb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3015b2a0 con 0x7f5a300cc1d0 2023-07-07T18:14:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a36378700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30156880 0x7f5a300ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a35b77700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a300aed30 0x7f5a300ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a35b77700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a300aed30 0x7f5a300ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:52454/0 (socket says 172.21.15.12:52454) 2023-07-07T18:14:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a36378700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30156880 0x7f5a300ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56852/0 (socket says 172.21.15.12:56852) 2023-07-07T18:14:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a35b77700 1 -- 172.21.15.12:0/2834010212 learned_addr learned my addr 172.21.15.12:0/2834010212 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:53.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a35376700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a300cc1d0 0x7f5a3015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a36378700 1 -- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a300cc1d0 msgr2=0x7f5a3015a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a36378700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a300cc1d0 0x7f5a3015a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a36378700 1 -- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a300aed30 msgr2=0x7f5a300ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a36378700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a300aed30 0x7f5a300ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a36378700 1 -- 172.21.15.12:0/2834010212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a200094a0 con 0x7f5a30156880 2023-07-07T18:14:53.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a36378700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30156880 0x7f5a300ab8d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a28001fd0 tx=0x7f5a2800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a267fc700 1 -- 172.21.15.12:0/2834010212 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800acd0 con 0x7f5a30156880 2023-07-07T18:14:53.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a267fc700 1 -- 172.21.15.12:0/2834010212 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800ae30 con 0x7f5a30156880 2023-07-07T18:14:53.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a37ddb700 1 -- 172.21.15.12:0/2834010212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3015b580 con 0x7f5a30156880 2023-07-07T18:14:53.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.132+0000 7f5a267fc700 1 -- 172.21.15.12:0/2834010212 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28007310 con 0x7f5a30156880 2023-07-07T18:14:53.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.133+0000 7f5a37ddb700 1 -- 172.21.15.12:0/2834010212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a301501b0 con 0x7f5a30156880 2023-07-07T18:14:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.134+0000 7f5a267fc700 1 -- 172.21.15.12:0/2834010212 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a28007470 con 0x7f5a30156880 2023-07-07T18:14:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.134+0000 7f5a267fc700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5a1406ace0 0x7f5a1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.134+0000 7f5a267fc700 1 -- 172.21.15.12:0/2834010212 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5a28089730 con 0x7f5a30156880 2023-07-07T18:14:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.134+0000 7f5a35b77700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5a1406ace0 0x7f5a1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.135+0000 7f5a35b77700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5a1406ace0 0x7f5a1406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009bc0 tx=0x7f5a20008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a43f60b80 1 Processor -- start 2023-07-07T18:14:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a43f60b80 1 -- start start 2023-07-07T18:14:53.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe45f50 0x55fa2fe46320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe6dd80 0x55fa2fe6c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2fe70440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fd4ac60 con 0x55fa2fe45f50 2023-07-07T18:14:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fd9d9f0 con 0x55fa2fe43740 2023-07-07T18:14:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fd96e80 con 0x55fa2fe6dd80 2023-07-07T18:14:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a35b77700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe45f50 0x55fa2fe46320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a35b77700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe45f50 0x55fa2fe46320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56856/0 (socket says 172.21.15.12:56856) 2023-07-07T18:14:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.137+0000 7f5a35b77700 1 -- 172.21.15.12:0/1350608638 learned_addr learned my addr 172.21.15.12:0/1350608638 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:53.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a35376700 1 --2- 172.21.15.12:0/1350608638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe6dd80 0x55fa2fe6c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a36378700 1 --2- 172.21.15.12:0/1350608638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2fe70440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a35b77700 1 -- 172.21.15.12:0/1350608638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe6dd80 msgr2=0x55fa2fe6c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:53.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a35b77700 1 --2- 172.21.15.12:0/1350608638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe6dd80 0x55fa2fe6c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a35b77700 1 -- 172.21.15.12:0/1350608638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 msgr2=0x55fa2fe70440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:53.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a35b77700 1 --2- 172.21.15.12:0/1350608638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2fe70440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a35b77700 1 -- 172.21.15.12:0/1350608638 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa2fc185e0 con 0x55fa2fe45f50 2023-07-07T18:14:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a35b77700 1 --2- 172.21.15.12:0/1350608638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe45f50 0x55fa2fe46320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009ed0 tx=0x7f5a20010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5e7373bc633357 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a137fe700 1 -- 172.21.15.12:0/1350608638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20010590 con 0x55fa2fe45f50 2023-07-07T18:14:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a137fe700 1 -- 172.21.15.12:0/1350608638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a200106f0 con 0x55fa2fe45f50 2023-07-07T18:14:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.138+0000 7f5a137fe700 1 -- 172.21.15.12:0/1350608638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a20010a60 con 0x55fa2fe45f50 2023-07-07T18:14:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 -- 172.21.15.12:0/1350608638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe45f50 msgr2=0x55fa2fe46320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/1350608638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe45f50 0x55fa2fe46320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009ed0 tx=0x7f5a20010000 comp rx=0 tx=0).stop 2023-07-07T18:14:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 -- 172.21.15.12:0/1350608638 shutdown_connections 2023-07-07T18:14:53.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/1350608638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2fe70440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/1350608638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe45f50 0x55fa2fe46320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/1350608638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe6dd80 0x55fa2fe6c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 -- 172.21.15.12:0/1350608638 >> 172.21.15.12:0/1350608638 conn(0x55fa2fe3afc0 msgr2=0x55fa2fe8b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 -- 172.21.15.12:0/1350608638 shutdown_connections 2023-07-07T18:14:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 -- 172.21.15.12:0/1350608638 wait complete. 2023-07-07T18:14:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 -- start start 2023-07-07T18:14:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.139+0000 7f5a43f60b80 1 Processor -- start 2023-07-07T18:14:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.140+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe43740 0x55fa2fe8dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.140+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe45f50 0x55fa2fe83a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.140+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe83f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.140+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fd36a70 con 0x55fa2fe6dd80 2023-07-07T18:14:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.140+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fd36770 con 0x55fa2fe45f50 2023-07-07T18:14:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.140+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fc1a8d0 con 0x55fa2fe43740 2023-07-07T18:14:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a43f60b80 10 client.0 _ll_register_callbacks cb 0x55fa2fd3c210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-07T18:14:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a36378700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe83f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a36378700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe83f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56866/0 (socket says 172.21.15.12:56866) 2023-07-07T18:14:53.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a36378700 1 -- 172.21.15.12:0/2689757219 learned_addr learned my addr 172.21.15.12:0/2689757219 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a35b77700 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe43740 0x55fa2fe8dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a35376700 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe45f50 0x55fa2fe83a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a36378700 1 -- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe43740 msgr2=0x55fa2fe8dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a36378700 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe43740 0x55fa2fe8dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a36378700 1 -- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe45f50 msgr2=0x55fa2fe83a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a36378700 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe45f50 0x55fa2fe83a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a36378700 1 -- 172.21.15.12:0/2689757219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a300cd390 con 0x55fa2fe6dd80 2023-07-07T18:14:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a36378700 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe83f40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800a690 tx=0x7f5a280578e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadfc95268b825d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-07-07T18:14:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a10ff9700 1 -- 172.21.15.12:0/2689757219 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28087d90 con 0x55fa2fe6dd80 2023-07-07T18:14:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a10ff9700 1 -- 172.21.15.12:0/2689757219 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5a28007720 con 0x55fa2fe6dd80 2023-07-07T18:14:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a43f60b80 1 -- 172.21.15.12:0/2689757219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa2fe38780 con 0x55fa2fe6dd80 2023-07-07T18:14:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a10ff9700 1 -- 172.21.15.12:0/2689757219 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a280604e0 con 0x55fa2fe6dd80 2023-07-07T18:14:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a43f60b80 10 client.4440 fetch_fsmap learned FSMap version 7 2023-07-07T18:14:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a43f60b80 1 -- 172.21.15.12:0/2689757219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55fa2fbc4d90 con 0x55fa2fe6dd80 2023-07-07T18:14:53.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a10ff9700 1 -- 172.21.15.12:0/2689757219 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa2fe38780 con 0x55fa2fe6dd80 2023-07-07T18:14:53.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a10ff9700 1 -- 172.21.15.12:0/2689757219 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5a280078e0 con 0x55fa2fe6dd80 2023-07-07T18:14:53.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.141+0000 7f5a43f60b80 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2023-07-07T18:14:53.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.142+0000 7f5a43f60b80 10 client.4440 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-07T18:14:53.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.142+0000 7f5a43f60b80 20 client.4440 populate_metadata read hostname 'smithi012' 2023-07-07T18:14:53.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.142+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x55fa2fe8a210 0x55fa2fe8cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.142+0000 7f5a43f60b80 4 client.4440 mds_command: new command op to 4296 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-07T18:14:53.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.142+0000 7f5a43f60b80 1 -- 172.21.15.12:0/2689757219 --> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa2fd8fe60 con 0x55fa2fe8a210 2023-07-07T18:14:53.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.142+0000 7f5a35b77700 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x55fa2fe8a210 0x55fa2fe8cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.142+0000 7f5a10ff9700 10 client.4440 ms_handle_connect on v2:172.21.15.160:6835/3361031905 2023-07-07T18:14:53.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.142+0000 7f5a35b77700 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x55fa2fe8a210 0x55fa2fe8cf10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b40a83d56c96e11 server_cookie=2748ee242cf1ee00 in_seq=0 out_seq=0 2023-07-07T18:14:53.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a10ff9700 1 -- 172.21.15.12:0/2689757219 <== mds.0 v2:172.21.15.160:6835/3361031905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fa2fd8fe60 con 0x55fa2fe8a210 2023-07-07T18:14:53.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a10ff9700 10 client.4440 handle_command_reply: tid=0 2023-07-07T18:14:53.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 client.4440 shutdown 2023-07-07T18:14:53.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 -- 172.21.15.12:0/2689757219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 msgr2=0x55fa2fe83f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe83f40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800a690 tx=0x7f5a280578e0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 -- 172.21.15.12:0/2689757219 shutdown_connections 2023-07-07T18:14:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe83f40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe43740 0x55fa2fe8dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x55fa2fe8a210 0x55fa2fe8cf10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/2689757219 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe45f50 0x55fa2fe83a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a10ff9700 0 client.4440 ms_handle_reset on v2:172.21.15.160:6835/3361031905 2023-07-07T18:14:53.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 -- 172.21.15.12:0/2689757219 >> 172.21.15.12:0/2689757219 conn(0x55fa2fe3afc0 msgr2=0x55fa2fe6cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:53.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 -- 172.21.15.12:0/2689757219 shutdown_connections 2023-07-07T18:14:53.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 1 -- 172.21.15.12:0/2689757219 wait complete. 2023-07-07T18:14:53.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.143+0000 7f5a43f60b80 20 client.4440 trim_cache size 0 max 16384 2023-07-07T18:14:53.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.161+0000 7f5a43f60b80 1 Processor -- start 2023-07-07T18:14:53.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.161+0000 7f5a43f60b80 1 -- start start 2023-07-07T18:14:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2fe8cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 0x55fa2fe680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe6c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fe8ee90 con 0x55fa2fe6dd80 2023-07-07T18:14:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fe38360 con 0x55fa2fe43740 2023-07-07T18:14:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fe841e0 con 0x55fa2fe45f50 2023-07-07T18:14:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a36378700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe6c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a36378700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe6c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56874/0 (socket says 172.21.15.12:56874) 2023-07-07T18:14:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a36378700 1 -- 172.21.15.12:0/3388086907 learned_addr learned my addr 172.21.15.12:0/3388086907 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a35b77700 1 --2- 172.21.15.12:0/3388086907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2fe8cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a35376700 1 --2- 172.21.15.12:0/3388086907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 0x55fa2fe680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a36378700 1 -- 172.21.15.12:0/3388086907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 msgr2=0x55fa2fe680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:53.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a36378700 1 --2- 172.21.15.12:0/3388086907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 0x55fa2fe680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a36378700 1 -- 172.21.15.12:0/3388086907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 msgr2=0x55fa2fe8cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.162+0000 7f5a36378700 1 --2- 172.21.15.12:0/3388086907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2fe8cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a36378700 1 -- 172.21.15.12:0/3388086907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa2fbadc10 con 0x55fa2fe6dd80 2023-07-07T18:14:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a36378700 1 --2- 172.21.15.12:0/3388086907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe6c230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a28057a00 tx=0x7f5a28015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ba0f27898c4d0d server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a13fff700 1 -- 172.21.15.12:0/3388086907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28087d90 con 0x55fa2fe6dd80 2023-07-07T18:14:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a13fff700 1 -- 172.21.15.12:0/3388086907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28060460 con 0x55fa2fe6dd80 2023-07-07T18:14:53.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a13fff700 1 -- 172.21.15.12:0/3388086907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28007920 con 0x55fa2fe6dd80 2023-07-07T18:14:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3388086907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 msgr2=0x55fa2fe6c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3388086907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe6c230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a28057a00 tx=0x7f5a28015000 comp rx=0 tx=0).stop 2023-07-07T18:14:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3388086907 shutdown_connections 2023-07-07T18:14:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3388086907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe6c230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3388086907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2fe8cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3388086907 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 0x55fa2fe680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3388086907 >> 172.21.15.12:0/3388086907 conn(0x55fa2fe3afc0 msgr2=0x55fa2feacde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:53.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3388086907 shutdown_connections 2023-07-07T18:14:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.163+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3388086907 wait complete. 2023-07-07T18:14:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.164+0000 7f5a43f60b80 1 -- start start 2023-07-07T18:14:53.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.164+0000 7f5a43f60b80 1 Processor -- start 2023-07-07T18:14:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2feeb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 0x55fa2fe87a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a43f60b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe43b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fef5380 con 0x55fa2fe6dd80 2023-07-07T18:14:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fe83530 con 0x55fa2fe43740 2023-07-07T18:14:53.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a43f60b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa2fe680f0 con 0x55fa2fe45f50 2023-07-07T18:14:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a43f60b80 10 client.0 _ll_register_callbacks cb 0x55fa2fd3c210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-07T18:14:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a36378700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe43b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a36378700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe43b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56880/0 (socket says 172.21.15.12:56880) 2023-07-07T18:14:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a35376700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 0x55fa2fe87a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a36378700 1 -- 172.21.15.12:0/3552858686 learned_addr learned my addr 172.21.15.12:0/3552858686 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:53.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a35b77700 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2feeb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a36378700 1 -- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 msgr2=0x55fa2fe87a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a36378700 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 0x55fa2fe87a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a36378700 1 -- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 msgr2=0x55fa2feeb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a36378700 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2feeb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a36378700 1 -- 172.21.15.12:0/3552858686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa2fbc4d90 con 0x55fa2fe6dd80 2023-07-07T18:14:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a36378700 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe43b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a28054610 tx=0x7f5a28087640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db255cd87753115c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.165+0000 7f5a10ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-07-07T18:14:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a10ff9700 1 -- 172.21.15.12:0/3552858686 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28053f00 con 0x55fa2fe6dd80 2023-07-07T18:14:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a10ff9700 1 -- 172.21.15.12:0/3552858686 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5a28054060 con 0x55fa2fe6dd80 2023-07-07T18:14:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3552858686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a200106f0 con 0x55fa2fe6dd80 2023-07-07T18:14:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a10ff9700 1 -- 172.21.15.12:0/3552858686 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a28054220 con 0x55fa2fe6dd80 2023-07-07T18:14:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a43f60b80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-07-07T18:14:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3552858686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55fa2fbeb200 con 0x55fa2fe6dd80 2023-07-07T18:14:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a10ff9700 1 -- 172.21.15.12:0/3552858686 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a200106f0 con 0x55fa2fe6dd80 2023-07-07T18:14:53.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a10ff9700 1 -- 172.21.15.12:0/3552858686 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5a28057070 con 0x55fa2fe6dd80 2023-07-07T18:14:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a43f60b80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-07-07T18:14:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a43f60b80 10 client.4446 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-07T18:14:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a43f60b80 20 client.4446 populate_metadata read hostname 'smithi012' 2023-07-07T18:14:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x55fa2fef1b10 0x55fa2fef1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a43f60b80 4 client.4446 mds_command: new command op to 4296 tid=0[{"prefix": "status"}] 2023-07-07T18:14:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3552858686 --> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fa2fd52000 con 0x55fa2fef1b10 2023-07-07T18:14:53.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.166+0000 7f5a35b77700 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x55fa2fef1b10 0x55fa2fef1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a10ff9700 10 client.4446 ms_handle_connect on v2:172.21.15.160:6835/3361031905 2023-07-07T18:14:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a35b77700 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x55fa2fef1b10 0x55fa2fef1ee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdc0b10b144f31b8 server_cookie=c6f4cb43c6c9a894 in_seq=0 out_seq=0 2023-07-07T18:14:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a10ff9700 1 -- 172.21.15.12:0/3552858686 <== mds.0 v2:172.21.15.160:6835/3361031905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55fa2fd52000 con 0x55fa2fef1b10 2023-07-07T18:14:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a10ff9700 10 client.4446 handle_command_reply: tid=0 2023-07-07T18:14:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 client.4446 shutdown 2023-07-07T18:14:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3552858686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 msgr2=0x55fa2fe43b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe43b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a28054610 tx=0x7f5a28087640 comp rx=0 tx=0).stop 2023-07-07T18:14:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3552858686 shutdown_connections 2023-07-07T18:14:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fa2fe6dd80 0x55fa2fe43b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x55fa2fef1b10 0x55fa2fef1ee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fa2fe43740 0x55fa2feeb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a10ff9700 0 client.4446 ms_handle_reset on v2:172.21.15.160:6835/3361031905 2023-07-07T18:14:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 --2- 172.21.15.12:0/3552858686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fa2fe45f50 0x55fa2fe87a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3552858686 >> 172.21.15.12:0/3552858686 conn(0x55fa2fe3afc0 msgr2=0x55fa2feacde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3552858686 shutdown_connections 2023-07-07T18:14:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 1 -- 172.21.15.12:0/3552858686 wait complete. 2023-07-07T18:14:53.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.167+0000 7f5a43f60b80 20 client.4446 trim_cache size 0 max 16384 2023-07-07T18:14:53.179 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-07-07T18:14:53.179 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "6f09c1a9-a759-4e94-bed7-68b16c28b7f9", 2023-07-07T18:14:53.179 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-07-07T18:14:53.180 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4296, 2023-07-07T18:14:53.180 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-07-07T18:14:53.180 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-07-07T18:14:53.180 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-07-07T18:14:53.180 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 6.9389095149999998, 2023-07-07T18:14:53.180 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 7, 2023-07-07T18:14:53.180 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 29, 2023-07-07T18:14:53.181 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 28, 2023-07-07T18:14:53.181 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 12.403870899999999 2023-07-07T18:14:53.181 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-07-07T18:14:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 -- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5a1406ace0 msgr2=0x7f5a1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5a1406ace0 0x7f5a1406d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a20009bc0 tx=0x7f5a20008000 comp rx=0 tx=0).stop 2023-07-07T18:14:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 -- 172.21.15.12:0/2834010212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30156880 msgr2=0x7f5a300ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30156880 0x7f5a300ab8d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5a28001fd0 tx=0x7f5a2800a340 comp rx=0 tx=0).stop 2023-07-07T18:14:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 -- 172.21.15.12:0/2834010212 shutdown_connections 2023-07-07T18:14:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5a1406ace0 0x7f5a1406d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30156880 0x7f5a300ab8d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a300aed30 0x7f5a300ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 --2- 172.21.15.12:0/2834010212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a300cc1d0 0x7f5a3015a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 -- 172.21.15.12:0/2834010212 >> 172.21.15.12:0/2834010212 conn(0x7f5a3006d4a0 msgr2=0x7f5a300b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:53.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 -- 172.21.15.12:0/2834010212 shutdown_connections 2023-07-07T18:14:53.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.168+0000 7f5a37ddb700 1 -- 172.21.15.12:0/2834010212 wait complete. 2023-07-07T18:14:53.184 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-07T18:14:53.185 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-07T18:14:53.185 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-07T18:14:53.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.309+0000 7f0e9fac4700 1 Processor -- start 2023-07-07T18:14:53.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.309+0000 7f0e9fac4700 1 -- start start 2023-07-07T18:14:53.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9fac4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 0x7f0e98069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9fac4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e980cc1d0 0x7f0e980cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9fac4700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980cee80 con 0x7f0e980aed30 2023-07-07T18:14:53.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9fac4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980ccb90 con 0x7f0e980cc1d0 2023-07-07T18:14:53.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9fac4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cf100 con 0x7f0e98156880 2023-07-07T18:14:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9e061700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e980cc1d0 0x7f0e980cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9e061700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e980cc1d0 0x7f0e980cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56888/0 (socket says 172.21.15.12:56888) 2023-07-07T18:14:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9d05f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0e980aed30 0x7f0e98160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54082/0 (socket says 172.21.15.12:54082) 2023-07-07T18:14:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9e061700 1 -- 172.21.15.12:0/3887599001 learned_addr learned my addr 172.21.15.12:0/3887599001 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9d860700 1 --2- 172.21.15.12:0/3887599001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 0x7f0e98069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9e061700 1 -- 172.21.15.12:0/3887599001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 msgr2=0x7f0e98069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9e061700 1 --2- 172.21.15.12:0/3887599001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 0x7f0e98069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9e061700 1 -- 172.21.15.12:0/3887599001 >> v1:172.21.15.12:6789/0 conn(0x7f0e980aed30 legacy=0x7f0e98160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9e061700 1 -- 172.21.15.12:0/3887599001 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980cf3e0 con 0x7f0e980cc1d0 2023-07-07T18:14:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.310+0000 7f0e9c85e700 1 -- 172.21.15.12:0/3887599001 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373560743 0 0) 0x7f0e980cee80 con 0x7f0e980aed30 2023-07-07T18:14:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9e061700 1 --2- 172.21.15.12:0/3887599001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 0x7f0e980cc650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009e50 tx=0x7f0e9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4f1ebd0b9bb38 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9c85e700 1 -- 172.21.15.12:0/3887599001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000e070 con 0x7f0e980cc1d0 2023-07-07T18:14:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9c85e700 1 -- 172.21.15.12:0/3887599001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000b9c0 con 0x7f0e980cc1d0 2023-07-07T18:14:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9c85e700 1 -- 172.21.15.12:0/3887599001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000bd70 con 0x7f0e980cc1d0 2023-07-07T18:14:53.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9fac4700 1 -- 172.21.15.12:0/3887599001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 msgr2=0x7f0e980cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9fac4700 1 --2- 172.21.15.12:0/3887599001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 0x7f0e980cc650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009e50 tx=0x7f0e9000b330 comp rx=0 tx=0).stop 2023-07-07T18:14:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9fac4700 1 -- 172.21.15.12:0/3887599001 shutdown_connections 2023-07-07T18:14:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9fac4700 1 --2- 172.21.15.12:0/3887599001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 0x7f0e980cc650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9fac4700 1 --2- 172.21.15.12:0/3887599001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 0x7f0e98069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9fac4700 1 -- 172.21.15.12:0/3887599001 >> 172.21.15.12:0/3887599001 conn(0x7f0e9806d4a0 msgr2=0x7f0e9806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9fac4700 1 -- 172.21.15.12:0/3887599001 shutdown_connections 2023-07-07T18:14:53.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.311+0000 7f0e9fac4700 1 -- 172.21.15.12:0/3887599001 wait complete. 2023-07-07T18:14:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9fac4700 1 Processor -- start 2023-07-07T18:14:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9fac4700 1 -- start start 2023-07-07T18:14:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9fac4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980aed30 0x7f0e980c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9fac4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 0x7f0e980b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9fac4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 0x7f0e9814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9fac4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980b5330 con 0x7f0e980cc1d0 2023-07-07T18:14:53.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9fac4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9814f060 con 0x7f0e980aed30 2023-07-07T18:14:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9fac4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980b2790 con 0x7f0e98156880 2023-07-07T18:14:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9d05f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 0x7f0e980b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9d05f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 0x7f0e980b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56892/0 (socket says 172.21.15.12:56892) 2023-07-07T18:14:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.313+0000 7f0e9d05f700 1 -- 172.21.15.12:0/390975968 learned_addr learned my addr 172.21.15.12:0/390975968 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9e061700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 0x7f0e9814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9d860700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980aed30 0x7f0e980c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9d05f700 1 -- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 msgr2=0x7f0e9814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9d05f700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 0x7f0e9814eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9d05f700 1 -- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980aed30 msgr2=0x7f0e980c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9d05f700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980aed30 0x7f0e980c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9d05f700 1 -- 172.21.15.12:0/390975968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e90009b30 con 0x7f0e980cc1d0 2023-07-07T18:14:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9d05f700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 0x7f0e980b4df0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400c550 tx=0x7f0e9400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e8e7fc700 1 -- 172.21.15.12:0/390975968 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94004c80 con 0x7f0e980cc1d0 2023-07-07T18:14:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e8e7fc700 1 -- 172.21.15.12:0/390975968 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94004e00 con 0x7f0e980cc1d0 2023-07-07T18:14:53.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e980b2a70 con 0x7f0e980cc1d0 2023-07-07T18:14:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e8e7fc700 1 -- 172.21.15.12:0/390975968 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94007310 con 0x7f0e980cc1d0 2023-07-07T18:14:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.314+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e980b3030 con 0x7f0e980cc1d0 2023-07-07T18:14:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.315+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e980b3220 con 0x7f0e980cc1d0 2023-07-07T18:14:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.316+0000 7f0e8e7fc700 1 -- 172.21.15.12:0/390975968 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e94007470 con 0x7f0e980cc1d0 2023-07-07T18:14:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.316+0000 7f0e8e7fc700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0e7c06ace0 0x7f0e7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.316+0000 7f0e8e7fc700 1 -- 172.21.15.12:0/390975968 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e940892a0 con 0x7f0e980cc1d0 2023-07-07T18:14:53.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.316+0000 7f0e9d860700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0e7c06ace0 0x7f0e7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.317+0000 7f0e9d860700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0e7c06ace0 0x7f0e7c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e88006b20 tx=0x7f0e88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:53.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.320+0000 7f0e8e7fc700 1 -- 172.21.15.12:0/390975968 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0e940540f0 con 0x7f0e980cc1d0 2023-07-07T18:14:53.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.561+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e98073910 con 0x7f0e980cc1d0 2023-07-07T18:14:53.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.562+0000 7f0e8e7fc700 1 -- 172.21.15.12:0/390975968 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0e94057710 con 0x7f0e980cc1d0 2023-07-07T18:14:53.564 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-07T18:14:53.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0e7c06ace0 msgr2=0x7f0e7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0e7c06ace0 0x7f0e7c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e88006b20 tx=0x7f0e88008040 comp rx=0 tx=0).stop 2023-07-07T18:14:53.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 msgr2=0x7f0e980b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 0x7f0e980b4df0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400c550 tx=0x7f0e9400c860 comp rx=0 tx=0).stop 2023-07-07T18:14:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 shutdown_connections 2023-07-07T18:14:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0e7c06ace0 0x7f0e7c06d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e98156880 0x7f0e9814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e980aed30 0x7f0e980c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 --2- 172.21.15.12:0/390975968 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980cc1d0 0x7f0e980b4df0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:53.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 >> 172.21.15.12:0/390975968 conn(0x7f0e9806d4a0 msgr2=0x7f0e9815ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:53.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 shutdown_connections 2023-07-07T18:14:53.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:53.564+0000 7f0e9fac4700 1 -- 172.21.15.12:0/390975968 wait complete. 2023-07-07T18:14:53.578 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-07T18:14:53.578 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-07T18:14:53.578 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-07-07T18:14:53.578 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-07T18:14:53.579 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-07T18:14:53.579 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-07T18:14:53.579 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-07T18:14:53.580 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-07T18:14:53.580 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-07T18:14:53.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:53.581 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-07-07T18:14:53.598 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:14:53.598 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:14:53.598 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:14:53.599 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:14:53.599 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-07-07T18:14:53.599 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:14:53.599 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:14:53.599 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:14:53.599 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:14:53.599 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:14:53.600 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-07T18:14:53.600 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-07-07T18:14:53.600 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-07T18:14:53.600 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42141sec preferred_lft 42141sec 2023-07-07T18:14:53.600 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2023-07-07T18:14:53.601 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:14:53.601 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:14:53.601 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-07-07T18:14:53.601 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-07T18:14:53.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:53.602 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:14:53.602 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:14:53.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2023-07-07T18:14:53.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2023-07-07T18:14:53.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2023-07-07T18:14:53.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-07T18:14:53.604 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:14:53.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:53.777 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-07T18:14:53.805 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-07-07T18:14:53.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:53.807 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-07-07T18:14:53.880 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-07-07T18:14:53.880 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-07T18:14:53.880 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-07T18:14:53.880 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-07T18:14:53.881 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-07T18:14:53.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:53.881 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:14:53.882 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:14:53.882 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-07T18:14:53.882 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-07T18:14:53.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-07T18:14:53.883 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:14:54.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:54.169 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-07-07T18:14:54.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:54.188 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2023-07-07T18:14:54.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:54.245 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:14:54.245 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:14:54.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-07T18:14:54.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-07T18:14:54.246 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:14:54.340 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-07T18:14:54.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:54.341 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:14:54.342 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:14:54.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-07T18:14:54.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-07T18:14:54.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-07T18:14:54.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-07T18:14:54.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-07T18:14:54.343 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:14:54.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:54.561 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:14:54.561 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:14:54.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-07-07T18:14:54.562 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2023-07-07T18:14:54.562 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:14:54.667 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-07T18:14:54.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:14:54.668 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-07T18:14:54.689 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-07T18:14:54.689 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:14:54.689 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-07T18:14:54.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2023-07-07T18:14:54.813 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-07T18:14:54.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-07T18:14:54.879 INFO:teuthology.orchestra.run.smithi012.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-07T18:14:54.881 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-07T18:14:54.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:54.883 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2023-07-07T18:14:54.938 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-07T18:14:54.939 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-07T18:14:54.981 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2023-07-07T18:14:55.008 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-07T18:14:55.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-07T18:14:55.075 INFO:teuthology.orchestra.run.smithi012.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-07T18:14:55.076 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-07T18:14:55.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:55.078 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2023-07-07T18:14:55.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:2023-07-07T18:14:55.081+0000 7fbad5b125c0 -1 init, newargv = 0x55e3e0c33450 newargc=15 2023-07-07T18:14:55.083 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:ceph-fuse[138286]: starting ceph client 2023-07-07T18:14:55.089 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:ceph-fuse[138286]: starting fuse 2023-07-07T18:14:55.100 INFO:teuthology.orchestra.run.smithi012.stdout:47 2023-07-07T18:14:55.100 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-07-07T18:14:55.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-07T18:14:55.101 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2023-07-07T18:14:55.102 DEBUG:teuthology.orchestra.run.smithi012:> import re 2023-07-07T18:14:55.102 DEBUG:teuthology.orchestra.run.smithi012:> import os 2023-07-07T18:14:55.102 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2023-07-07T18:14:55.103 DEBUG:teuthology.orchestra.run.smithi012:> 2023-07-07T18:14:55.103 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2023-07-07T18:14:55.103 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-07T18:14:55.104 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2023-07-07T18:14:55.104 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-07T18:14:55.104 DEBUG:teuthology.orchestra.run.smithi012:> 2023-07-07T18:14:55.105 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2023-07-07T18:14:55.105 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2023-07-07T18:14:55.105 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2023-07-07T18:14:55.105 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2023-07-07T18:14:55.106 DEBUG:teuthology.orchestra.run.smithi012:> 2023-07-07T18:14:55.106 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2023-07-07T18:14:55.106 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-07T18:14:55.107 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-07T18:14:55.107 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-07T18:14:55.107 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2023-07-07T18:14:55.108 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2023-07-07T18:14:55.108 DEBUG:teuthology.orchestra.run.smithi012:> return f 2023-07-07T18:14:55.108 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-07T18:14:55.108 DEBUG:teuthology.orchestra.run.smithi012:> 2023-07-07T18:14:55.109 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.admin")) 2023-07-07T18:14:55.109 DEBUG:teuthology.orchestra.run.smithi012:> ' 2023-07-07T18:14:55.225 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.admin.138286.asok 2023-07-07T18:14:55.408 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.138286.asok 2023-07-07T18:14:55.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:55.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.138286.asok status 2023-07-07T18:14:55.569 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-07-07T18:14:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2023-07-07T18:14:55.569 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "8e854f7d61ef670caec08861f0f82587a7320e12", 2023-07-07T18:14:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 18.0.0-4477-g8e854f7d (8e854f7d61ef670caec08861f0f82587a7320e12) reef (dev)", 2023-07-07T18:14:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "admin", 2023-07-07T18:14:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2023-07-07T18:14:55.570 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-07T18:14:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "138286", 2023-07-07T18:14:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2023-07-07T18:14:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:14:55.571 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2023-07-07T18:14:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2023-07-07T18:14:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4461, 2023-07-07T18:14:55.572 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2023-07-07T18:14:55.573 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2023-07-07T18:14:55.573 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2023-07-07T18:14:55.573 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4461 2023-07-07T18:14:55.574 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:14:55.574 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2023-07-07T18:14:55.574 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2023-07-07T18:14:55.574 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2023-07-07T18:14:55.575 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2709940685 2023-07-07T18:14:55.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:14:55.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:14:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2023-07-07T18:14:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2023-07-07T18:14:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2023-07-07T18:14:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 2709940685 2023-07-07T18:14:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:14:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4461 192.168.0.1:0/2709940685", 2023-07-07T18:14:55.577 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.1:0/2709940685", 2023-07-07T18:14:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2023-07-07T18:14:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 7, 2023-07-07T18:14:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 29, 2023-07-07T18:14:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2023-07-07T18:14:55.578 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2023-07-07T18:14:55.579 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2023-07-07T18:14:55.579 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-07-07T18:14:55.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:55.581 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2023-07-07T18:14:55.581 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-07T18:14:55.599 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2023-07-07T18:14:55.599 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-07T18:14:55.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:55.600 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-07T18:14:55.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:14:55.667 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-07T18:14:55.781 INFO:teuthology.orchestra.run.smithi012.stdout:# file: . 2023-07-07T18:14:55.781 INFO:teuthology.orchestra.run.smithi012.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-07T18:14:55.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:55.782 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:55.782 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:14:55.799 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:55.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.961+0000 7ff8fca9a700 1 Processor -- start 2023-07-07T18:14:55.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.961+0000 7ff8fca9a700 1 -- start start 2023-07-07T18:14:55.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8fca9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8f80cc1d0 0x7ff8f80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:55.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8fca9a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f80ccb50 con 0x7ff8f80aed30 2023-07-07T18:14:55.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8fca9a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f80cee80 con 0x7ff8f8156880 2023-07-07T18:14:55.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8fca9a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f80cf100 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8f6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8f80cc1d0 0x7ff8f80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:55.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8f5d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff8f80aed30 0x7ff8f8160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54120/0 (socket says 172.21.15.12:54120) 2023-07-07T18:14:55.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8f6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8f80cc1d0 0x7ff8f80cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56924/0 (socket says 172.21.15.12:56924) 2023-07-07T18:14:55.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8f5d9b700 1 -- 172.21.15.12:0/3335224845 learned_addr learned my addr 172.21.15.12:0/3335224845 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:55.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8f6d9d700 1 -- 172.21.15.12:0/3335224845 >> v1:172.21.15.160:6789/0 conn(0x7ff8f8156880 legacy=0x7ff8f8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:55.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8f6d9d700 1 -- 172.21.15.12:0/3335224845 >> v1:172.21.15.12:6789/0 conn(0x7ff8f80aed30 legacy=0x7ff8f8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:55.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8f559a700 1 -- 172.21.15.12:0/3335224845 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140256241 0 0) 0x7ff8f80ccb50 con 0x7ff8f80aed30 2023-07-07T18:14:55.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.962+0000 7ff8f6d9d700 1 -- 172.21.15.12:0/3335224845 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f80cf3e0 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8f6d9d700 1 --2- 172.21.15.12:0/3335224845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 0x7ff8f80cc610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009d90 tx=0x7ff8f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4339c379fdbd49 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:55.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8f559a700 1 -- 172.21.15.12:0/3335224845 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000e070 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8f559a700 1 -- 172.21.15.12:0/3335224845 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f000bbd0 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8f559a700 1 -- 172.21.15.12:0/3335224845 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0012430 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8fca9a700 1 -- 172.21.15.12:0/3335224845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 msgr2=0x7ff8f80cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:55.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8fca9a700 1 --2- 172.21.15.12:0/3335224845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 0x7ff8f80cc610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009d90 tx=0x7ff8f000b330 comp rx=0 tx=0).stop 2023-07-07T18:14:55.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8fca9a700 1 -- 172.21.15.12:0/3335224845 shutdown_connections 2023-07-07T18:14:55.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8fca9a700 1 --2- 172.21.15.12:0/3335224845 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 0x7ff8f80cc610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:55.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8fca9a700 1 -- 172.21.15.12:0/3335224845 >> 172.21.15.12:0/3335224845 conn(0x7ff8f806d4a0 msgr2=0x7ff8f806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:55.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8fca9a700 1 -- 172.21.15.12:0/3335224845 shutdown_connections 2023-07-07T18:14:55.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.963+0000 7ff8fca9a700 1 -- 172.21.15.12:0/3335224845 wait complete. 2023-07-07T18:14:55.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.965+0000 7ff8fca9a700 1 Processor -- start 2023-07-07T18:14:55.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.965+0000 7ff8fca9a700 1 -- start start 2023-07-07T18:14:55.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.965+0000 7ff8fca9a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8f80aed30 0x7ff8f814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:55.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.965+0000 7ff8fca9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 0x7ff8f80b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:55.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.965+0000 7ff8fca9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f8156880 0x7ff8f815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:55.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8fca9a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f81e7a20 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8fca9a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f80ad6c0 con 0x7ff8f8156880 2023-07-07T18:14:55.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8fca9a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f814fd50 con 0x7ff8f80aed30 2023-07-07T18:14:55.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 0x7ff8f80b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:55.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 0x7ff8f80b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56928/0 (socket says 172.21.15.12:56928) 2023-07-07T18:14:55.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f5d9b700 1 -- 172.21.15.12:0/44303118 learned_addr learned my addr 172.21.15.12:0/44303118 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:55.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f659c700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8f80aed30 0x7ff8f814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:55.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f6d9d700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f8156880 0x7ff8f815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:55.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f5d9b700 1 -- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8f80aed30 msgr2=0x7ff8f814f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:55.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f5d9b700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8f80aed30 0x7ff8f814f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f5d9b700 1 -- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f8156880 msgr2=0x7ff8f815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f5d9b700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f8156880 0x7ff8f815ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f5d9b700 1 -- 172.21.15.12:0/44303118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f0009a70 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8f5d9b700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 0x7ff8f80b4cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c520 tx=0x7ff8e800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8e6ffd700 1 -- 172.21.15.12:0/44303118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8004c80 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8e6ffd700 1 -- 172.21.15.12:0/44303118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8004e00 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f80acab0 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8e6ffd700 1 -- 172.21.15.12:0/44303118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8007310 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.966+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f80ad070 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.967+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f8073910 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.968+0000 7ff8e6ffd700 1 -- 172.21.15.12:0/44303118 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8e8007470 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.968+0000 7ff8e6ffd700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff8d806ace0 0x7ff8d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:55.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.968+0000 7ff8e6ffd700 1 -- 172.21.15.12:0/44303118 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff8e80893b0 con 0x7ff8f80cc1d0 2023-07-07T18:14:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.968+0000 7ff8f659c700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff8d806ace0 0x7ff8d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.969+0000 7ff8f659c700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff8d806ace0 0x7ff8d806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec007fd0 tx=0x7ff8ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:55.973+0000 7ff8e6ffd700 1 -- 172.21.15.12:0/44303118 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8e8054170 con 0x7ff8f80cc1d0 2023-07-07T18:14:56.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.168+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8f8071cf0 con 0x7ff8f80cc1d0 2023-07-07T18:14:56.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.169+0000 7ff8e6ffd700 1 -- 172.21.15.12:0/44303118 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7ff8e8057790 con 0x7ff8f80cc1d0 2023-07-07T18:14:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:56.174 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff8d806ace0 msgr2=0x7ff8d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff8d806ace0 0x7ff8d806d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec007fd0 tx=0x7ff8ec009040 comp rx=0 tx=0).stop 2023-07-07T18:14:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 msgr2=0x7ff8f80b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 0x7ff8f80b4cd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c520 tx=0x7ff8e800c830 comp rx=0 tx=0).stop 2023-07-07T18:14:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 shutdown_connections 2023-07-07T18:14:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff8d806ace0 0x7ff8d806d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f8156880 0x7ff8f815ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8f80aed30 0x7ff8f814f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 --2- 172.21.15.12:0/44303118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8f80cc1d0 0x7ff8f80b4cd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 >> 172.21.15.12:0/44303118 conn(0x7ff8f806d4a0 msgr2=0x7ff8f8069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:56.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 shutdown_connections 2023-07-07T18:14:56.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.172+0000 7ff8fca9a700 1 -- 172.21.15.12:0/44303118 wait complete. 2023-07-07T18:14:56.186 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:14:56.187 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:14:56.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.312+0000 7ff995414700 1 Processor -- start 2023-07-07T18:14:56.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.312+0000 7ff995414700 1 -- start start 2023-07-07T18:14:56.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.313+0000 7ff995414700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9900aecc0 0x7ff99006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.313+0000 7ff995414700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9900ce620 con 0x7ff99006e970 2023-07-07T18:14:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.313+0000 7ff995414700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff990160580 con 0x7ff99015fc60 2023-07-07T18:14:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.313+0000 7ff995414700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff990160860 con 0x7ff9900aecc0 2023-07-07T18:14:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.313+0000 7ff98f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff99006e970 0x7ff9900cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54136/0 (socket says 172.21.15.12:54136) 2023-07-07T18:14:56.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.313+0000 7ff98f7fe700 1 -- 172.21.15.12:0/1317901166 learned_addr learned my addr 172.21.15.12:0/1317901166 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.313+0000 7ff98e7fc700 1 --2- 172.21.15.12:0/1317901166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9900aecc0 0x7ff99006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.313+0000 7ff98dffb700 1 -- 172.21.15.12:0/1317901166 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486668719 0 0) 0x7ff9900ce620 con 0x7ff99006e970 2023-07-07T18:14:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98dffb700 1 -- 172.21.15.12:0/1317901166 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9780035b0 con 0x7ff99006e970 2023-07-07T18:14:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98dffb700 1 -- 172.21.15.12:0/1317901166 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796991515 0 0) 0x7ff990160580 con 0x7ff99015fc60 2023-07-07T18:14:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98dffb700 1 -- 172.21.15.12:0/1317901166 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9900ce620 con 0x7ff99015fc60 2023-07-07T18:14:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98e7fc700 1 -- 172.21.15.12:0/1317901166 >> v1:172.21.15.160:6789/0 conn(0x7ff99015fc60 legacy=0x7ff99006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98e7fc700 1 -- 172.21.15.12:0/1317901166 >> v1:172.21.15.12:6789/0 conn(0x7ff99006e970 legacy=0x7ff9900cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98e7fc700 1 -- 172.21.15.12:0/1317901166 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff990160b40 con 0x7ff9900aecc0 2023-07-07T18:14:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98e7fc700 1 --2- 172.21.15.12:0/1317901166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9900aecc0 0x7ff99006a900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff980009870 tx=0x7ff980009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f013d9550df719f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98dffb700 1 -- 172.21.15.12:0/1317901166 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980011830 con 0x7ff9900aecc0 2023-07-07T18:14:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98dffb700 1 -- 172.21.15.12:0/1317901166 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980011990 con 0x7ff9900aecc0 2023-07-07T18:14:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.314+0000 7ff98dffb700 1 -- 172.21.15.12:0/1317901166 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980011d20 con 0x7ff9900aecc0 2023-07-07T18:14:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.315+0000 7ff995414700 1 -- 172.21.15.12:0/1317901166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9900aecc0 msgr2=0x7ff99006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.315+0000 7ff995414700 1 --2- 172.21.15.12:0/1317901166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9900aecc0 0x7ff99006a900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff980009870 tx=0x7ff980009b80 comp rx=0 tx=0).stop 2023-07-07T18:14:56.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.315+0000 7ff995414700 1 -- 172.21.15.12:0/1317901166 shutdown_connections 2023-07-07T18:14:56.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.315+0000 7ff995414700 1 --2- 172.21.15.12:0/1317901166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9900aecc0 0x7ff99006a900 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.315+0000 7ff995414700 1 -- 172.21.15.12:0/1317901166 >> 172.21.15.12:0/1317901166 conn(0x7ff99006b920 msgr2=0x7ff9900cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:56.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.315+0000 7ff995414700 1 -- 172.21.15.12:0/1317901166 shutdown_connections 2023-07-07T18:14:56.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.315+0000 7ff995414700 1 -- 172.21.15.12:0/1317901166 wait complete. 2023-07-07T18:14:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.316+0000 7ff995414700 1 Processor -- start 2023-07-07T18:14:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.316+0000 7ff995414700 1 -- start start 2023-07-07T18:14:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff995414700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99006e970 0x7ff990153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff995414700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9900aecc0 0x7ff9901f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff995414700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff99015fc60 0x7ff9901f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff995414700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900cba60 con 0x7ff99015fc60 2023-07-07T18:14:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff995414700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900cbd40 con 0x7ff9900aecc0 2023-07-07T18:14:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff995414700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9900cc020 con 0x7ff99006e970 2023-07-07T18:14:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff99015fc60 0x7ff9901f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff99015fc60 0x7ff9901f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56942/0 (socket says 172.21.15.12:56942) 2023-07-07T18:14:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98f7fe700 1 -- 172.21.15.12:0/1766434452 learned_addr learned my addr 172.21.15.12:0/1766434452 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98e7fc700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9900aecc0 0x7ff9901f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98effd700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99006e970 0x7ff990153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98f7fe700 1 -- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99006e970 msgr2=0x7ff990153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98f7fe700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99006e970 0x7ff990153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98f7fe700 1 -- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9900aecc0 msgr2=0x7ff9901f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98f7fe700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9900aecc0 0x7ff9901f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98f7fe700 1 -- 172.21.15.12:0/1766434452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800094a0 con 0x7ff99015fc60 2023-07-07T18:14:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98effd700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99006e970 0x7ff990153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.317+0000 7ff98f7fe700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff99015fc60 0x7ff9901f6020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff98800cbc0 tx=0x7ff98800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.318+0000 7ff9777fe700 1 -- 172.21.15.12:0/1766434452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98800aaf0 con 0x7ff99015fc60 2023-07-07T18:14:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.318+0000 7ff9777fe700 1 -- 172.21.15.12:0/1766434452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98800ac50 con 0x7ff99015fc60 2023-07-07T18:14:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.318+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9900cc300 con 0x7ff99015fc60 2023-07-07T18:14:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.318+0000 7ff9777fe700 1 -- 172.21.15.12:0/1766434452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988012400 con 0x7ff99015fc60 2023-07-07T18:14:56.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.318+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff990153fe0 con 0x7ff99015fc60 2023-07-07T18:14:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.319+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9900cc820 con 0x7ff99015fc60 2023-07-07T18:14:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.319+0000 7ff9777fe700 1 -- 172.21.15.12:0/1766434452 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff98801b3b0 con 0x7ff99015fc60 2023-07-07T18:14:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.320+0000 7ff9777fe700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff97c06ace0 0x7ff97c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.320+0000 7ff9777fe700 1 -- 172.21.15.12:0/1766434452 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff988089350 con 0x7ff99015fc60 2023-07-07T18:14:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.320+0000 7ff98effd700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff97c06ace0 0x7ff97c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.320+0000 7ff98effd700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff97c06ace0 0x7ff97c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff984001230 tx=0x7ff984009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.324+0000 7ff9777fe700 1 -- 172.21.15.12:0/1766434452 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff988054250 con 0x7ff99015fc60 2023-07-07T18:14:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.521+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff99004ea20 con 0x7ff99015fc60 2023-07-07T18:14:56.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.521+0000 7ff9777fe700 1 -- 172.21.15.12:0/1766434452 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff988057870 con 0x7ff99015fc60 2023-07-07T18:14:56.524 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:14:56.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff97c06ace0 msgr2=0x7ff97c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff97c06ace0 0x7ff97c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff984001230 tx=0x7ff984009040 comp rx=0 tx=0).stop 2023-07-07T18:14:56.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff99015fc60 msgr2=0x7ff9901f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff99015fc60 0x7ff9901f6020 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff98800cbc0 tx=0x7ff98800cf80 comp rx=0 tx=0).stop 2023-07-07T18:14:56.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 shutdown_connections 2023-07-07T18:14:56.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff97c06ace0 0x7ff97c06d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff99015fc60 0x7ff9901f6020 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff99006e970 0x7ff990153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 --2- 172.21.15.12:0/1766434452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9900aecc0 0x7ff9901f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 >> 172.21.15.12:0/1766434452 conn(0x7ff99006b920 msgr2=0x7ff9900af450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:56.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 shutdown_connections 2023-07-07T18:14:56.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.523+0000 7ff995414700 1 -- 172.21.15.12:0/1766434452 wait complete. 2023-07-07T18:14:56.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:14:56.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.663+0000 7f5b98ae8700 1 Processor -- start 2023-07-07T18:14:56.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.663+0000 7f5b98ae8700 1 -- start start 2023-07-07T18:14:56.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b98ae8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b98ae8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5b940cb560 0x7f5b9415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b98ae8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b940cac60 con 0x7f5b940cb0f0 2023-07-07T18:14:56.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b98ae8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9415dca0 con 0x7f5b940cb560 2023-07-07T18:14:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b98ae8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940cb9b0 con 0x7f5b94070dc0 2023-07-07T18:14:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b9259c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b92d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5b940cb560 0x7f5b9415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b92d9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5b940cb560 0x7f5b9415cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:52558/0 (socket says 172.21.15.12:52558) 2023-07-07T18:14:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b91d9b700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5b940cb0f0 0x7f5b94069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:47386/0 (socket says 172.21.15.12:47386) 2023-07-07T18:14:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.664+0000 7f5b92d9d700 1 -- 172.21.15.12:0/4270202919 learned_addr learned my addr 172.21.15.12:0/4270202919 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.665+0000 7f5b92d9d700 1 -- 172.21.15.12:0/4270202919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 msgr2=0x7f5b94071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.665+0000 7f5b92d9d700 1 --2- 172.21.15.12:0/4270202919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.665+0000 7f5b92d9d700 1 -- 172.21.15.12:0/4270202919 >> v1:172.21.15.160:6789/0 conn(0x7f5b940cb0f0 legacy=0x7f5b94069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.665+0000 7f5b92d9d700 1 -- 172.21.15.12:0/4270202919 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b940ca370 con 0x7f5b940cb560 2023-07-07T18:14:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.665+0000 7f5b9259c700 1 --2- 172.21.15.12:0/4270202919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:14:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.665+0000 7f5b92d9d700 1 --2- 172.21.15.12:0/4270202919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b940cb560 0x7f5b9415cc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009e80 tx=0x7f5b8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6dcf97cef8ee47d server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.667+0000 7f5b9159a700 1 -- 172.21.15.12:0/4270202919 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00e070 con 0x7f5b940cb560 2023-07-07T18:14:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.667+0000 7f5b9159a700 1 -- 172.21.15.12:0/4270202919 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c00b8d0 con 0x7f5b940cb560 2023-07-07T18:14:56.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.668+0000 7f5b9159a700 1 -- 172.21.15.12:0/4270202919 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c00bc80 con 0x7f5b940cb560 2023-07-07T18:14:56.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.668+0000 7f5b98ae8700 1 -- 172.21.15.12:0/4270202919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b940cb560 msgr2=0x7f5b9415cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.668+0000 7f5b98ae8700 1 --2- 172.21.15.12:0/4270202919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b940cb560 0x7f5b9415cc90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009e80 tx=0x7f5b8c00b330 comp rx=0 tx=0).stop 2023-07-07T18:14:56.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.668+0000 7f5b98ae8700 1 -- 172.21.15.12:0/4270202919 shutdown_connections 2023-07-07T18:14:56.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.668+0000 7f5b98ae8700 1 --2- 172.21.15.12:0/4270202919 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b940cb560 0x7f5b9415cc90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.668+0000 7f5b98ae8700 1 --2- 172.21.15.12:0/4270202919 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.668+0000 7f5b98ae8700 1 -- 172.21.15.12:0/4270202919 >> 172.21.15.12:0/4270202919 conn(0x7f5b940b1990 msgr2=0x7f5b940cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.668+0000 7f5b98ae8700 1 -- 172.21.15.12:0/4270202919 shutdown_connections 2023-07-07T18:14:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.668+0000 7f5b98ae8700 1 -- 172.21.15.12:0/4270202919 wait complete. 2023-07-07T18:14:56.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.670+0000 7f5b98ae8700 1 Processor -- start 2023-07-07T18:14:56.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.670+0000 7f5b98ae8700 1 -- start start 2023-07-07T18:14:56.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.670+0000 7f5b98ae8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94139f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.670+0000 7f5b98ae8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b940cb0f0 0x7f5b940b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.670+0000 7f5b98ae8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b940cb560 0x7f5b9413c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.670+0000 7f5b98ae8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940c9100 con 0x7f5b940cb560 2023-07-07T18:14:56.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.670+0000 7f5b98ae8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b941f1e50 con 0x7f5b940cb0f0 2023-07-07T18:14:56.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b98ae8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94152040 con 0x7f5b94070dc0 2023-07-07T18:14:56.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b92d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b940cb560 0x7f5b9413c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b9259c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94139f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b91d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b940cb0f0 0x7f5b940b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b92d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b940cb560 0x7f5b9413c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56958/0 (socket says 172.21.15.12:56958) 2023-07-07T18:14:56.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b92d9d700 1 -- 172.21.15.12:0/2490928816 learned_addr learned my addr 172.21.15.12:0/2490928816 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:56.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b9259c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94139f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46044/0 (socket says 172.21.15.12:46044) 2023-07-07T18:14:56.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b92d9d700 1 -- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 msgr2=0x7f5b94139f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b92d9d700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94139f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b92d9d700 1 -- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b940cb0f0 msgr2=0x7f5b940b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b92d9d700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b940cb0f0 0x7f5b940b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b92d9d700 1 -- 172.21.15.12:0/2490928816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8800b740 con 0x7f5b940cb560 2023-07-07T18:14:56.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b92d9d700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b940cb560 0x7f5b9413c4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b94070a30 tx=0x7f5b8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:56.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b82ffd700 1 -- 172.21.15.12:0/2490928816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c003ea0 con 0x7f5b940cb560 2023-07-07T18:14:56.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b82ffd700 1 -- 172.21.15.12:0/2490928816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c004820 con 0x7f5b940cb560 2023-07-07T18:14:56.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8c009b30 con 0x7f5b940cb560 2023-07-07T18:14:56.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b82ffd700 1 -- 172.21.15.12:0/2490928816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c01c650 con 0x7f5b940cb560 2023-07-07T18:14:56.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.671+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b941519f0 con 0x7f5b940cb560 2023-07-07T18:14:56.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.672+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b94067260 con 0x7f5b940cb560 2023-07-07T18:14:56.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.673+0000 7f5b82ffd700 1 -- 172.21.15.12:0/2490928816 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b8c01c7b0 con 0x7f5b940cb560 2023-07-07T18:14:56.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.673+0000 7f5b82ffd700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5b7406ace0 0x7f5b7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:56.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.673+0000 7f5b82ffd700 1 -- 172.21.15.12:0/2490928816 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b8c08b2b0 con 0x7f5b940cb560 2023-07-07T18:14:56.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.673+0000 7f5b9259c700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5b7406ace0 0x7f5b7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:56.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.674+0000 7f5b9259c700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5b7406ace0 0x7f5b7406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800bf70 tx=0x7f5b8800b420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:56.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.677+0000 7f5b82ffd700 1 -- 172.21.15.12:0/2490928816 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5b8c056100 con 0x7f5b940cb560 2023-07-07T18:14:56.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.874+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b9404ea20 con 0x7f5b940cb560 2023-07-07T18:14:56.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.875+0000 7f5b82ffd700 1 -- 172.21.15.12:0/2490928816 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b8c059720 con 0x7f5b940cb560 2023-07-07T18:14:56.877 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:14:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5b7406ace0 msgr2=0x7f5b7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5b7406ace0 0x7f5b7406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800bf70 tx=0x7f5b8800b420 comp rx=0 tx=0).stop 2023-07-07T18:14:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b940cb560 msgr2=0x7f5b9413c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b940cb560 0x7f5b9413c4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b94070a30 tx=0x7f5b8c004ad0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 shutdown_connections 2023-07-07T18:14:56.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5b7406ace0 0x7f5b7406d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b940cb560 0x7f5b9413c4d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b94070dc0 0x7f5b94139f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 --2- 172.21.15.12:0/2490928816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b940cb0f0 0x7f5b940b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:56.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 >> 172.21.15.12:0/2490928816 conn(0x7f5b940b1990 msgr2=0x7f5b940cbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:56.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 shutdown_connections 2023-07-07T18:14:56.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:56.877+0000 7f5b98ae8700 1 -- 172.21.15.12:0/2490928816 wait complete. 2023-07-07T18:14:56.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:14:57.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.016+0000 7fe08a22f700 1 Processor -- start 2023-07-07T18:14:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.016+0000 7fe08a22f700 1 -- start start 2023-07-07T18:14:57.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.017+0000 7fe08a22f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08406e970 0x7fe08406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.017+0000 7fe08a22f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0840ce620 con 0x7fe08415fc60 2023-07-07T18:14:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.017+0000 7fe08a22f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe084160580 con 0x7fe0840aecc0 2023-07-07T18:14:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.017+0000 7fe08a22f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe084160860 con 0x7fe08406e970 2023-07-07T18:14:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.017+0000 7fe0837fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe08415fc60 0x7fe08406e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54160/0 (socket says 172.21.15.12:54160) 2023-07-07T18:14:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.017+0000 7fe0837fe700 1 -- 172.21.15.12:0/3492780655 learned_addr learned my addr 172.21.15.12:0/3492780655 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe083fff700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08406e970 0x7fe08406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431030423 0 0) 0x7fe0840ce620 con 0x7fe08415fc60 2023-07-07T18:14:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0700035b0 con 0x7fe08415fc60 2023-07-07T18:14:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647367503 0 0) 0x7fe084160580 con 0x7fe0840aecc0 2023-07-07T18:14:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0840ce620 con 0x7fe0840aecc0 2023-07-07T18:14:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766696730 0 0) 0x7fe0700035b0 con 0x7fe08415fc60 2023-07-07T18:14:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08406e970 msgr2=0x7fe08406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08406e970 0x7fe08406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 >> v1:172.21.15.160:6789/0 conn(0x7fe0840aecc0 legacy=0x7fe0840cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe084160b40 con 0x7fe08415fc60 2023-07-07T18:14:57.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fe06c0017f0 con 0x7fe08415fc60 2023-07-07T18:14:57.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 >> v1:172.21.15.12:6789/0 conn(0x7fe08415fc60 legacy=0x7fe08406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe070003bc0 0x7fe070003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08406e970 0x7fe070004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe070004d90 0x7fe070005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe084160860 con 0x7fe070003bc0 2023-07-07T18:14:57.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07000bac0 con 0x7fe070004d90 2023-07-07T18:14:57.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07000bc80 con 0x7fe08406e970 2023-07-07T18:14:57.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0837fe700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe070003bc0 0x7fe070003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe082ffd700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08406e970 0x7fe070004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe083fff700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe070004d90 0x7fe070005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0837fe700 1 -- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08406e970 msgr2=0x7fe070004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:57.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0837fe700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe08406e970 0x7fe070004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0837fe700 1 -- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe070004d90 msgr2=0x7fe070005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:57.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0837fe700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe070004d90 0x7fe070005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.018+0000 7fe0837fe700 1 -- 172.21.15.12:0/3492780655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700035b0 con 0x7fe070003bc0 2023-07-07T18:14:57.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe0837fe700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe070003bc0 0x7fe070003fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c0e0 tx=0x7fe070005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda33bf398e0a45e server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:57.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c00cc20 con 0x7fe070003bc0 2023-07-07T18:14:57.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c00cd80 con 0x7fe070003bc0 2023-07-07T18:14:57.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe0827fc700 1 -- 172.21.15.12:0/3492780655 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c007310 con 0x7fe070003bc0 2023-07-07T18:14:57.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe08a22f700 1 -- 172.21.15.12:0/3492780655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe070003bc0 msgr2=0x7fe070003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe08a22f700 1 --2- 172.21.15.12:0/3492780655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe070003bc0 0x7fe070003fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c0e0 tx=0x7fe070005880 comp rx=0 tx=0).stop 2023-07-07T18:14:57.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe083fff700 1 -- 172.21.15.12:0/3492780655 reap_dead start 2023-07-07T18:14:57.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe08a22f700 1 -- 172.21.15.12:0/3492780655 shutdown_connections 2023-07-07T18:14:57.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe08a22f700 1 -- 172.21.15.12:0/3492780655 >> 172.21.15.12:0/3492780655 conn(0x7fe08406b920 msgr2=0x7fe0840cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:57.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe08a22f700 1 -- 172.21.15.12:0/3492780655 shutdown_connections 2023-07-07T18:14:57.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.019+0000 7fe08a22f700 1 -- 172.21.15.12:0/3492780655 wait complete. 2023-07-07T18:14:57.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.021+0000 7fe08a22f700 1 Processor -- start 2023-07-07T18:14:57.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.021+0000 7fe08a22f700 1 -- start start 2023-07-07T18:14:57.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.021+0000 7fe08a22f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe070003bc0 0x7fe0840c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.021+0000 7fe08a22f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0840c8340 0x7fe0840c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.021+0000 7fe08a22f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe084153d70 0x7fe0840ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.021+0000 7fe08a22f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840c7020 con 0x7fe0840c8340 2023-07-07T18:14:57.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.021+0000 7fe08a22f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840c72a0 con 0x7fe070003bc0 2023-07-07T18:14:57.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.021+0000 7fe08a22f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840c7580 con 0x7fe084153d70 2023-07-07T18:14:57.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe082ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0840c8340 0x7fe0840c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe082ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0840c8340 0x7fe0840c90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56976/0 (socket says 172.21.15.12:56976) 2023-07-07T18:14:57.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe082ffd700 1 -- 172.21.15.12:0/3579089773 learned_addr learned my addr 172.21.15.12:0/3579089773 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:57.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe0837fe700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe070003bc0 0x7fe0840c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe083fff700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe084153d70 0x7fe0840ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe082ffd700 1 -- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe084153d70 msgr2=0x7fe0840ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe082ffd700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe084153d70 0x7fe0840ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe082ffd700 1 -- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe070003bc0 msgr2=0x7fe0840c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe082ffd700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe070003bc0 0x7fe0840c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe082ffd700 1 -- 172.21.15.12:0/3579089773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840c7860 con 0x7fe0840c8340 2023-07-07T18:14:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe082ffd700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0840c8340 0x7fe0840c90f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe07400e7b0 tx=0x7fe07400eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe07bfff700 1 -- 172.21.15.12:0/3579089773 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0740052e0 con 0x7fe0840c8340 2023-07-07T18:14:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe07bfff700 1 -- 172.21.15.12:0/3579089773 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074005440 con 0x7fe0840c8340 2023-07-07T18:14:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0840c7b40 con 0x7fe0840c8340 2023-07-07T18:14:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe07bfff700 1 -- 172.21.15.12:0/3579089773 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074006aa0 con 0x7fe0840c8340 2023-07-07T18:14:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.022+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0840c9630 con 0x7fe0840c8340 2023-07-07T18:14:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.023+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0840c8060 con 0x7fe0840c8340 2023-07-07T18:14:57.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.024+0000 7fe07bfff700 1 -- 172.21.15.12:0/3579089773 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe074006c00 con 0x7fe0840c8340 2023-07-07T18:14:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.024+0000 7fe07bfff700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe06406ace0 0x7fe06406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.024+0000 7fe07bfff700 1 -- 172.21.15.12:0/3579089773 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe074088b40 con 0x7fe0840c8340 2023-07-07T18:14:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.024+0000 7fe0837fe700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe06406ace0 0x7fe06406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.025+0000 7fe0837fe700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe06406ace0 0x7fe06406d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe06c015040 tx=0x7fe06c007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:57.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.028+0000 7fe07bfff700 1 -- 172.21.15.12:0/3579089773 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe0840c8060 con 0x7fe0840c8340 2023-07-07T18:14:57.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.224+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe0840c8060 con 0x7fe0840c8340 2023-07-07T18:14:57.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.225+0000 7fe07bfff700 1 -- 172.21.15.12:0/3579089773 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe0840c8060 con 0x7fe0840c8340 2023-07-07T18:14:57.227 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:14:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe06406ace0 msgr2=0x7fe06406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe06406ace0 0x7fe06406d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe06c015040 tx=0x7fe06c007000 comp rx=0 tx=0).stop 2023-07-07T18:14:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0840c8340 msgr2=0x7fe0840c90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0840c8340 0x7fe0840c90f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe07400e7b0 tx=0x7fe07400eac0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 shutdown_connections 2023-07-07T18:14:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe06406ace0 0x7fe06406d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe084153d70 0x7fe0840ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe070003bc0 0x7fe0840c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 --2- 172.21.15.12:0/3579089773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0840c8340 0x7fe0840c90f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 >> 172.21.15.12:0/3579089773 conn(0x7fe08406b920 msgr2=0x7fe08415db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 shutdown_connections 2023-07-07T18:14:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.227+0000 7fe08a22f700 1 -- 172.21.15.12:0/3579089773 wait complete. 2023-07-07T18:14:57.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:14:57.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.367+0000 7f319c8e9700 1 Processor -- start 2023-07-07T18:14:57.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.367+0000 7f319c8e9700 1 -- start start 2023-07-07T18:14:57.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319c8e9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f319806e970 0x7f319806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319c8e9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31980ce620 con 0x7f31980aecc0 2023-07-07T18:14:57.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319c8e9700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3198160580 con 0x7f319815fc60 2023-07-07T18:14:57.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319c8e9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3198160860 con 0x7f319806e970 2023-07-07T18:14:57.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f3195d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f31980aecc0 0x7f31980cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54180/0 (socket says 172.21.15.12:54180) 2023-07-07T18:14:57.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f3195d9b700 1 -- 172.21.15.12:0/151719238 learned_addr learned my addr 172.21.15.12:0/151719238 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:57.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f3196d9d700 1 --2- 172.21.15.12:0/151719238 >> v2:172.21.15.160:3300/0 conn(0x7f319806e970 0x7f319806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464920446 0 0) 0x7f31980ce620 con 0x7f31980aecc0 2023-07-07T18:14:57.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31800035b0 con 0x7f31980aecc0 2023-07-07T18:14:57.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084102883 0 0) 0x7f31800035b0 con 0x7f31980aecc0 2023-07-07T18:14:57.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 >> v2:172.21.15.160:3300/0 conn(0x7f319806e970 msgr2=0x7f319806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:57.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319559a700 1 --2- 172.21.15.12:0/151719238 >> v2:172.21.15.160:3300/0 conn(0x7f319806e970 0x7f319806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.368+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 >> v1:172.21.15.160:6789/0 conn(0x7f319815fc60 legacy=0x7f319806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198160b40 con 0x7f31980aecc0 2023-07-07T18:14:57.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f318c001670 con 0x7f31980aecc0 2023-07-07T18:14:57.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 >> v1:172.21.15.12:6789/0 conn(0x7f31980aecc0 legacy=0x7f31980cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3180003a00 0x7f3180003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180004850 0x7f3180004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f318000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3198160860 con 0x7f3180005200 2023-07-07T18:14:57.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318000c080 con 0x7f3180003a00 2023-07-07T18:14:57.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318000c240 con 0x7f3180004850 2023-07-07T18:14:57.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f3196d9d700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f318000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319659c700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3180003a00 0x7f3180003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f3195d9b700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180004850 0x7f3180004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f3196d9d700 1 -- 172.21.15.12:0/151719238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180004850 msgr2=0x7f3180004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:57.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f3196d9d700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180004850 0x7f3180004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f3196d9d700 1 -- 172.21.15.12:0/151719238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3180003a00 msgr2=0x7f3180003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:57.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f3196d9d700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3180003a00 0x7f3180003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f3196d9d700 1 -- 172.21.15.12:0/151719238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800035b0 con 0x7f3180005200 2023-07-07T18:14:57.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f3196d9d700 1 -- 172.21.15.12:0/151719238 reap_dead start 2023-07-07T18:14:57.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f3196d9d700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f318000ba10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3190009f90 tx=0x7f3180005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9a007612c43887 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:57.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000ec30 con 0x7f3180005200 2023-07-07T18:14:57.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319000f040 con 0x7f3180005200 2023-07-07T18:14:57.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.369+0000 7f319559a700 1 -- 172.21.15.12:0/151719238 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190014480 con 0x7f3180005200 2023-07-07T18:14:57.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.370+0000 7f319c8e9700 1 -- 172.21.15.12:0/151719238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 msgr2=0x7f318000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.370+0000 7f319c8e9700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f318000ba10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3190009f90 tx=0x7f3180005880 comp rx=0 tx=0).stop 2023-07-07T18:14:57.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.370+0000 7f319c8e9700 1 -- 172.21.15.12:0/151719238 shutdown_connections 2023-07-07T18:14:57.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.370+0000 7f319c8e9700 1 --2- 172.21.15.12:0/151719238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f318000ba10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.370+0000 7f319c8e9700 1 -- 172.21.15.12:0/151719238 >> 172.21.15.12:0/151719238 conn(0x7f319806b920 msgr2=0x7f31980cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:57.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.370+0000 7f319c8e9700 1 -- 172.21.15.12:0/151719238 shutdown_connections 2023-07-07T18:14:57.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.370+0000 7f319c8e9700 1 -- 172.21.15.12:0/151719238 wait complete. 2023-07-07T18:14:57.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.371+0000 7f319c8e9700 1 Processor -- start 2023-07-07T18:14:57.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.371+0000 7f319c8e9700 1 -- start start 2023-07-07T18:14:57.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.372+0000 7f319c8e9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f31980b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.372+0000 7f319c8e9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f319815ca90 0x7f31981e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.372+0000 7f319c8e9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f319815c290 0x7f31980adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.372+0000 7f319c8e9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980b2d50 con 0x7f3180005200 2023-07-07T18:14:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.372+0000 7f319c8e9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980b36b0 con 0x7f319815ca90 2023-07-07T18:14:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.372+0000 7f319c8e9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31981e83b0 con 0x7f319815c290 2023-07-07T18:14:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.372+0000 7f319659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f31980b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.372+0000 7f319659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f31980b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56994/0 (socket says 172.21.15.12:56994) 2023-07-07T18:14:57.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.372+0000 7f319659c700 1 -- 172.21.15.12:0/1788420265 learned_addr learned my addr 172.21.15.12:0/1788420265 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:57.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f319659c700 1 -- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f319815c290 msgr2=0x7f31980adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f319659c700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f319815c290 0x7f31980adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f319659c700 1 -- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f319815ca90 msgr2=0x7f31981e7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f3195d9b700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f319815ca90 0x7f31981e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f319659c700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f319815ca90 0x7f31981e7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f319659c700 1 -- 172.21.15.12:0/1788420265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31981e7b50 con 0x7f3180005200 2023-07-07T18:14:57.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f319659c700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f31980b3170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f318800f850 tx=0x7f318800fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:57.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f3186ffd700 1 -- 172.21.15.12:0/1788420265 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31880050d0 con 0x7f3180005200 2023-07-07T18:14:57.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f3186ffd700 1 -- 172.21.15.12:0/1788420265 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3188005230 con 0x7f3180005200 2023-07-07T18:14:57.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31981e7df0 con 0x7f3180005200 2023-07-07T18:14:57.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f3186ffd700 1 -- 172.21.15.12:0/1788420265 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31880036d0 con 0x7f3180005200 2023-07-07T18:14:57.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.373+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31980b2970 con 0x7f3180005200 2023-07-07T18:14:57.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.374+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31980cd640 con 0x7f3180005200 2023-07-07T18:14:57.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.374+0000 7f3186ffd700 1 -- 172.21.15.12:0/1788420265 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3188003830 con 0x7f3180005200 2023-07-07T18:14:57.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.375+0000 7f3186ffd700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f317806ace0 0x7f317806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.375+0000 7f3186ffd700 1 -- 172.21.15.12:0/1788420265 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f31880894a0 con 0x7f3180005200 2023-07-07T18:14:57.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.375+0000 7f3195d9b700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f317806ace0 0x7f317806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.375+0000 7f3195d9b700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f317806ace0 0x7f317806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f318c001050 tx=0x7f318c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:57.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.379+0000 7f3186ffd700 1 -- 172.21.15.12:0/1788420265 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3188054250 con 0x7f3180005200 2023-07-07T18:14:57.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.574+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31980b2b00 con 0x7f3180005200 2023-07-07T18:14:57.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.575+0000 7f3186ffd700 1 -- 172.21.15.12:0/1788420265 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3188057870 con 0x7f3180005200 2023-07-07T18:14:57.577 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:14:57.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.576+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f317806ace0 msgr2=0x7f317806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.576+0000 7f319c8e9700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f317806ace0 0x7f317806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f318c001050 tx=0x7f318c009040 comp rx=0 tx=0).stop 2023-07-07T18:14:57.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 msgr2=0x7f31980b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f31980b3170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f318800f850 tx=0x7f318800fc10 comp rx=0 tx=0).stop 2023-07-07T18:14:57.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 shutdown_connections 2023-07-07T18:14:57.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f317806ace0 0x7f317806d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f319815c290 0x7f31980adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3180005200 0x7f31980b3170 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 --2- 172.21.15.12:0/1788420265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f319815ca90 0x7f31981e7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 >> 172.21.15.12:0/1788420265 conn(0x7f319806b920 msgr2=0x7f31980b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:57.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 shutdown_connections 2023-07-07T18:14:57.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.577+0000 7f319c8e9700 1 -- 172.21.15.12:0/1788420265 wait complete. 2023-07-07T18:14:57.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:14:57.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.717+0000 7f39238d1700 1 Processor -- start 2023-07-07T18:14:57.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.717+0000 7f39238d1700 1 -- start start 2023-07-07T18:14:57.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f39238d1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 0x7f391c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f39238d1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f391c06e030 0x7f391c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f39238d1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c06f0e0 con 0x7f391c15cf70 2023-07-07T18:14:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f39238d1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0ce2c0 con 0x7f391c06e030 2023-07-07T18:14:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f39238d1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0cdef0 con 0x7f391c0cd5e0 2023-07-07T18:14:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f3920e6c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f391c06e030 0x7f391c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f3921e6e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f391c15cf70 0x7f391c15d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54204/0 (socket says 172.21.15.12:54204) 2023-07-07T18:14:57.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f3920e6c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f391c06e030 0x7f391c06e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57004/0 (socket says 172.21.15.12:57004) 2023-07-07T18:14:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f3921e6e700 1 -- 172.21.15.12:0/1570325396 learned_addr learned my addr 172.21.15.12:0/1570325396 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.718+0000 7f392166d700 1 --2- 172.21.15.12:0/1570325396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 0x7f391c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f3920e6c700 1 -- 172.21.15.12:0/1570325396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 msgr2=0x7f391c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f3920e6c700 1 --2- 172.21.15.12:0/1570325396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 0x7f391c0cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f3920e6c700 1 -- 172.21.15.12:0/1570325396 >> v1:172.21.15.12:6789/0 conn(0x7f391c15cf70 legacy=0x7f391c15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f3920e6c700 1 -- 172.21.15.12:0/1570325396 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c06eb20 con 0x7f391c06e030 2023-07-07T18:14:57.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f392166d700 1 --2- 172.21.15.12:0/1570325396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 0x7f391c0cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:57.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f3920e6c700 1 --2- 172.21.15.12:0/1570325396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 0x7f391c06e4a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3918009840 tx=0x7f3918009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e396bec7ed5954b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:57.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f3913fff700 1 -- 172.21.15.12:0/1570325396 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918011830 con 0x7f391c06e030 2023-07-07T18:14:57.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f3913fff700 1 -- 172.21.15.12:0/1570325396 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3918011990 con 0x7f391c06e030 2023-07-07T18:14:57.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f3913fff700 1 -- 172.21.15.12:0/1570325396 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918011d20 con 0x7f391c06e030 2023-07-07T18:14:57.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f39238d1700 1 -- 172.21.15.12:0/1570325396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 msgr2=0x7f391c06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f39238d1700 1 --2- 172.21.15.12:0/1570325396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 0x7f391c06e4a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3918009840 tx=0x7f3918009b50 comp rx=0 tx=0).stop 2023-07-07T18:14:57.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f39238d1700 1 -- 172.21.15.12:0/1570325396 shutdown_connections 2023-07-07T18:14:57.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f39238d1700 1 --2- 172.21.15.12:0/1570325396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 0x7f391c0cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f39238d1700 1 --2- 172.21.15.12:0/1570325396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 0x7f391c06e4a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.719+0000 7f39238d1700 1 -- 172.21.15.12:0/1570325396 >> 172.21.15.12:0/1570325396 conn(0x7f391c06b920 msgr2=0x7f391c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:57.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.720+0000 7f39238d1700 1 -- 172.21.15.12:0/1570325396 shutdown_connections 2023-07-07T18:14:57.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.720+0000 7f39238d1700 1 -- 172.21.15.12:0/1570325396 wait complete. 2023-07-07T18:14:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.721+0000 7f39238d1700 1 Processor -- start 2023-07-07T18:14:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.721+0000 7f39238d1700 1 -- start start 2023-07-07T18:14:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.721+0000 7f39238d1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 0x7f391c0ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f39238d1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 0x7f391c1631b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f39238d1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f391c15cf70 0x7f391c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f39238d1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0ae7f0 con 0x7f391c06e030 2023-07-07T18:14:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f39238d1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c14ef70 con 0x7f391c15cf70 2023-07-07T18:14:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f39238d1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c1636f0 con 0x7f391c0cd5e0 2023-07-07T18:14:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f392166d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 0x7f391c0ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f392166d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 0x7f391c0ae2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57008/0 (socket says 172.21.15.12:57008) 2023-07-07T18:14:57.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f392166d700 1 -- 172.21.15.12:0/85937622 learned_addr learned my addr 172.21.15.12:0/85937622 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f3920e6c700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 0x7f391c1631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f3921e6e700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f391c15cf70 0x7f391c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f392166d700 1 -- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 msgr2=0x7f391c1631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f392166d700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 0x7f391c1631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f392166d700 1 -- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f391c15cf70 msgr2=0x7f391c14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f392166d700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f391c15cf70 0x7f391c14e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f392166d700 1 -- 172.21.15.12:0/85937622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180094a0 con 0x7f391c06e030 2023-07-07T18:14:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f392166d700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 0x7f391c0ae2b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e810 tx=0x7f390c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:57.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f3911ffb700 1 -- 172.21.15.12:0/85937622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c005c20 con 0x7f391c06e030 2023-07-07T18:14:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f3911ffb700 1 -- 172.21.15.12:0/85937622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c005d80 con 0x7f391c06e030 2023-07-07T18:14:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c1623f0 con 0x7f391c06e030 2023-07-07T18:14:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.722+0000 7f3911ffb700 1 -- 172.21.15.12:0/85937622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c006230 con 0x7f391c06e030 2023-07-07T18:14:57.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.723+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c1629b0 con 0x7f391c06e030 2023-07-07T18:14:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.724+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c04ea20 con 0x7f391c06e030 2023-07-07T18:14:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.724+0000 7f3911ffb700 1 -- 172.21.15.12:0/85937622 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f390c006390 con 0x7f391c06e030 2023-07-07T18:14:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.724+0000 7f3911ffb700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f390006ace0 0x7f390006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:57.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.724+0000 7f3911ffb700 1 -- 172.21.15.12:0/85937622 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f390c0891e0 con 0x7f391c06e030 2023-07-07T18:14:57.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.725+0000 7f3920e6c700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f390006ace0 0x7f390006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:57.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.725+0000 7f3920e6c700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f390006ace0 0x7f390006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39180090b0 tx=0x7f3918008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:57.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.729+0000 7f3911ffb700 1 -- 172.21.15.12:0/85937622 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f390c054030 con 0x7f391c06e030 2023-07-07T18:14:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.929+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f391c0b5990 con 0x7f391c06e030 2023-07-07T18:14:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.930+0000 7f3911ffb700 1 -- 172.21.15.12:0/85937622 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f390c057650 con 0x7f391c06e030 2023-07-07T18:14:57.932 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:14:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f390006ace0 msgr2=0x7f390006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f390006ace0 0x7f390006d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39180090b0 tx=0x7f3918008030 comp rx=0 tx=0).stop 2023-07-07T18:14:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 msgr2=0x7f391c0ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 0x7f391c0ae2b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f390c00e810 tx=0x7f390c00ebd0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 shutdown_connections 2023-07-07T18:14:57.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f390006ace0 0x7f390006d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f391c15cf70 0x7f391c14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f391c06e030 0x7f391c0ae2b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 --2- 172.21.15.12:0/85937622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f391c0cd5e0 0x7f391c1631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:57.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 >> 172.21.15.12:0/85937622 conn(0x7f391c06b920 msgr2=0x7f391c0b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:57.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 shutdown_connections 2023-07-07T18:14:57.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:57.932+0000 7f39238d1700 1 -- 172.21.15.12:0/85937622 wait complete. 2023-07-07T18:14:57.947 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-07T18:14:58.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.072+0000 7f10ca277700 1 Processor -- start 2023-07-07T18:14:58.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.072+0000 7f10ca277700 1 -- start start 2023-07-07T18:14:58.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10ca277700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10c40cddd0 0x7f10c415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10ca277700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40aec10 0x7f10c40714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10ca277700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c40af090 con 0x7f10c40ae6c0 2023-07-07T18:14:58.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10ca277700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c40cdc80 con 0x7f10c40cddd0 2023-07-07T18:14:58.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10ca277700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c415d6a0 con 0x7f10c40aec10 2023-07-07T18:14:58.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10c40cddd0 0x7f10c415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10c40cddd0 0x7f10c415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57016/0 (socket says 172.21.15.12:57016) 2023-07-07T18:14:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c3fff700 1 -- 172.21.15.12:0/3713514777 learned_addr learned my addr 172.21.15.12:0/3713514777 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c8814700 1 --2- 172.21.15.12:0/3713514777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40aec10 0x7f10c40714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c3fff700 1 -- 172.21.15.12:0/3713514777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40aec10 msgr2=0x7f10c40714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c3fff700 1 --2- 172.21.15.12:0/3713514777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40aec10 0x7f10c40714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c3fff700 1 -- 172.21.15.12:0/3713514777 >> v1:172.21.15.160:6789/0 conn(0x7f10c40ae6c0 legacy=0x7f10c40ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c3fff700 1 -- 172.21.15.12:0/3713514777 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4159700 con 0x7f10c40cddd0 2023-07-07T18:14:58.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c8814700 1 --2- 172.21.15.12:0/3713514777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40aec10 0x7f10c40714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:14:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.073+0000 7f10c3fff700 1 --2- 172.21.15.12:0/3713514777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40cddd0 0x7f10c415a1e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f10b40098f0 tx=0x7f10b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b779dbe264e7f95 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10c2ffd700 1 -- 172.21.15.12:0/3713514777 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4004230 con 0x7f10c40cddd0 2023-07-07T18:14:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10c2ffd700 1 -- 172.21.15.12:0/3713514777 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b4004390 con 0x7f10c40cddd0 2023-07-07T18:14:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10c2ffd700 1 -- 172.21.15.12:0/3713514777 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b40036a0 con 0x7f10c40cddd0 2023-07-07T18:14:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10ca277700 1 -- 172.21.15.12:0/3713514777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40cddd0 msgr2=0x7f10c415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10ca277700 1 --2- 172.21.15.12:0/3713514777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40cddd0 0x7f10c415a1e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f10b40098f0 tx=0x7f10b4009c00 comp rx=0 tx=0).stop 2023-07-07T18:14:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10ca277700 1 -- 172.21.15.12:0/3713514777 shutdown_connections 2023-07-07T18:14:58.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10ca277700 1 --2- 172.21.15.12:0/3713514777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40aec10 0x7f10c40714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10ca277700 1 --2- 172.21.15.12:0/3713514777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40cddd0 0x7f10c415a1e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10ca277700 1 -- 172.21.15.12:0/3713514777 >> 172.21.15.12:0/3713514777 conn(0x7f10c406d4a0 msgr2=0x7f10c406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10ca277700 1 -- 172.21.15.12:0/3713514777 shutdown_connections 2023-07-07T18:14:58.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.074+0000 7f10ca277700 1 -- 172.21.15.12:0/3713514777 wait complete. 2023-07-07T18:14:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.075+0000 7f10ca277700 1 Processor -- start 2023-07-07T18:14:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10ca277700 1 -- start start 2023-07-07T18:14:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10ca277700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40ae6c0 0x7f10c4154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10ca277700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40aec10 0x7f10c40c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10ca277700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c40cddd0 0x7f10c40c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10ca277700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40c34c0 con 0x7f10c40aec10 2023-07-07T18:14:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10ca277700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40c57f0 con 0x7f10c40cddd0 2023-07-07T18:14:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10ca277700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c40c83b0 con 0x7f10c40ae6c0 2023-07-07T18:14:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10c37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40aec10 0x7f10c40c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10c37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40aec10 0x7f10c40c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57024/0 (socket says 172.21.15.12:57024) 2023-07-07T18:14:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.076+0000 7f10c37fe700 1 -- 172.21.15.12:0/3282816769 learned_addr learned my addr 172.21.15.12:0/3282816769 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c3fff700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40ae6c0 0x7f10c4154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c8814700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c40cddd0 0x7f10c40c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c37fe700 1 -- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40ae6c0 msgr2=0x7f10c4154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c37fe700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40ae6c0 0x7f10c4154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c37fe700 1 -- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c40cddd0 msgr2=0x7f10c40c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c37fe700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c40cddd0 0x7f10c40c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c37fe700 1 -- 172.21.15.12:0/3282816769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4009550 con 0x7f10c40aec10 2023-07-07T18:14:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c37fe700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40aec10 0x7f10c40c44e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f10b800b4d0 tx=0x7f10b800b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c0ff9700 1 -- 172.21.15.12:0/3282816769 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800bea0 con 0x7f10c40aec10 2023-07-07T18:14:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c0ff9700 1 -- 172.21.15.12:0/3282816769 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b8011830 con 0x7f10c40aec10 2023-07-07T18:14:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c40c4be0 con 0x7f10c40aec10 2023-07-07T18:14:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10c0ff9700 1 -- 172.21.15.12:0/3282816769 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8011be0 con 0x7f10c40aec10 2023-07-07T18:14:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.077+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c40c51a0 con 0x7f10c40aec10 2023-07-07T18:14:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.078+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c406f120 con 0x7f10c40aec10 2023-07-07T18:14:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.079+0000 7f10c0ff9700 1 -- 172.21.15.12:0/3282816769 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10b8011d40 con 0x7f10c40aec10 2023-07-07T18:14:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.079+0000 7f10c0ff9700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10b006ace0 0x7f10b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.079+0000 7f10c0ff9700 1 -- 172.21.15.12:0/3282816769 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f10b8089290 con 0x7f10c40aec10 2023-07-07T18:14:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.079+0000 7f10c3fff700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10b006ace0 0x7f10b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.080+0000 7f10c3fff700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10b006ace0 0x7f10b006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009130 tx=0x7f10b4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.083+0000 7f10c0ff9700 1 -- 172.21.15.12:0/3282816769 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10b80540e0 con 0x7f10c40aec10 2023-07-07T18:14:58.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.300+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f10c4073910 con 0x7f10c40aec10 2023-07-07T18:14:58.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.300+0000 7f10c0ff9700 1 -- 172.21.15.12:0/3282816769 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f10b8057700 con 0x7f10c40aec10 2023-07-07T18:14:58.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10b006ace0 msgr2=0x7f10b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10b006ace0 0x7f10b006d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009130 tx=0x7f10b4008030 comp rx=0 tx=0).stop 2023-07-07T18:14:58.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40aec10 msgr2=0x7f10c40c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40aec10 0x7f10c40c44e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f10b800b4d0 tx=0x7f10b800b7e0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 shutdown_connections 2023-07-07T18:14:58.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10b006ace0 0x7f10b006d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c40cddd0 0x7f10c40c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c40ae6c0 0x7f10c4154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 --2- 172.21.15.12:0/3282816769 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c40aec10 0x7f10c40c44e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.302+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 >> 172.21.15.12:0/3282816769 conn(0x7f10c406d4a0 msgr2=0x7f10c415c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:58.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.303+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 shutdown_connections 2023-07-07T18:14:58.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.303+0000 7f10ca277700 1 -- 172.21.15.12:0/3282816769 wait complete. 2023-07-07T18:14:58.307 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-07-07T18:14:58.317 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:14:58.317 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:14:58.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:14:58.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.498+0000 7f75a52be700 1 Processor -- start 2023-07-07T18:14:58.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.498+0000 7f75a52be700 1 -- start start 2023-07-07T18:14:58.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f75a52be700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f75a015c570 0x7f75a00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f75a52be700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f75a00cd660 0x7f75a0160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f75a52be700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a0160880 0x7f75a006b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f75a52be700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a015d670 con 0x7f75a015c570 2023-07-07T18:14:58.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f75a52be700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a00cdae0 con 0x7f75a00cd660 2023-07-07T18:14:58.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f75a52be700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a01610a0 con 0x7f75a0160880 2023-07-07T18:14:58.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f75a015c570 0x7f75a00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f75a015c570 0x7f75a00cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57036/0 (socket says 172.21.15.12:57036) 2023-07-07T18:14:58.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759effd700 1 -- 172.21.15.12:0/1979060414 learned_addr learned my addr 172.21.15.12:0/1979060414 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:58.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759e7fc700 1 --2- 172.21.15.12:0/1979060414 >> v2:172.21.15.160:3300/0 conn(0x7f75a00cd660 0x7f75a0160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759f7fe700 1 --2- 172.21.15.12:0/1979060414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a0160880 0x7f75a006b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759effd700 1 -- 172.21.15.12:0/1979060414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a0160880 msgr2=0x7f75a006b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:58.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759effd700 1 --2- 172.21.15.12:0/1979060414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a0160880 0x7f75a006b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759effd700 1 -- 172.21.15.12:0/1979060414 >> v2:172.21.15.160:3300/0 conn(0x7f75a00cd660 msgr2=0x7f75a0160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:58.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759effd700 1 --2- 172.21.15.12:0/1979060414 >> v2:172.21.15.160:3300/0 conn(0x7f75a00cd660 0x7f75a0160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759effd700 1 -- 172.21.15.12:0/1979060414 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a015da90 con 0x7f75a015c570 2023-07-07T18:14:58.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759e7fc700 1 --2- 172.21.15.12:0/1979060414 >> v2:172.21.15.160:3300/0 conn(0x7f75a00cd660 0x7f75a0160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:58.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759effd700 1 --2- 172.21.15.12:0/1979060414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 0x7f75a00cd120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75a008bc50 tx=0x7f7590009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e53181aa95ce4b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:58.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759dffb700 1 -- 172.21.15.12:0/1979060414 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759000b870 con 0x7f75a015c570 2023-07-07T18:14:58.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759dffb700 1 -- 172.21.15.12:0/1979060414 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759000b9d0 con 0x7f75a015c570 2023-07-07T18:14:58.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.499+0000 7f759dffb700 1 -- 172.21.15.12:0/1979060414 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759000bd60 con 0x7f75a015c570 2023-07-07T18:14:58.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.500+0000 7f75a52be700 1 -- 172.21.15.12:0/1979060414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 msgr2=0x7f75a00cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.500+0000 7f75a52be700 1 --2- 172.21.15.12:0/1979060414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 0x7f75a00cd120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75a008bc50 tx=0x7f7590009bd0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.500+0000 7f75a52be700 1 -- 172.21.15.12:0/1979060414 shutdown_connections 2023-07-07T18:14:58.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.500+0000 7f75a52be700 1 --2- 172.21.15.12:0/1979060414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a0160880 0x7f75a006b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.500+0000 7f75a52be700 1 --2- 172.21.15.12:0/1979060414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 0x7f75a00cd120 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.500+0000 7f75a52be700 1 --2- 172.21.15.12:0/1979060414 >> v2:172.21.15.160:3300/0 conn(0x7f75a00cd660 0x7f75a0160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.500+0000 7f75a52be700 1 -- 172.21.15.12:0/1979060414 >> 172.21.15.12:0/1979060414 conn(0x7f75a0071620 msgr2=0x7f75a00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:58.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.500+0000 7f75a52be700 1 -- 172.21.15.12:0/1979060414 shutdown_connections 2023-07-07T18:14:58.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.500+0000 7f75a52be700 1 -- 172.21.15.12:0/1979060414 wait complete. 2023-07-07T18:14:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.502+0000 7f75a52be700 1 Processor -- start 2023-07-07T18:14:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.502+0000 7f75a52be700 1 -- start start 2023-07-07T18:14:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f75a52be700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a00cd660 0x7f75a00b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f75a52be700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 0x7f75a00b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f75a52be700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75a0160880 0x7f75a00c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f75a52be700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a01498a0 con 0x7f75a015c570 2023-07-07T18:14:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f75a52be700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00c8970 con 0x7f75a0160880 2023-07-07T18:14:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f75a52be700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00c78d0 con 0x7f75a00cd660 2023-07-07T18:14:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 0x7f75a00b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759effd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a00cd660 0x7f75a00b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759effd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a00cd660 0x7f75a00b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46132/0 (socket says 172.21.15.12:46132) 2023-07-07T18:14:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759effd700 1 -- 172.21.15.12:0/2641993116 learned_addr learned my addr 172.21.15.12:0/2641993116 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759f7fe700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75a0160880 0x7f75a00c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759e7fc700 1 -- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a00cd660 msgr2=0x7f75a00b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759e7fc700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a00cd660 0x7f75a00b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759e7fc700 1 -- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75a0160880 msgr2=0x7f75a00c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759e7fc700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75a0160880 0x7f75a00c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759e7fc700 1 -- 172.21.15.12:0/2641993116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7590009550 con 0x7f75a015c570 2023-07-07T18:14:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f759e7fc700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 0x7f75a00b41b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f759400d5d0 tx=0x7f759400d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.503+0000 7f75877fe700 1 -- 172.21.15.12:0/2641993116 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594004030 con 0x7f75a015c570 2023-07-07T18:14:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.504+0000 7f75877fe700 1 -- 172.21.15.12:0/2641993116 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7594004190 con 0x7f75a015c570 2023-07-07T18:14:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.504+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a00c7bb0 con 0x7f75a015c570 2023-07-07T18:14:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.504+0000 7f75877fe700 1 -- 172.21.15.12:0/2641993116 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7594004540 con 0x7f75a015c570 2023-07-07T18:14:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.504+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a00c8170 con 0x7f75a015c570 2023-07-07T18:14:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.505+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a00ce990 con 0x7f75a015c570 2023-07-07T18:14:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.505+0000 7f75877fe700 1 -- 172.21.15.12:0/2641993116 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75940036a0 con 0x7f75a015c570 2023-07-07T18:14:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.505+0000 7f75877fe700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f758c06ace0 0x7f758c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.506+0000 7f75877fe700 1 -- 172.21.15.12:0/2641993116 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f75940894e0 con 0x7f75a015c570 2023-07-07T18:14:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.506+0000 7f759effd700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f758c06ace0 0x7f758c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.506+0000 7f759effd700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f758c06ace0 0x7f758c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7590009c10 tx=0x7f7590008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.510+0000 7f75877fe700 1 -- 172.21.15.12:0/2641993116 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7594054330 con 0x7f75a015c570 2023-07-07T18:14:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.708+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75a0073910 con 0x7f75a015c570 2023-07-07T18:14:58.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.709+0000 7f75877fe700 1 -- 172.21.15.12:0/2641993116 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f7594057950 con 0x7f75a015c570 2023-07-07T18:14:58.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:14:58.712 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:14:58.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f758c06ace0 msgr2=0x7f758c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f758c06ace0 0x7f758c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7590009c10 tx=0x7f7590008030 comp rx=0 tx=0).stop 2023-07-07T18:14:58.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 msgr2=0x7f75a00b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 0x7f75a00b41b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f759400d5d0 tx=0x7f759400d8e0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 shutdown_connections 2023-07-07T18:14:58.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f758c06ace0 0x7f758c06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75a0160880 0x7f75a00c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75a00cd660 0x7f75a00b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 --2- 172.21.15.12:0/2641993116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75a015c570 0x7f75a00b41b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 >> 172.21.15.12:0/2641993116 conn(0x7f75a0071620 msgr2=0x7f75a00d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:58.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 shutdown_connections 2023-07-07T18:14:58.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.711+0000 7f75a52be700 1 -- 172.21.15.12:0/2641993116 wait complete. 2023-07-07T18:14:58.726 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:14:58.728 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:14:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.854+0000 7f7eb1696700 1 Processor -- start 2023-07-07T18:14:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.854+0000 7f7eb1696700 1 -- start start 2023-07-07T18:14:58.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.855+0000 7f7eb1696700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7eac0d0a60 0x7f7eac0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.855+0000 7f7eb1696700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0cd9d0 con 0x7f7eac0b51d0 2023-07-07T18:14:58.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.855+0000 7f7eb1696700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0b5620 con 0x7f7eac0cf910 2023-07-07T18:14:58.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.855+0000 7f7eb1696700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0d0060 con 0x7f7eac0d0a60 2023-07-07T18:14:58.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.855+0000 7f7eaaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7eac0d0a60 0x7f7eac0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.855+0000 7f7eaaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7eac0d0a60 0x7f7eac0b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57050/0 (socket says 172.21.15.12:57050) 2023-07-07T18:14:58.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.855+0000 7f7eaa7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7eac0b51d0 0x7f7eac0d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54248/0 (socket says 172.21.15.12:54248) 2023-07-07T18:14:58.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.855+0000 7f7eaaffd700 1 -- 172.21.15.12:0/3731528860 learned_addr learned my addr 172.21.15.12:0/3731528860 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:58.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.856+0000 7f7eaaffd700 1 -- 172.21.15.12:0/3731528860 >> v1:172.21.15.160:6789/0 conn(0x7f7eac0cf910 legacy=0x7f7eac0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:58.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.856+0000 7f7eaaffd700 1 -- 172.21.15.12:0/3731528860 >> v1:172.21.15.12:6789/0 conn(0x7f7eac0b51d0 legacy=0x7f7eac0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.856+0000 7f7eaaffd700 1 -- 172.21.15.12:0/3731528860 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0cd410 con 0x7f7eac0d0a60 2023-07-07T18:14:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.856+0000 7f7ea9ffb700 1 -- 172.21.15.12:0/3731528860 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508231126 0 0) 0x7f7eac0cd9d0 con 0x7f7eac0b51d0 2023-07-07T18:14:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.856+0000 7f7eaaffd700 1 --2- 172.21.15.12:0/3731528860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 0x7f7eac0b5a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ea00098f0 tx=0x7f7ea0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fe2159a8871790 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:58.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.856+0000 7f7ea9ffb700 1 -- 172.21.15.12:0/3731528860 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0004230 con 0x7f7eac0d0a60 2023-07-07T18:14:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.856+0000 7f7ea9ffb700 1 -- 172.21.15.12:0/3731528860 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0004390 con 0x7f7eac0d0a60 2023-07-07T18:14:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.856+0000 7f7ea9ffb700 1 -- 172.21.15.12:0/3731528860 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00036a0 con 0x7f7eac0d0a60 2023-07-07T18:14:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.857+0000 7f7eb1696700 1 -- 172.21.15.12:0/3731528860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 msgr2=0x7f7eac0b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.857+0000 7f7eb1696700 1 --2- 172.21.15.12:0/3731528860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 0x7f7eac0b5a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7ea00098f0 tx=0x7f7ea0009c00 comp rx=0 tx=0).stop 2023-07-07T18:14:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.857+0000 7f7eb1696700 1 -- 172.21.15.12:0/3731528860 shutdown_connections 2023-07-07T18:14:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.857+0000 7f7eb1696700 1 --2- 172.21.15.12:0/3731528860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 0x7f7eac0b5a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.857+0000 7f7eb1696700 1 -- 172.21.15.12:0/3731528860 >> 172.21.15.12:0/3731528860 conn(0x7f7eac071620 msgr2=0x7f7eac0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:58.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.857+0000 7f7eb1696700 1 -- 172.21.15.12:0/3731528860 shutdown_connections 2023-07-07T18:14:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.857+0000 7f7eb1696700 1 -- 172.21.15.12:0/3731528860 wait complete. 2023-07-07T18:14:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.858+0000 7f7eb1696700 1 Processor -- start 2023-07-07T18:14:58.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.858+0000 7f7eb1696700 1 -- start start 2023-07-07T18:14:58.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eb1696700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7eac0b51d0 0x7f7eac0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eb1696700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eac0cf910 0x7f7eac15b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eb1696700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 0x7f7eac15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eb1696700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac1f2cd0 con 0x7f7eac0d0a60 2023-07-07T18:14:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eb1696700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c85e0 con 0x7f7eac0b51d0 2023-07-07T18:14:58.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eb1696700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c7820 con 0x7f7eac0cf910 2023-07-07T18:14:58.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 0x7f7eac15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eab7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 0x7f7eac15bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57058/0 (socket says 172.21.15.12:57058) 2023-07-07T18:14:58.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eab7fe700 1 -- 172.21.15.12:0/1004333985 learned_addr learned my addr 172.21.15.12:0/1004333985 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:58.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eaa7fc700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eac0cf910 0x7f7eac15b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eaaffd700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7eac0b51d0 0x7f7eac0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eab7fe700 1 -- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eac0cf910 msgr2=0x7f7eac15b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eab7fe700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eac0cf910 0x7f7eac15b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eab7fe700 1 -- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7eac0b51d0 msgr2=0x7f7eac0b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eab7fe700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7eac0b51d0 0x7f7eac0b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eab7fe700 1 -- 172.21.15.12:0/1004333985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea0009550 con 0x7f7eac0d0a60 2023-07-07T18:14:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eaa7fc700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eac0cf910 0x7f7eac15b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eaaffd700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7eac0b51d0 0x7f7eac0b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.859+0000 7f7eab7fe700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 0x7f7eac15bc90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400cc10 tx=0x7f7ea400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.860+0000 7f7e937fe700 1 -- 172.21.15.12:0/1004333985 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400abb0 con 0x7f7eac0d0a60 2023-07-07T18:14:58.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.860+0000 7f7e937fe700 1 -- 172.21.15.12:0/1004333985 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea400ad10 con 0x7f7eac0d0a60 2023-07-07T18:14:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.860+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac0c7b00 con 0x7f7eac0d0a60 2023-07-07T18:14:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.860+0000 7f7e937fe700 1 -- 172.21.15.12:0/1004333985 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4012660 con 0x7f7eac0d0a60 2023-07-07T18:14:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.860+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac0c80c0 con 0x7f7eac0d0a60 2023-07-07T18:14:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.861+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac0c82e0 con 0x7f7eac0d0a60 2023-07-07T18:14:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.861+0000 7f7e937fe700 1 -- 172.21.15.12:0/1004333985 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ea40127c0 con 0x7f7eac0d0a60 2023-07-07T18:14:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.861+0000 7f7e937fe700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9806ace0 0x7f7e9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:58.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.862+0000 7f7e937fe700 1 -- 172.21.15.12:0/1004333985 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ea4089f70 con 0x7f7eac0d0a60 2023-07-07T18:14:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.862+0000 7f7eaaffd700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9806ace0 0x7f7e9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.862+0000 7f7eaaffd700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9806ace0 0x7f7e9806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009130 tx=0x7f7ea0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:58.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:58.866+0000 7f7e937fe700 1 -- 172.21.15.12:0/1004333985 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ea40bc310 con 0x7f7eac0d0a60 2023-07-07T18:14:59.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.063+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7eac04ea20 con 0x7f7eac0d0a60 2023-07-07T18:14:59.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.064+0000 7f7e937fe700 1 -- 172.21.15.12:0/1004333985 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ea4016020 con 0x7f7eac0d0a60 2023-07-07T18:14:59.066 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:14:59.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.065+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9806ace0 msgr2=0x7f7e9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.065+0000 7f7eb1696700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9806ace0 0x7f7e9806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009130 tx=0x7f7ea0008030 comp rx=0 tx=0).stop 2023-07-07T18:14:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.065+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 msgr2=0x7f7eac15bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.065+0000 7f7eb1696700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 0x7f7eac15bc90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400cc10 tx=0x7f7ea400a060 comp rx=0 tx=0).stop 2023-07-07T18:14:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.066+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 shutdown_connections 2023-07-07T18:14:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.066+0000 7f7eb1696700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9806ace0 0x7f7e9806d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.066+0000 7f7eb1696700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7eac0d0a60 0x7f7eac15bc90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.066+0000 7f7eb1696700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7eac0b51d0 0x7f7eac0b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.066+0000 7f7eb1696700 1 --2- 172.21.15.12:0/1004333985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7eac0cf910 0x7f7eac15b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.066+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 >> 172.21.15.12:0/1004333985 conn(0x7f7eac071620 msgr2=0x7f7eac0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.066+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 shutdown_connections 2023-07-07T18:14:59.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.066+0000 7f7eb1696700 1 -- 172.21.15.12:0/1004333985 wait complete. 2023-07-07T18:14:59.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:14:59.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.205+0000 7fc6ae907700 1 Processor -- start 2023-07-07T18:14:59.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.205+0000 7fc6ae907700 1 -- start start 2023-07-07T18:14:59.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.206+0000 7fc6ae907700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc6a815fc60 0x7fc6a806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.206+0000 7fc6ae907700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6a80aecc0 0x7fc6a80ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.206+0000 7fc6ae907700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 0x7fc6a806e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.206+0000 7fc6ae907700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80ce620 con 0x7fc6a80aecc0 2023-07-07T18:14:59.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.206+0000 7fc6ae907700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a806ec00 con 0x7fc6a815fc60 2023-07-07T18:14:59.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.206+0000 7fc6ae907700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a8160580 con 0x7fc6a806e260 2023-07-07T18:14:59.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.206+0000 7fc6a77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6a80aecc0 0x7fc6a80ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.206+0000 7fc6a77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc6a80aecc0 0x7fc6a80ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57062/0 (socket says 172.21.15.12:57062) 2023-07-07T18:14:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.206+0000 7fc6a77fe700 1 -- 172.21.15.12:0/437350872 learned_addr learned my addr 172.21.15.12:0/437350872 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6acea4700 1 --2- 172.21.15.12:0/437350872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 0x7fc6a806e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/437350872 >> v2:172.21.15.160:3300/0 conn(0x7fc6a815fc60 0x7fc6a806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a77fe700 1 -- 172.21.15.12:0/437350872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 msgr2=0x7fc6a806e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a77fe700 1 --2- 172.21.15.12:0/437350872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 0x7fc6a806e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a77fe700 1 -- 172.21.15.12:0/437350872 >> v2:172.21.15.160:3300/0 conn(0x7fc6a815fc60 msgr2=0x7fc6a806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a77fe700 1 --2- 172.21.15.12:0/437350872 >> v2:172.21.15.160:3300/0 conn(0x7fc6a815fc60 0x7fc6a806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a77fe700 1 -- 172.21.15.12:0/437350872 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8160860 con 0x7fc6a80aecc0 2023-07-07T18:14:59.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a77fe700 1 --2- 172.21.15.12:0/437350872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 0x7fc6a80ac600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8066830 tx=0x7fc698009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8213c7cbbaca70 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:59.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a6ffd700 1 -- 172.21.15.12:0/437350872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69800b870 con 0x7fc6a80aecc0 2023-07-07T18:14:59.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a6ffd700 1 -- 172.21.15.12:0/437350872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69800b9d0 con 0x7fc6a80aecc0 2023-07-07T18:14:59.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.207+0000 7fc6a6ffd700 1 -- 172.21.15.12:0/437350872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69800bd60 con 0x7fc6a80aecc0 2023-07-07T18:14:59.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.208+0000 7fc6ae907700 1 -- 172.21.15.12:0/437350872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 msgr2=0x7fc6a80ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.208+0000 7fc6ae907700 1 --2- 172.21.15.12:0/437350872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 0x7fc6a80ac600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8066830 tx=0x7fc698009bd0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.208+0000 7fc6ae907700 1 -- 172.21.15.12:0/437350872 shutdown_connections 2023-07-07T18:14:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.208+0000 7fc6ae907700 1 --2- 172.21.15.12:0/437350872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 0x7fc6a806e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.208+0000 7fc6ae907700 1 --2- 172.21.15.12:0/437350872 >> v2:172.21.15.160:3300/0 conn(0x7fc6a815fc60 0x7fc6a806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.208+0000 7fc6ae907700 1 --2- 172.21.15.12:0/437350872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 0x7fc6a80ac600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.208+0000 7fc6ae907700 1 -- 172.21.15.12:0/437350872 >> 172.21.15.12:0/437350872 conn(0x7fc6a806b920 msgr2=0x7fc6a80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.208+0000 7fc6ae907700 1 -- 172.21.15.12:0/437350872 shutdown_connections 2023-07-07T18:14:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.208+0000 7fc6ae907700 1 -- 172.21.15.12:0/437350872 wait complete. 2023-07-07T18:14:59.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.209+0000 7fc6ae907700 1 Processor -- start 2023-07-07T18:14:59.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.209+0000 7fc6ae907700 1 -- start start 2023-07-07T18:14:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6ae907700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 0x7fc6a81537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6ae907700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 0x7fc6a81e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6ae907700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6a815fc60 0x7fc6a81e7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6ae907700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a81e7cb0 con 0x7fc6a80aecc0 2023-07-07T18:14:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6ae907700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80c9440 con 0x7fc6a815fc60 2023-07-07T18:14:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6ae907700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80b28e0 con 0x7fc6a806e260 2023-07-07T18:14:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 0x7fc6a81e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 0x7fc6a81e7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57068/0 (socket says 172.21.15.12:57068) 2023-07-07T18:14:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a77fe700 1 -- 172.21.15.12:0/1132949792 learned_addr learned my addr 172.21.15.12:0/1132949792 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 0x7fc6a81537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6acea4700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6a815fc60 0x7fc6a81e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a77fe700 1 -- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 msgr2=0x7fc6a81537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a77fe700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 0x7fc6a81537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a77fe700 1 -- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6a815fc60 msgr2=0x7fc6a81e7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a77fe700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6a815fc60 0x7fc6a81e7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a77fe700 1 -- 172.21.15.12:0/1132949792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698009550 con 0x7fc6a80aecc0 2023-07-07T18:14:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6acea4700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6a815fc60 0x7fc6a81e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.210+0000 7fc6a77fe700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 0x7fc6a81e7230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc698000c00 tx=0x7fc698004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.211+0000 7fc6a4ff9700 1 -- 172.21.15.12:0/1132949792 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698004540 con 0x7fc6a80aecc0 2023-07-07T18:14:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.211+0000 7fc6a4ff9700 1 -- 172.21.15.12:0/1132949792 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6980036a0 con 0x7fc6a80aecc0 2023-07-07T18:14:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.211+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a80b2bc0 con 0x7fc6a80aecc0 2023-07-07T18:14:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.211+0000 7fc6a4ff9700 1 -- 172.21.15.12:0/1132949792 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698003a50 con 0x7fc6a80aecc0 2023-07-07T18:14:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.211+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a80b3180 con 0x7fc6a80aecc0 2023-07-07T18:14:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.212+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a804ea20 con 0x7fc6a80aecc0 2023-07-07T18:14:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.212+0000 7fc6a4ff9700 1 -- 172.21.15.12:0/1132949792 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc698021070 con 0x7fc6a80aecc0 2023-07-07T18:14:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.212+0000 7fc6a4ff9700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc68806ace0 0x7fc68806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.212+0000 7fc6a4ff9700 1 -- 172.21.15.12:0/1132949792 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc69808ada0 con 0x7fc6a80aecc0 2023-07-07T18:14:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.213+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc68806ace0 0x7fc68806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.213+0000 7fc6a7fff700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc68806ace0 0x7fc68806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8070c50 tx=0x7fc690008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.217+0000 7fc6a4ff9700 1 -- 172.21.15.12:0/1132949792 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc698055bf0 con 0x7fc6a80aecc0 2023-07-07T18:14:59.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.416+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6a806e750 con 0x7fc6a80aecc0 2023-07-07T18:14:59.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.416+0000 7fc6a4ff9700 1 -- 172.21.15.12:0/1132949792 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6980150a0 con 0x7fc6a80aecc0 2023-07-07T18:14:59.418 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:14:59.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc68806ace0 msgr2=0x7fc68806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc68806ace0 0x7fc68806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8070c50 tx=0x7fc690008040 comp rx=0 tx=0).stop 2023-07-07T18:14:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 msgr2=0x7fc6a81e7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 0x7fc6a81e7230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc698000c00 tx=0x7fc698004750 comp rx=0 tx=0).stop 2023-07-07T18:14:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 shutdown_connections 2023-07-07T18:14:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc68806ace0 0x7fc68806d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6a815fc60 0x7fc6a81e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6a806e260 0x7fc6a81537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 --2- 172.21.15.12:0/1132949792 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc6a80aecc0 0x7fc6a81e7230 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 >> 172.21.15.12:0/1132949792 conn(0x7fc6a806b920 msgr2=0x7fc6a80afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:59.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 shutdown_connections 2023-07-07T18:14:59.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.418+0000 7fc6ae907700 1 -- 172.21.15.12:0/1132949792 wait complete. 2023-07-07T18:14:59.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:14:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.558+0000 7fbca3d70700 1 Processor -- start 2023-07-07T18:14:59.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.558+0000 7fbca3d70700 1 -- start start 2023-07-07T18:14:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca3d70700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc9c0aecc0 0x7fbc9c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca3d70700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbc9c06e970 0x7fbc9c0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca3d70700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c0ce620 con 0x7fbc9c15fc60 2023-07-07T18:14:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca3d70700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c160580 con 0x7fbc9c0aecc0 2023-07-07T18:14:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca3d70700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c160860 con 0x7fbc9c06e970 2023-07-07T18:14:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca130b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc9c0aecc0 0x7fbc9c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca1b0c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbc9c15fc60 0x7fbc9c06e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54272/0 (socket says 172.21.15.12:54272) 2023-07-07T18:14:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca130b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc9c0aecc0 0x7fbc9c06a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57076/0 (socket says 172.21.15.12:57076) 2023-07-07T18:14:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca1b0c700 1 -- 172.21.15.12:0/1053788353 learned_addr learned my addr 172.21.15.12:0/1053788353 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:59.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca230d700 1 --2- 172.21.15.12:0/1053788353 >> v2:172.21.15.160:3300/0 conn(0x7fbc9c06e970 0x7fbc9c0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca130b700 1 -- 172.21.15.12:0/1053788353 >> v2:172.21.15.160:3300/0 conn(0x7fbc9c06e970 msgr2=0x7fbc9c0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca130b700 1 --2- 172.21.15.12:0/1053788353 >> v2:172.21.15.160:3300/0 conn(0x7fbc9c06e970 0x7fbc9c0ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca130b700 1 -- 172.21.15.12:0/1053788353 >> v1:172.21.15.12:6789/0 conn(0x7fbc9c15fc60 legacy=0x7fbc9c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca130b700 1 -- 172.21.15.12:0/1053788353 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c160b40 con 0x7fbc9c0aecc0 2023-07-07T18:14:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.559+0000 7fbca0b0a700 1 -- 172.21.15.12:0/1053788353 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087963390 0 0) 0x7fbc9c0ce620 con 0x7fbc9c15fc60 2023-07-07T18:14:59.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca130b700 1 --2- 172.21.15.12:0/1053788353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c0aecc0 0x7fbc9c06a900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0c34f0 tx=0x7fbc98009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bf5868278f1cd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca0b0a700 1 -- 172.21.15.12:0/1053788353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98011830 con 0x7fbc9c0aecc0 2023-07-07T18:14:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca0b0a700 1 -- 172.21.15.12:0/1053788353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98011990 con 0x7fbc9c0aecc0 2023-07-07T18:14:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca0b0a700 1 -- 172.21.15.12:0/1053788353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98011d20 con 0x7fbc9c0aecc0 2023-07-07T18:14:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca3d70700 1 -- 172.21.15.12:0/1053788353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c0aecc0 msgr2=0x7fbc9c06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca3d70700 1 --2- 172.21.15.12:0/1053788353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c0aecc0 0x7fbc9c06a900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0c34f0 tx=0x7fbc98009b20 comp rx=0 tx=0).stop 2023-07-07T18:14:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca3d70700 1 -- 172.21.15.12:0/1053788353 shutdown_connections 2023-07-07T18:14:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca3d70700 1 --2- 172.21.15.12:0/1053788353 >> v2:172.21.15.160:3300/0 conn(0x7fbc9c06e970 0x7fbc9c0ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca3d70700 1 --2- 172.21.15.12:0/1053788353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c0aecc0 0x7fbc9c06a900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca3d70700 1 -- 172.21.15.12:0/1053788353 >> 172.21.15.12:0/1053788353 conn(0x7fbc9c06b920 msgr2=0x7fbc9c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:59.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca3d70700 1 -- 172.21.15.12:0/1053788353 shutdown_connections 2023-07-07T18:14:59.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.560+0000 7fbca3d70700 1 -- 172.21.15.12:0/1053788353 wait complete. 2023-07-07T18:14:59.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca3d70700 1 Processor -- start 2023-07-07T18:14:59.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca3d70700 1 -- start start 2023-07-07T18:14:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca3d70700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c06e970 0x7fbc9c154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca3d70700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0aecc0 0x7fbc9c0c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca3d70700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c15fc60 0x7fbc9c0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca3d70700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c0c59c0 con 0x7fbc9c06e970 2023-07-07T18:14:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca3d70700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c0c56e0 con 0x7fbc9c0aecc0 2023-07-07T18:14:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca3d70700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c1e60b0 con 0x7fbc9c15fc60 2023-07-07T18:14:59.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca1b0c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c06e970 0x7fbc9c154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca1b0c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c06e970 0x7fbc9c154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57080/0 (socket says 172.21.15.12:57080) 2023-07-07T18:14:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.562+0000 7fbca1b0c700 1 -- 172.21.15.12:0/892201937 learned_addr learned my addr 172.21.15.12:0/892201937 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca230d700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c15fc60 0x7fbc9c0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca130b700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0aecc0 0x7fbc9c0c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca1b0c700 1 -- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c15fc60 msgr2=0x7fbc9c0c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca1b0c700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c15fc60 0x7fbc9c0c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca1b0c700 1 -- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0aecc0 msgr2=0x7fbc9c0c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca1b0c700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0aecc0 0x7fbc9c0c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca1b0c700 1 -- 172.21.15.12:0/892201937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc980094a0 con 0x7fbc9c06e970 2023-07-07T18:14:59.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca130b700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0aecc0 0x7fbc9c0c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:14:59.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca1b0c700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c06e970 0x7fbc9c154880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c4a0 tx=0x7fbc8c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:59.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbc927fc700 1 -- 172.21.15.12:0/892201937 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0074e0 con 0x7fbc9c06e970 2023-07-07T18:14:59.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbc927fc700 1 -- 172.21.15.12:0/892201937 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c007640 con 0x7fbc9c06e970 2023-07-07T18:14:59.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c1e6390 con 0x7fbc9c06e970 2023-07-07T18:14:59.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbc927fc700 1 -- 172.21.15.12:0/892201937 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c005a70 con 0x7fbc9c06e970 2023-07-07T18:14:59.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.563+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c0c4840 con 0x7fbc9c06e970 2023-07-07T18:14:59.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.564+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c1e5f10 con 0x7fbc9c06e970 2023-07-07T18:14:59.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.565+0000 7fbc927fc700 1 -- 172.21.15.12:0/892201937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc8c005bd0 con 0x7fbc9c06e970 2023-07-07T18:14:59.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.565+0000 7fbc927fc700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbc8006ace0 0x7fbc8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.565+0000 7fbc927fc700 1 -- 172.21.15.12:0/892201937 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbc8c088b80 con 0x7fbc9c06e970 2023-07-07T18:14:59.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.565+0000 7fbca130b700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbc8006ace0 0x7fbc8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.566+0000 7fbca130b700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbc8006ace0 0x7fbc8006d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbc980090b0 tx=0x7fbc98008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:59.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.569+0000 7fbc927fc700 1 -- 172.21.15.12:0/892201937 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc9c1e5f10 con 0x7fbc9c06e970 2023-07-07T18:14:59.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.766+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc9c1e5f10 con 0x7fbc9c06e970 2023-07-07T18:14:59.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.767+0000 7fbc927fc700 1 -- 172.21.15.12:0/892201937 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc8c017020 con 0x7fbc9c06e970 2023-07-07T18:14:59.769 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:14:59.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbc8006ace0 msgr2=0x7fbc8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbc8006ace0 0x7fbc8006d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbc980090b0 tx=0x7fbc98008030 comp rx=0 tx=0).stop 2023-07-07T18:14:59.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c06e970 msgr2=0x7fbc9c154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c06e970 0x7fbc9c154880 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00c4a0 tx=0x7fbc8c00c7b0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 shutdown_connections 2023-07-07T18:14:59.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbc8006ace0 0x7fbc8006d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c15fc60 0x7fbc9c0c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc9c06e970 0x7fbc9c154880 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 --2- 172.21.15.12:0/892201937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0aecc0 0x7fbc9c0c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 >> 172.21.15.12:0/892201937 conn(0x7fbc9c06b920 msgr2=0x7fbc9c15eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:59.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 shutdown_connections 2023-07-07T18:14:59.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.769+0000 7fbca3d70700 1 -- 172.21.15.12:0/892201937 wait complete. 2023-07-07T18:14:59.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:14:59.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.908+0000 7f6a49e09700 1 Processor -- start 2023-07-07T18:14:59.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.908+0000 7f6a49e09700 1 -- start start 2023-07-07T18:14:59.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a49e09700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6a4415fc60 0x7f6a4406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a49e09700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a440aecc0 0x7f6a440ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a49e09700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440ce620 con 0x7f6a4406e260 2023-07-07T18:14:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a49e09700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a44160580 con 0x7f6a4415fc60 2023-07-07T18:14:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a49e09700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44160860 con 0x7f6a440aecc0 2023-07-07T18:14:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a437fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6a4415fc60 0x7f6a4406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a43fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6a4406e260 0x7f6a440cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54290/0 (socket says 172.21.15.12:54290) 2023-07-07T18:14:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a437fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6a4415fc60 0x7f6a4406a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57088/0 (socket says 172.21.15.12:57088) 2023-07-07T18:14:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a43fff700 1 -- 172.21.15.12:0/3994756094 learned_addr learned my addr 172.21.15.12:0/3994756094 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:14:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a42ffd700 1 --2- 172.21.15.12:0/3994756094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a440aecc0 0x7f6a440ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a437fe700 1 -- 172.21.15.12:0/3994756094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a440aecc0 msgr2=0x7f6a440ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:14:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a437fe700 1 --2- 172.21.15.12:0/3994756094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a440aecc0 0x7f6a440ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a437fe700 1 -- 172.21.15.12:0/3994756094 >> v1:172.21.15.12:6789/0 conn(0x7f6a4406e260 legacy=0x7f6a440cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a437fe700 1 -- 172.21.15.12:0/3994756094 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44160b40 con 0x7f6a4415fc60 2023-07-07T18:14:59.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.909+0000 7f6a427fc700 1 -- 172.21.15.12:0/3994756094 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522745945 0 0) 0x7f6a440ce620 con 0x7f6a4406e260 2023-07-07T18:14:59.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a437fe700 1 --2- 172.21.15.12:0/3994756094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 0x7f6a4406a900 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009820 tx=0x7f6a34009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e86775621f12a10 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:59.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a427fc700 1 -- 172.21.15.12:0/3994756094 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34005e30 con 0x7f6a4415fc60 2023-07-07T18:14:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a427fc700 1 -- 172.21.15.12:0/3994756094 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a34006030 con 0x7f6a4415fc60 2023-07-07T18:14:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a427fc700 1 -- 172.21.15.12:0/3994756094 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a340063c0 con 0x7f6a4415fc60 2023-07-07T18:14:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a49e09700 1 -- 172.21.15.12:0/3994756094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 msgr2=0x7f6a4406a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a49e09700 1 --2- 172.21.15.12:0/3994756094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 0x7f6a4406a900 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009820 tx=0x7f6a34009b30 comp rx=0 tx=0).stop 2023-07-07T18:14:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a49e09700 1 -- 172.21.15.12:0/3994756094 shutdown_connections 2023-07-07T18:14:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a49e09700 1 --2- 172.21.15.12:0/3994756094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 0x7f6a4406a900 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a49e09700 1 --2- 172.21.15.12:0/3994756094 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a440aecc0 0x7f6a440ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a49e09700 1 -- 172.21.15.12:0/3994756094 >> 172.21.15.12:0/3994756094 conn(0x7f6a4406b920 msgr2=0x7f6a440cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:14:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a49e09700 1 -- 172.21.15.12:0/3994756094 shutdown_connections 2023-07-07T18:14:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.910+0000 7f6a49e09700 1 -- 172.21.15.12:0/3994756094 wait complete. 2023-07-07T18:14:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.912+0000 7f6a49e09700 1 Processor -- start 2023-07-07T18:14:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.912+0000 7f6a49e09700 1 -- start start 2023-07-07T18:14:59.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a49e09700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a4406e260 0x7f6a440c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a49e09700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a440aecc0 0x7f6a44156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a49e09700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 0x7f6a440b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a49e09700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441576b0 con 0x7f6a4415fc60 2023-07-07T18:14:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a49e09700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44156bc0 con 0x7f6a440aecc0 2023-07-07T18:14:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a49e09700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440b3740 con 0x7f6a4406e260 2023-07-07T18:14:59.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a43fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 0x7f6a440b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a43fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 0x7f6a440b4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57098/0 (socket says 172.21.15.12:57098) 2023-07-07T18:14:59.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a43fff700 1 -- 172.21.15.12:0/2642750239 learned_addr learned my addr 172.21.15.12:0/2642750239 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:14:59.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a437fe700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a4406e260 0x7f6a440c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a42ffd700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a440aecc0 0x7f6a44156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a43fff700 1 -- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a4406e260 msgr2=0x7f6a440c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a43fff700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a4406e260 0x7f6a440c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a43fff700 1 -- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a440aecc0 msgr2=0x7f6a44156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:14:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a43fff700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a440aecc0 0x7f6a44156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:14:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a43fff700 1 -- 172.21.15.12:0/2642750239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009430 con 0x7f6a4415fc60 2023-07-07T18:14:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a43fff700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 0x7f6a440b4500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00cca0 tx=0x7f6a3c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a3bfff700 1 -- 172.21.15.12:0/2642750239 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c00cea0 con 0x7f6a4415fc60 2023-07-07T18:14:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a3bfff700 1 -- 172.21.15.12:0/2642750239 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c00ade0 con 0x7f6a4415fc60 2023-07-07T18:14:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a440b3a20 con 0x7f6a4415fc60 2023-07-07T18:14:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a3bfff700 1 -- 172.21.15.12:0/2642750239 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c007310 con 0x7f6a4415fc60 2023-07-07T18:14:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.913+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a440b3fe0 con 0x7f6a4415fc60 2023-07-07T18:14:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.914+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a440b02e0 con 0x7f6a4415fc60 2023-07-07T18:14:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.915+0000 7f6a3bfff700 1 -- 172.21.15.12:0/2642750239 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a3c007470 con 0x7f6a4415fc60 2023-07-07T18:14:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.915+0000 7f6a3bfff700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6a2406ace0 0x7f6a2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:14:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.915+0000 7f6a3bfff700 1 -- 172.21.15.12:0/2642750239 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a3c089490 con 0x7f6a4415fc60 2023-07-07T18:14:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.916+0000 7f6a437fe700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6a2406ace0 0x7f6a2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:14:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.916+0000 7f6a437fe700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6a2406ace0 0x7f6a2406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a34000c00 tx=0x7f6a34008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:14:59.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:14:59.920+0000 7f6a3bfff700 1 -- 172.21.15.12:0/2642750239 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6a3c054240 con 0x7f6a4415fc60 2023-07-07T18:15:00.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.114+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a4404ea20 con 0x7f6a4415fc60 2023-07-07T18:15:00.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.114+0000 7f6a3bfff700 1 -- 172.21.15.12:0/2642750239 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a3c057860 con 0x7f6a4415fc60 2023-07-07T18:15:00.117 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:00.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6a2406ace0 msgr2=0x7f6a2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6a2406ace0 0x7f6a2406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a34000c00 tx=0x7f6a34008070 comp rx=0 tx=0).stop 2023-07-07T18:15:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 msgr2=0x7f6a440b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 0x7f6a440b4500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00cca0 tx=0x7f6a3c00a340 comp rx=0 tx=0).stop 2023-07-07T18:15:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 shutdown_connections 2023-07-07T18:15:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6a2406ace0 0x7f6a2406d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a4415fc60 0x7f6a440b4500 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a4406e260 0x7f6a440c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 --2- 172.21.15.12:0/2642750239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a440aecc0 0x7f6a44156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 >> 172.21.15.12:0/2642750239 conn(0x7f6a4406b920 msgr2=0x7f6a4415d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 shutdown_connections 2023-07-07T18:15:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.117+0000 7f6a49e09700 1 -- 172.21.15.12:0/2642750239 wait complete. 2023-07-07T18:15:00.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:00.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.256+0000 7f86816df700 1 Processor -- start 2023-07-07T18:15:00.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.256+0000 7f86816df700 1 -- start start 2023-07-07T18:15:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f86816df700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 0x7f867c0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f86816df700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f867c0b51d0 0x7f867c0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f86816df700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f867c0d0e30 0x7f867c0d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f86816df700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c0d0060 con 0x7f867c0b51d0 2023-07-07T18:15:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f86816df700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c0cfe50 con 0x7f867c0d0e30 2023-07-07T18:15:00.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f86816df700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0cd9d0 con 0x7f867c0d0a60 2023-07-07T18:15:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f867c0b51d0 0x7f867c0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f867c0b51d0 0x7f867c0cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57102/0 (socket says 172.21.15.12:57102) 2023-07-07T18:15:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867a7fc700 1 -- 172.21.15.12:0/3082273179 learned_addr learned my addr 172.21.15.12:0/3082273179 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867affd700 1 --2- 172.21.15.12:0/3082273179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 0x7f867c0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867b7fe700 1 --2- 172.21.15.12:0/3082273179 >> v2:172.21.15.160:3300/0 conn(0x7f867c0d0e30 0x7f867c0d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867a7fc700 1 -- 172.21.15.12:0/3082273179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 msgr2=0x7f867c0b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:00.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867a7fc700 1 --2- 172.21.15.12:0/3082273179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 0x7f867c0b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867a7fc700 1 -- 172.21.15.12:0/3082273179 >> v2:172.21.15.160:3300/0 conn(0x7f867c0d0e30 msgr2=0x7f867c0d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:00.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867a7fc700 1 --2- 172.21.15.12:0/3082273179 >> v2:172.21.15.160:3300/0 conn(0x7f867c0d0e30 0x7f867c0d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867a7fc700 1 -- 172.21.15.12:0/3082273179 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0b5640 con 0x7f867c0b51d0 2023-07-07T18:15:00.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f867a7fc700 1 --2- 172.21.15.12:0/3082273179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0b51d0 0x7f867c0cf910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f867c15fdd0 tx=0x7f8670009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ed24c8da608ace server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f8679ffb700 1 -- 172.21.15.12:0/3082273179 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670011830 con 0x7f867c0b51d0 2023-07-07T18:15:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f8679ffb700 1 -- 172.21.15.12:0/3082273179 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670011990 con 0x7f867c0b51d0 2023-07-07T18:15:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.257+0000 7f8679ffb700 1 -- 172.21.15.12:0/3082273179 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670011d20 con 0x7f867c0b51d0 2023-07-07T18:15:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.258+0000 7f86816df700 1 -- 172.21.15.12:0/3082273179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0b51d0 msgr2=0x7f867c0cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.258+0000 7f86816df700 1 --2- 172.21.15.12:0/3082273179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0b51d0 0x7f867c0cf910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f867c15fdd0 tx=0x7f8670009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.258+0000 7f86816df700 1 -- 172.21.15.12:0/3082273179 shutdown_connections 2023-07-07T18:15:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.258+0000 7f86816df700 1 --2- 172.21.15.12:0/3082273179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 0x7f867c0b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.258+0000 7f86816df700 1 --2- 172.21.15.12:0/3082273179 >> v2:172.21.15.160:3300/0 conn(0x7f867c0d0e30 0x7f867c0d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.258+0000 7f86816df700 1 --2- 172.21.15.12:0/3082273179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0b51d0 0x7f867c0cf910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.258+0000 7f86816df700 1 -- 172.21.15.12:0/3082273179 >> 172.21.15.12:0/3082273179 conn(0x7f867c071620 msgr2=0x7f867c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:00.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.258+0000 7f86816df700 1 -- 172.21.15.12:0/3082273179 shutdown_connections 2023-07-07T18:15:00.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.258+0000 7f86816df700 1 -- 172.21.15.12:0/3082273179 wait complete. 2023-07-07T18:15:00.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.259+0000 7f86816df700 1 Processor -- start 2023-07-07T18:15:00.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.259+0000 7f86816df700 1 -- start start 2023-07-07T18:15:00.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f86816df700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c0b51d0 0x7f867c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f86816df700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 0x7f867c15e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f86816df700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0d0e30 0x7f867c0c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f86816df700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c15e980 con 0x7f867c0d0e30 2023-07-07T18:15:00.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f86816df700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c15ec60 con 0x7f867c0b51d0 2023-07-07T18:15:00.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f86816df700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c15ef40 con 0x7f867c0d0a60 2023-07-07T18:15:00.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f867b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0d0e30 0x7f867c0c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f867b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0d0e30 0x7f867c0c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57112/0 (socket says 172.21.15.12:57112) 2023-07-07T18:15:00.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f867b7fe700 1 -- 172.21.15.12:0/1428108730 learned_addr learned my addr 172.21.15.12:0/1428108730 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:00.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f867a7fc700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 0x7f867c15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.260+0000 7f867affd700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c0b51d0 0x7f867c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f867b7fe700 1 -- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 msgr2=0x7f867c15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f867b7fe700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 0x7f867c15e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f867b7fe700 1 -- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c0b51d0 msgr2=0x7f867c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f867b7fe700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c0b51d0 0x7f867c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f867b7fe700 1 -- 172.21.15.12:0/1428108730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670009550 con 0x7f867c0d0e30 2023-07-07T18:15:00.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f867affd700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c0b51d0 0x7f867c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:00.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f867b7fe700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0d0e30 0x7f867c0c85a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f867400efc0 tx=0x7f867400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:00.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f86637fe700 1 -- 172.21.15.12:0/1428108730 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400cb80 con 0x7f867c0d0e30 2023-07-07T18:15:00.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f86637fe700 1 -- 172.21.15.12:0/1428108730 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867400f040 con 0x7f867c0d0e30 2023-07-07T18:15:00.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c149c40 con 0x7f867c0d0e30 2023-07-07T18:15:00.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f86637fe700 1 -- 172.21.15.12:0/1428108730 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674014480 con 0x7f867c0d0e30 2023-07-07T18:15:00.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.261+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c0b44c0 con 0x7f867c0d0e30 2023-07-07T18:15:00.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.262+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c14a160 con 0x7f867c0d0e30 2023-07-07T18:15:00.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.262+0000 7f86637fe700 1 -- 172.21.15.12:0/1428108730 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86740145e0 con 0x7f867c0d0e30 2023-07-07T18:15:00.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.263+0000 7f86637fe700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f866806ace0 0x7f866806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.263+0000 7f86637fe700 1 -- 172.21.15.12:0/1428108730 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8674089f70 con 0x7f867c0d0e30 2023-07-07T18:15:00.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.263+0000 7f867affd700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f866806ace0 0x7f866806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.264+0000 7f867affd700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f866806ace0 0x7f866806d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f866c009bb0 tx=0x7f866c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:00.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.267+0000 7f86637fe700 1 -- 172.21.15.12:0/1428108730 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86740bc310 con 0x7f867c0d0e30 2023-07-07T18:15:00.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.464+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f867c04ea20 con 0x7f867c0d0e30 2023-07-07T18:15:00.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.464+0000 7f86637fe700 1 -- 172.21.15.12:0/1428108730 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8674018020 con 0x7f867c0d0e30 2023-07-07T18:15:00.467 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:00.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f866806ace0 msgr2=0x7f866806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f866806ace0 0x7f866806d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f866c009bb0 tx=0x7f866c008040 comp rx=0 tx=0).stop 2023-07-07T18:15:00.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0d0e30 msgr2=0x7f867c0c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0d0e30 0x7f867c0c85a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f867400efc0 tx=0x7f867400c0c0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 shutdown_connections 2023-07-07T18:15:00.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f866806ace0 0x7f866806d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f867c0d0e30 0x7f867c0c85a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f867c0b51d0 0x7f867c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 --2- 172.21.15.12:0/1428108730 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f867c0d0a60 0x7f867c15e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 >> 172.21.15.12:0/1428108730 conn(0x7f867c071620 msgr2=0x7f867c0c9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:00.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 shutdown_connections 2023-07-07T18:15:00.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.466+0000 7f86816df700 1 -- 172.21.15.12:0/1428108730 wait complete. 2023-07-07T18:15:00.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-07T18:15:00.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.604+0000 7fe152e7d700 1 Processor -- start 2023-07-07T18:15:00.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.604+0000 7fe152e7d700 1 -- start start 2023-07-07T18:15:00.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe152e7d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe14c0caf00 0x7fe14c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe152e7d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c15b130 0x7fe14c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe152e7d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c0d1210 con 0x7fe14c15a820 2023-07-07T18:15:00.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe152e7d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c15b570 con 0x7fe14c0caf00 2023-07-07T18:15:00.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe152e7d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c154a80 con 0x7fe14c15b130 2023-07-07T18:15:00.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe14bfff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe14c0caf00 0x7fe14c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe15141a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c15b130 0x7fe14c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe14bfff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe14c0caf00 0x7fe14c15abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:52724/0 (socket says 172.21.15.12:52724) 2023-07-07T18:15:00.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe14bfff700 1 -- 172.21.15.12:0/1928649657 learned_addr learned my addr 172.21.15.12:0/1928649657 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:00.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe14bfff700 1 -- 172.21.15.12:0/1928649657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c15b130 msgr2=0x7fe14c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:00.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe14bfff700 1 --2- 172.21.15.12:0/1928649657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c15b130 0x7fe14c0ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe14bfff700 1 -- 172.21.15.12:0/1928649657 >> v1:172.21.15.160:6789/0 conn(0x7fe14c15a820 legacy=0x7fe14c0d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.605+0000 7fe14bfff700 1 -- 172.21.15.12:0/1928649657 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0cb380 con 0x7fe14c0caf00 2023-07-07T18:15:00.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe14bfff700 1 --2- 172.21.15.12:0/1928649657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14c0caf00 0x7fe14c15abf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1380098f0 tx=0x7fe138009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f350a92c1be6366f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:00.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe14b7fe700 1 -- 172.21.15.12:0/1928649657 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138011830 con 0x7fe14c0caf00 2023-07-07T18:15:00.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe14b7fe700 1 -- 172.21.15.12:0/1928649657 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe138011990 con 0x7fe14c0caf00 2023-07-07T18:15:00.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe14b7fe700 1 -- 172.21.15.12:0/1928649657 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138011d20 con 0x7fe14c0caf00 2023-07-07T18:15:00.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe152e7d700 1 -- 172.21.15.12:0/1928649657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14c0caf00 msgr2=0x7fe14c15abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe152e7d700 1 --2- 172.21.15.12:0/1928649657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14c0caf00 0x7fe14c15abf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1380098f0 tx=0x7fe138009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:00.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe152e7d700 1 -- 172.21.15.12:0/1928649657 shutdown_connections 2023-07-07T18:15:00.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe152e7d700 1 --2- 172.21.15.12:0/1928649657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c15b130 0x7fe14c0ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe152e7d700 1 --2- 172.21.15.12:0/1928649657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14c0caf00 0x7fe14c15abf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe152e7d700 1 -- 172.21.15.12:0/1928649657 >> 172.21.15.12:0/1928649657 conn(0x7fe14c06e530 msgr2=0x7fe14c06e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:00.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe152e7d700 1 -- 172.21.15.12:0/1928649657 shutdown_connections 2023-07-07T18:15:00.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.606+0000 7fe152e7d700 1 -- 172.21.15.12:0/1928649657 wait complete. 2023-07-07T18:15:00.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.608+0000 7fe152e7d700 1 Processor -- start 2023-07-07T18:15:00.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.608+0000 7fe152e7d700 1 -- start start 2023-07-07T18:15:00.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe152e7d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c0caf00 0x7fe14c151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe152e7d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe14c15a820 0x7fe14c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe152e7d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14c15b130 0x7fe14c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe152e7d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0b1fe0 con 0x7fe14c15a820 2023-07-07T18:15:00.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe152e7d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c13f260 con 0x7fe14c15b130 2023-07-07T18:15:00.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe152e7d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c0c7b00 con 0x7fe14c0caf00 2023-07-07T18:15:00.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe14bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe14c15a820 0x7fe14c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe14bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe14c15a820 0x7fe14c0b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57124/0 (socket says 172.21.15.12:57124) 2023-07-07T18:15:00.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe14bfff700 1 -- 172.21.15.12:0/4177270998 learned_addr learned my addr 172.21.15.12:0/4177270998 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:00.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.609+0000 7fe15141a700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14c15b130 0x7fe14c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe150c19700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c0caf00 0x7fe14c151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe14bfff700 1 -- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c0caf00 msgr2=0x7fe14c151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe14bfff700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c0caf00 0x7fe14c151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe14bfff700 1 -- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14c15b130 msgr2=0x7fe14c0b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe14bfff700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14c15b130 0x7fe14c0b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe14bfff700 1 -- 172.21.15.12:0/4177270998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe138009550 con 0x7fe14c15a820 2023-07-07T18:15:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe14bfff700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe14c15a820 0x7fe14c0b2470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe138000c00 tx=0x7fe138004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe1497fa700 1 -- 172.21.15.12:0/4177270998 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138004480 con 0x7fe14c15a820 2023-07-07T18:15:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe1497fa700 1 -- 172.21.15.12:0/4177270998 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13801f070 con 0x7fe14c15a820 2023-07-07T18:15:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe1497fa700 1 -- 172.21.15.12:0/4177270998 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1380038c0 con 0x7fe14c15a820 2023-07-07T18:15:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c0c7de0 con 0x7fe14c15a820 2023-07-07T18:15:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.610+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c0b1c70 con 0x7fe14c15a820 2023-07-07T18:15:00.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.611+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c0b2150 con 0x7fe14c15a820 2023-07-07T18:15:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.611+0000 7fe1497fa700 1 -- 172.21.15.12:0/4177270998 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe138021030 con 0x7fe14c15a820 2023-07-07T18:15:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.612+0000 7fe1497fa700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe13006ace0 0x7fe13006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.612+0000 7fe1497fa700 1 -- 172.21.15.12:0/4177270998 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe13808ab90 con 0x7fe14c15a820 2023-07-07T18:15:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.612+0000 7fe150c19700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe13006ace0 0x7fe13006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.613+0000 7fe150c19700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe13006ace0 0x7fe13006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0b3150 tx=0x7fe140009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:00.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.616+0000 7fe1497fa700 1 -- 172.21.15.12:0/4177270998 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1380559e0 con 0x7fe14c15a820 2023-07-07T18:15:00.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.831+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe14c073910 con 0x7fe14c15a820 2023-07-07T18:15:00.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.832+0000 7fe1497fa700 1 -- 172.21.15.12:0/4177270998 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe138015080 con 0x7fe14c15a820 2023-07-07T18:15:00.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe13006ace0 msgr2=0x7fe13006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe13006ace0 0x7fe13006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0b3150 tx=0x7fe140009040 comp rx=0 tx=0).stop 2023-07-07T18:15:00.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe14c15a820 msgr2=0x7fe14c0b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:00.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe14c15a820 0x7fe14c0b2470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe138000c00 tx=0x7fe138004750 comp rx=0 tx=0).stop 2023-07-07T18:15:00.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 shutdown_connections 2023-07-07T18:15:00.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe13006ace0 0x7fe13006d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe14c15b130 0x7fe14c0b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe14c0caf00 0x7fe14c151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 --2- 172.21.15.12:0/4177270998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe14c15a820 0x7fe14c0b2470 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:00.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 >> 172.21.15.12:0/4177270998 conn(0x7fe14c06e530 msgr2=0x7fe14c0b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:00.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 shutdown_connections 2023-07-07T18:15:00.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:00.834+0000 7fe152e7d700 1 -- 172.21.15.12:0/4177270998 wait complete. 2023-07-07T18:15:00.838 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-07-07T18:15:00.847 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2023-07-07T18:15:00.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:00.848 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-07T18:15:00.890 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:ceph-fuse[138286]: fuse finished with error 0 and tester_r 0 2023-07-07T18:15:00.891 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T18:15:06.992 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T18:15:06.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:06.993 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-07T18:15:07.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:07.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.208+0000 7f17f5500700 1 Processor -- start 2023-07-07T18:15:07.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.208+0000 7f17f5500700 1 -- start start 2023-07-07T18:15:07.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.209+0000 7f17f5500700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f17f0158550 0x7f17f006d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.209+0000 7f17f5500700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f006e190 con 0x7f17f006a600 2023-07-07T18:15:07.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.209+0000 7f17f5500700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f00ccdc0 con 0x7f17f006d5a0 2023-07-07T18:15:07.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.209+0000 7f17f5500700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f00c8ce0 con 0x7f17f0158550 2023-07-07T18:15:07.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.209+0000 7f17ef7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f17f006a600 0x7f17f00c96f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54330/0 (socket says 172.21.15.12:54330) 2023-07-07T18:15:07.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.209+0000 7f17ef7fe700 1 -- 172.21.15.12:0/3875824210 learned_addr learned my addr 172.21.15.12:0/3875824210 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:07.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.209+0000 7f17eeffd700 1 --2- 172.21.15.12:0/3875824210 >> v2:172.21.15.160:3300/0 conn(0x7f17f0158550 0x7f17f006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17edffb700 1 -- 172.21.15.12:0/3875824210 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952833405 0 0) 0x7f17f006e190 con 0x7f17f006a600 2023-07-07T18:15:07.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17edffb700 1 -- 172.21.15.12:0/3875824210 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17dc0035b0 con 0x7f17f006a600 2023-07-07T18:15:07.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17edffb700 1 -- 172.21.15.12:0/3875824210 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346155645 0 0) 0x7f17dc0035b0 con 0x7f17f006a600 2023-07-07T18:15:07.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17eeffd700 1 -- 172.21.15.12:0/3875824210 >> v1:172.21.15.160:6789/0 conn(0x7f17f006d5a0 legacy=0x7f17f0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17eeffd700 1 -- 172.21.15.12:0/3875824210 >> v1:172.21.15.12:6789/0 conn(0x7f17f006a600 legacy=0x7f17f00c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17eeffd700 1 -- 172.21.15.12:0/3875824210 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f006dbd0 con 0x7f17f0158550 2023-07-07T18:15:07.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17eeffd700 1 --2- 172.21.15.12:0/3875824210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 0x7f17f006d060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f17e000aa10 tx=0x7f17e000ad20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48bcd8db29901183 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:07.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17edffb700 1 -- 172.21.15.12:0/3875824210 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80019f0 con 0x7f17f0158550 2023-07-07T18:15:07.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17edffb700 1 -- 172.21.15.12:0/3875824210 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e000aeb0 con 0x7f17f0158550 2023-07-07T18:15:07.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.210+0000 7f17edffb700 1 -- 172.21.15.12:0/3875824210 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0004230 con 0x7f17f0158550 2023-07-07T18:15:07.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.211+0000 7f17f5500700 1 -- 172.21.15.12:0/3875824210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 msgr2=0x7f17f006d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.211+0000 7f17f5500700 1 --2- 172.21.15.12:0/3875824210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 0x7f17f006d060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f17e000aa10 tx=0x7f17e000ad20 comp rx=0 tx=0).stop 2023-07-07T18:15:07.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.211+0000 7f17f5500700 1 -- 172.21.15.12:0/3875824210 shutdown_connections 2023-07-07T18:15:07.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.211+0000 7f17f5500700 1 --2- 172.21.15.12:0/3875824210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 0x7f17f006d060 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.211+0000 7f17f5500700 1 -- 172.21.15.12:0/3875824210 >> 172.21.15.12:0/3875824210 conn(0x7f17f00b0ef0 msgr2=0x7f17f00ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:07.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.211+0000 7f17f5500700 1 -- 172.21.15.12:0/3875824210 shutdown_connections 2023-07-07T18:15:07.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.211+0000 7f17f5500700 1 -- 172.21.15.12:0/3875824210 wait complete. 2023-07-07T18:15:07.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.212+0000 7f17f5500700 1 Processor -- start 2023-07-07T18:15:07.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.212+0000 7f17f5500700 1 -- start start 2023-07-07T18:15:07.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.213+0000 7f17f5500700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f006a600 0x7f17f00ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.213+0000 7f17f5500700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f006d5a0 0x7f17f00b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.213+0000 7f17f5500700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 0x7f17f01515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.213+0000 7f17f5500700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00ab8d0 con 0x7f17f006a600 2023-07-07T18:15:07.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.213+0000 7f17f5500700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00abb20 con 0x7f17f0158550 2023-07-07T18:15:07.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.213+0000 7f17f5500700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f00abe00 con 0x7f17f006d5a0 2023-07-07T18:15:07.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.213+0000 7f17eeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f006a600 0x7f17f00ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.213+0000 7f17eeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f006a600 0x7f17f00ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57134/0 (socket says 172.21.15.12:57134) 2023-07-07T18:15:07.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.213+0000 7f17eeffd700 1 -- 172.21.15.12:0/3557739566 learned_addr learned my addr 172.21.15.12:0/3557739566 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:07.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17ef7fe700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 0x7f17f01515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17ee7fc700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f006d5a0 0x7f17f00b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17eeffd700 1 -- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f006d5a0 msgr2=0x7f17f00b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17eeffd700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f006d5a0 0x7f17f00b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17eeffd700 1 -- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 msgr2=0x7f17f01515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17eeffd700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 0x7f17f01515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17eeffd700 1 -- 172.21.15.12:0/3557739566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e000a640 con 0x7f17f006a600 2023-07-07T18:15:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17ef7fe700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 0x7f17f01515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17ee7fc700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f006d5a0 0x7f17f00b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17eeffd700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f006a600 0x7f17f00ca5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f17e0000c00 tx=0x7f17e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17e77fe700 1 -- 172.21.15.12:0/3557739566 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e001d070 con 0x7f17f006a600 2023-07-07T18:15:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17e77fe700 1 -- 172.21.15.12:0/3557739566 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e00038b0 con 0x7f17f006a600 2023-07-07T18:15:07.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f00ac0e0 con 0x7f17f006a600 2023-07-07T18:15:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17e77fe700 1 -- 172.21.15.12:0/3557739566 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0006e60 con 0x7f17f006a600 2023-07-07T18:15:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.214+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f00ac6a0 con 0x7f17f006a600 2023-07-07T18:15:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.215+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f0073910 con 0x7f17f006a600 2023-07-07T18:15:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.216+0000 7f17e77fe700 1 -- 172.21.15.12:0/3557739566 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17e0003c60 con 0x7f17f006a600 2023-07-07T18:15:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.216+0000 7f17e77fe700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f17d006ace0 0x7f17d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.216+0000 7f17e77fe700 1 -- 172.21.15.12:0/3557739566 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f17e008a7d0 con 0x7f17f006a600 2023-07-07T18:15:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.216+0000 7f17ee7fc700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f17d006ace0 0x7f17d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.217+0000 7f17ee7fc700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f17d006ace0 0x7f17d006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17f015b750 tx=0x7f17d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:07.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.220+0000 7f17e77fe700 1 -- 172.21.15.12:0/3557739566 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f17e00555a0 con 0x7f17f006a600 2023-07-07T18:15:07.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.417+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17f00abf40 con 0x7f17f006a600 2023-07-07T18:15:07.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.419+0000 7f17e77fe700 1 -- 172.21.15.12:0/3557739566 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f17f00abf40 con 0x7f17f006a600 2023-07-07T18:15:07.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:07.421 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f17d006ace0 msgr2=0x7f17d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f17d006ace0 0x7f17d006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f17f015b750 tx=0x7f17d8009040 comp rx=0 tx=0).stop 2023-07-07T18:15:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f006a600 msgr2=0x7f17f00ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f006a600 0x7f17f00ca5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f17e0000c00 tx=0x7f17e0004750 comp rx=0 tx=0).stop 2023-07-07T18:15:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 shutdown_connections 2023-07-07T18:15:07.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f17d006ace0 0x7f17d006d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0158550 0x7f17f01515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17f006a600 0x7f17f00ca5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 --2- 172.21.15.12:0/3557739566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f006d5a0 0x7f17f00b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 >> 172.21.15.12:0/3557739566 conn(0x7f17f00b0ef0 msgr2=0x7f17f00c41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:07.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 shutdown_connections 2023-07-07T18:15:07.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.421+0000 7f17f5500700 1 -- 172.21.15.12:0/3557739566 wait complete. 2023-07-07T18:15:07.436 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:07.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.558+0000 7fb0a3788700 1 Processor -- start 2023-07-07T18:15:07.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.558+0000 7fb0a3788700 1 -- start start 2023-07-07T18:15:07.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a3788700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb09c0d05d0 0x7fb09c06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a3788700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c0ae580 con 0x7fb09c0cec80 2023-07-07T18:15:07.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a3788700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c06f610 con 0x7fb09c15a640 2023-07-07T18:15:07.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a3788700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0adf70 con 0x7fb09c0d05d0 2023-07-07T18:15:07.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a1d25700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb09c0cec80 0x7fb09c0aea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54344/0 (socket says 172.21.15.12:54344) 2023-07-07T18:15:07.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a1d25700 1 -- 172.21.15.12:0/2888062752 learned_addr learned my addr 172.21.15.12:0/2888062752 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a0d23700 1 --2- 172.21.15.12:0/2888062752 >> v2:172.21.15.160:3300/0 conn(0x7fb09c0d05d0 0x7fb09c06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb093fff700 1 -- 172.21.15.12:0/2888062752 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845842256 0 0) 0x7fb09c0ae580 con 0x7fb09c0cec80 2023-07-07T18:15:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb093fff700 1 -- 172.21.15.12:0/2888062752 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0880035b0 con 0x7fb09c0cec80 2023-07-07T18:15:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a0d23700 1 -- 172.21.15.12:0/2888062752 >> v1:172.21.15.160:6789/0 conn(0x7fb09c15a640 legacy=0x7fb09c0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a0d23700 1 -- 172.21.15.12:0/2888062752 >> v1:172.21.15.12:6789/0 conn(0x7fb09c0cec80 legacy=0x7fb09c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.559+0000 7fb0a0d23700 1 -- 172.21.15.12:0/2888062752 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c06f860 con 0x7fb09c0d05d0 2023-07-07T18:15:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb0a0d23700 1 --2- 172.21.15.12:0/2888062752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb09c0d05d0 0x7fb09c06fe80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009840 tx=0x7fb08c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=698b5fae544166cd server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb093fff700 1 -- 172.21.15.12:0/2888062752 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c011830 con 0x7fb09c0d05d0 2023-07-07T18:15:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb093fff700 1 -- 172.21.15.12:0/2888062752 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c011990 con 0x7fb09c0d05d0 2023-07-07T18:15:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb093fff700 1 -- 172.21.15.12:0/2888062752 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c011d20 con 0x7fb09c0d05d0 2023-07-07T18:15:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb0a3788700 1 -- 172.21.15.12:0/2888062752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb09c0d05d0 msgr2=0x7fb09c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb0a3788700 1 --2- 172.21.15.12:0/2888062752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb09c0d05d0 0x7fb09c06fe80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009840 tx=0x7fb08c009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb0a3788700 1 -- 172.21.15.12:0/2888062752 shutdown_connections 2023-07-07T18:15:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb0a3788700 1 --2- 172.21.15.12:0/2888062752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb09c0d05d0 0x7fb09c06fe80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb0a3788700 1 -- 172.21.15.12:0/2888062752 >> 172.21.15.12:0/2888062752 conn(0x7fb09c089fe0 msgr2=0x7fb09c0d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb0a3788700 1 -- 172.21.15.12:0/2888062752 shutdown_connections 2023-07-07T18:15:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.560+0000 7fb0a3788700 1 -- 172.21.15.12:0/2888062752 wait complete. 2023-07-07T18:15:07.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.562+0000 7fb0a3788700 1 Processor -- start 2023-07-07T18:15:07.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.562+0000 7fb0a3788700 1 -- start start 2023-07-07T18:15:07.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.562+0000 7fb0a3788700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb09c0cec80 0x7fb09c151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.562+0000 7fb0a3788700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb09c0d05d0 0x7fb09c1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.562+0000 7fb0a3788700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb09c15a640 0x7fb09c151060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.562+0000 7fb0a3788700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c1515a0 con 0x7fb09c0d05d0 2023-07-07T18:15:07.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.562+0000 7fb0a3788700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c152300 con 0x7fb09c15a640 2023-07-07T18:15:07.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.562+0000 7fb0a3788700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c152730 con 0x7fb09c0cec80 2023-07-07T18:15:07.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.562+0000 7fb0a0d23700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb09c0d05d0 0x7fb09c1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a0d23700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb09c0d05d0 0x7fb09c1534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57150/0 (socket says 172.21.15.12:57150) 2023-07-07T18:15:07.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a0d23700 1 -- 172.21.15.12:0/1954971436 learned_addr learned my addr 172.21.15.12:0/1954971436 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:07.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a1d25700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb09c15a640 0x7fb09c151060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a1524700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb09c0cec80 0x7fb09c151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a0d23700 1 -- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb09c0cec80 msgr2=0x7fb09c151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a0d23700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb09c0cec80 0x7fb09c151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a0d23700 1 -- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb09c15a640 msgr2=0x7fb09c151060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a0d23700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb09c15a640 0x7fb09c151060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a0d23700 1 -- 172.21.15.12:0/1954971436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0094a0 con 0x7fb09c0d05d0 2023-07-07T18:15:07.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a1524700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb09c0cec80 0x7fb09c151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:07.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a0d23700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb09c0d05d0 0x7fb09c1534b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009fd0 tx=0x7fb08c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:07.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb091ffb700 1 -- 172.21.15.12:0/1954971436 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c0036a0 con 0x7fb09c0d05d0 2023-07-07T18:15:07.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb091ffb700 1 -- 172.21.15.12:0/1954971436 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c01f070 con 0x7fb09c0d05d0 2023-07-07T18:15:07.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c1529d0 con 0x7fb09c0d05d0 2023-07-07T18:15:07.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.563+0000 7fb091ffb700 1 -- 172.21.15.12:0/1954971436 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c003a20 con 0x7fb09c0d05d0 2023-07-07T18:15:07.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.564+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c152f90 con 0x7fb09c0d05d0 2023-07-07T18:15:07.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.564+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c153180 con 0x7fb09c0d05d0 2023-07-07T18:15:07.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.565+0000 7fb091ffb700 1 -- 172.21.15.12:0/1954971436 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb08c003b80 con 0x7fb09c0d05d0 2023-07-07T18:15:07.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.565+0000 7fb091ffb700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb08006ace0 0x7fb08006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.565+0000 7fb091ffb700 1 -- 172.21.15.12:0/1954971436 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb08c021070 con 0x7fb09c0d05d0 2023-07-07T18:15:07.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.566+0000 7fb0a1524700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb08006ace0 0x7fb08006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.566+0000 7fb0a1524700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb08006ace0 0x7fb08006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb098000f60 tx=0x7fb098009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:07.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.570+0000 7fb091ffb700 1 -- 172.21.15.12:0/1954971436 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb08c055e00 con 0x7fb09c0d05d0 2023-07-07T18:15:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.767+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb09c073910 con 0x7fb09c0d05d0 2023-07-07T18:15:07.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.768+0000 7fb091ffb700 1 -- 172.21.15.12:0/1954971436 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fb08c015090 con 0x7fb09c0d05d0 2023-07-07T18:15:07.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:07.771 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb08006ace0 msgr2=0x7fb08006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb08006ace0 0x7fb08006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb098000f60 tx=0x7fb098009040 comp rx=0 tx=0).stop 2023-07-07T18:15:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb09c0d05d0 msgr2=0x7fb09c1534b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb09c0d05d0 0x7fb09c1534b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009fd0 tx=0x7fb08c004750 comp rx=0 tx=0).stop 2023-07-07T18:15:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 shutdown_connections 2023-07-07T18:15:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb08006ace0 0x7fb08006d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb09c15a640 0x7fb09c151060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb09c0cec80 0x7fb09c151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 --2- 172.21.15.12:0/1954971436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb09c0d05d0 0x7fb09c1534b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 >> 172.21.15.12:0/1954971436 conn(0x7fb09c089fe0 msgr2=0x7fb09c06fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 shutdown_connections 2023-07-07T18:15:07.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.770+0000 7fb0a3788700 1 -- 172.21.15.12:0/1954971436 wait complete. 2023-07-07T18:15:07.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-07T18:15:07.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.910+0000 7f87b256c700 1 Processor -- start 2023-07-07T18:15:07.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.910+0000 7f87b256c700 1 -- start start 2023-07-07T18:15:07.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87b256c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f87ac0cd330 0x7f87ac070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87b256c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f87ac0afc40 0x7f87ac15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87b256c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0caf70 con 0x7f87ac15a330 2023-07-07T18:15:07.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87b256c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0cb210 con 0x7f87ac0cd330 2023-07-07T18:15:07.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87b256c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0ccc20 con 0x7f87ac0afc40 2023-07-07T18:15:07.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87abfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f87ac0cd330 0x7f87ac070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87abfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f87ac0cd330 0x7f87ac070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57156/0 (socket says 172.21.15.12:57156) 2023-07-07T18:15:07.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87abfff700 1 -- 172.21.15.12:0/148783638 learned_addr learned my addr 172.21.15.12:0/148783638 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:07.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87b0b09700 1 --2- 172.21.15.12:0/148783638 >> v2:172.21.15.160:3300/0 conn(0x7f87ac0afc40 0x7f87ac15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87abfff700 1 -- 172.21.15.12:0/148783638 >> v2:172.21.15.160:3300/0 conn(0x7f87ac0afc40 msgr2=0x7f87ac15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87abfff700 1 --2- 172.21.15.12:0/148783638 >> v2:172.21.15.160:3300/0 conn(0x7f87ac0afc40 0x7f87ac15dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87abfff700 1 -- 172.21.15.12:0/148783638 >> v1:172.21.15.160:6789/0 conn(0x7f87ac15a330 legacy=0x7f87ac0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87abfff700 1 -- 172.21.15.12:0/148783638 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0ccf00 con 0x7f87ac0cd330 2023-07-07T18:15:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87abfff700 1 --2- 172.21.15.12:0/148783638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac0cd330 0x7f87ac070980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0c43d0 tx=0x7f879c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2fa00a62aa042d server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87aaffd700 1 -- 172.21.15.12:0/148783638 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c011830 con 0x7f87ac0cd330 2023-07-07T18:15:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87aaffd700 1 -- 172.21.15.12:0/148783638 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c011990 con 0x7f87ac0cd330 2023-07-07T18:15:07.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.911+0000 7f87aaffd700 1 -- 172.21.15.12:0/148783638 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c011d20 con 0x7f87ac0cd330 2023-07-07T18:15:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.912+0000 7f87b256c700 1 -- 172.21.15.12:0/148783638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac0cd330 msgr2=0x7f87ac070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.912+0000 7f87b256c700 1 --2- 172.21.15.12:0/148783638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac0cd330 0x7f87ac070980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0c43d0 tx=0x7f879c009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.912+0000 7f87b256c700 1 -- 172.21.15.12:0/148783638 shutdown_connections 2023-07-07T18:15:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.912+0000 7f87b256c700 1 --2- 172.21.15.12:0/148783638 >> v2:172.21.15.160:3300/0 conn(0x7f87ac0afc40 0x7f87ac15dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.912+0000 7f87b256c700 1 --2- 172.21.15.12:0/148783638 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac0cd330 0x7f87ac070980 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.912+0000 7f87b256c700 1 -- 172.21.15.12:0/148783638 >> 172.21.15.12:0/148783638 conn(0x7f87ac06e5c0 msgr2=0x7f87ac06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:07.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.912+0000 7f87b256c700 1 -- 172.21.15.12:0/148783638 shutdown_connections 2023-07-07T18:15:07.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.912+0000 7f87b256c700 1 -- 172.21.15.12:0/148783638 wait complete. 2023-07-07T18:15:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.913+0000 7f87b256c700 1 Processor -- start 2023-07-07T18:15:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.913+0000 7f87b256c700 1 -- start start 2023-07-07T18:15:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b256c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87ac0afc40 0x7f87ac155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b256c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87ac0cd330 0x7f87ac158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b256c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac15a330 0x7f87ac0c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b256c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac155f70 con 0x7f87ac15a330 2023-07-07T18:15:07.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b256c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac156650 con 0x7f87ac0cd330 2023-07-07T18:15:07.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b256c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac15cc30 con 0x7f87ac0afc40 2023-07-07T18:15:07.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b0b09700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac15a330 0x7f87ac0c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b0b09700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac15a330 0x7f87ac0c65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57166/0 (socket says 172.21.15.12:57166) 2023-07-07T18:15:07.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b0b09700 1 -- 172.21.15.12:0/321831951 learned_addr learned my addr 172.21.15.12:0/321831951 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:07.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87abfff700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87ac0afc40 0x7f87ac155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87ab7fe700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87ac0cd330 0x7f87ac158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b0b09700 1 -- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87ac0afc40 msgr2=0x7f87ac155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b0b09700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87ac0afc40 0x7f87ac155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b0b09700 1 -- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87ac0cd330 msgr2=0x7f87ac158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:07.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b0b09700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87ac0cd330 0x7f87ac158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:07.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.914+0000 7f87b0b09700 1 -- 172.21.15.12:0/321831951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009550 con 0x7f87ac15a330 2023-07-07T18:15:07.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.915+0000 7f87b0b09700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac15a330 0x7f87ac0c65d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f87a400efc0 tx=0x7f87a400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:07.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.915+0000 7f87a8ff9700 1 -- 172.21.15.12:0/321831951 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400cad0 con 0x7f87ac15a330 2023-07-07T18:15:07.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.915+0000 7f87a8ff9700 1 -- 172.21.15.12:0/321831951 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a400f040 con 0x7f87ac15a330 2023-07-07T18:15:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.915+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac15cf10 con 0x7f87ac15a330 2023-07-07T18:15:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.915+0000 7f87a8ff9700 1 -- 172.21.15.12:0/321831951 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400ce70 con 0x7f87ac15a330 2023-07-07T18:15:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.915+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac15d4d0 con 0x7f87ac15a330 2023-07-07T18:15:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.916+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac04ea20 con 0x7f87ac15a330 2023-07-07T18:15:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.916+0000 7f87a8ff9700 1 -- 172.21.15.12:0/321831951 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87a4014480 con 0x7f87ac15a330 2023-07-07T18:15:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.917+0000 7f87a8ff9700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f879806ace0 0x7f879806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.917+0000 7f87a8ff9700 1 -- 172.21.15.12:0/321831951 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87a4089e60 con 0x7f87ac15a330 2023-07-07T18:15:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.917+0000 7f87abfff700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f879806ace0 0x7f879806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:07.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.917+0000 7f87abfff700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f879806ace0 0x7f879806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f879c009c10 tx=0x7f879c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:07.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:07.921+0000 7f87a8ff9700 1 -- 172.21.15.12:0/321831951 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87a4054cb0 con 0x7f87ac15a330 2023-07-07T18:15:08.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.167+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f87ac0c3da0 con 0x7f87ac15a330 2023-07-07T18:15:08.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.693+0000 7f87a8ff9700 1 -- 172.21.15.12:0/321831951 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f87a40180b0 con 0x7f87ac15a330 2023-07-07T18:15:08.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f879806ace0 msgr2=0x7f879806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:08.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f879806ace0 0x7f879806d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f879c009c10 tx=0x7f879c008030 comp rx=0 tx=0).stop 2023-07-07T18:15:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac15a330 msgr2=0x7f87ac0c65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac15a330 0x7f87ac0c65d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f87a400efc0 tx=0x7f87a400c0c0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 shutdown_connections 2023-07-07T18:15:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f879806ace0 0x7f879806d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac15a330 0x7f87ac0c65d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87ac0afc40 0x7f87ac155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 --2- 172.21.15.12:0/321831951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87ac0cd330 0x7f87ac158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 >> 172.21.15.12:0/321831951 conn(0x7f87ac06e5c0 msgr2=0x7f87ac0b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:08.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 shutdown_connections 2023-07-07T18:15:08.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.696+0000 7f87b256c700 1 -- 172.21.15.12:0/321831951 wait complete. 2023-07-07T18:15:08.712 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-07T18:15:08.713 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-07T18:15:08.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.845+0000 7f21f4e6a700 1 Processor -- start 2023-07-07T18:15:08.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.845+0000 7f21f4e6a700 1 -- start start 2023-07-07T18:15:08.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.846+0000 7f21f4e6a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21f006e4d0 0x7f21f00ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:08.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.846+0000 7f21f4e6a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f006f0e0 con 0x7f21f006e030 2023-07-07T18:15:08.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.846+0000 7f21f4e6a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f006eb20 con 0x7f21f00cd5e0 2023-07-07T18:15:08.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.846+0000 7f21f4e6a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00ce2c0 con 0x7f21f006e4d0 2023-07-07T18:15:08.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.846+0000 7f21edd9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f21f006e030 0x7f21f00acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54368/0 (socket says 172.21.15.12:54368) 2023-07-07T18:15:08.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.846+0000 7f21edd9b700 1 -- 172.21.15.12:0/4179911135 learned_addr learned my addr 172.21.15.12:0/4179911135 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:08.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21eed9d700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21f006e4d0 0x7f21f00ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:08.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767611255 0 0) 0x7f21f006f0e0 con 0x7f21f006e030 2023-07-07T18:15:08.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d80035b0 con 0x7f21f006e030 2023-07-07T18:15:08.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961576716 0 0) 0x7f21f006eb20 con 0x7f21f00cd5e0 2023-07-07T18:15:08.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f006f0e0 con 0x7f21f00cd5e0 2023-07-07T18:15:08.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4088979036 0 0) 0x7f21d80035b0 con 0x7f21f006e030 2023-07-07T18:15:08.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21f006e4d0 msgr2=0x7f21f00ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:08.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21f006e4d0 0x7f21f00ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 >> v1:172.21.15.160:6789/0 conn(0x7f21f00cd5e0 legacy=0x7f21f00cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:08.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f006ee00 con 0x7f21f006e030 2023-07-07T18:15:08.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f21e0001670 con 0x7f21f006e030 2023-07-07T18:15:08.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 >> v1:172.21.15.12:6789/0 conn(0x7f21f006e030 legacy=0x7f21f00acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:08.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21d8003bc0 0x7f21d8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:08.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21d8004850 0x7f21d8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:08.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d8005200 0x7f21d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:08.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00ce2c0 con 0x7f21d8005200 2023-07-07T18:15:08.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d800c0e0 con 0x7f21d8003bc0 2023-07-07T18:15:08.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d800e480 con 0x7f21d8004850 2023-07-07T18:15:08.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21eed9d700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21f006e4d0 0x7f21f00ad640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:08.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21edd9b700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21d8004850 0x7f21d8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:08.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21eed9d700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d8005200 0x7f21d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:08.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.847+0000 7f21ee59c700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21d8003bc0 0x7f21d8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:08.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21eed9d700 1 -- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21d8004850 msgr2=0x7f21d8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:08.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21eed9d700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21d8004850 0x7f21d8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21eed9d700 1 -- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21d8003bc0 msgr2=0x7f21d8003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:08.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21eed9d700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21d8003bc0 0x7f21d8003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21eed9d700 1 -- 172.21.15.12:0/4179911135 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d80035b0 con 0x7f21d8005200 2023-07-07T18:15:08.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21eed9d700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d8005200 0x7f21d800ba10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21f006e8a0 tx=0x7f21d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fda1d479234ed8 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:08.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8003c20 con 0x7f21d8005200 2023-07-07T18:15:08.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800f040 con 0x7f21d8005200 2023-07-07T18:15:08.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21ed59a700 1 -- 172.21.15.12:0/4179911135 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800ea60 con 0x7f21d8005200 2023-07-07T18:15:08.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21f4e6a700 1 -- 172.21.15.12:0/4179911135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d8005200 msgr2=0x7f21d800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:08.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21f4e6a700 1 --2- 172.21.15.12:0/4179911135 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d8005200 0x7f21d800ba10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21f006e8a0 tx=0x7f21d8005880 comp rx=0 tx=0).stop 2023-07-07T18:15:08.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.848+0000 7f21eed9d700 1 -- 172.21.15.12:0/4179911135 reap_dead start 2023-07-07T18:15:08.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.849+0000 7f21f4e6a700 1 -- 172.21.15.12:0/4179911135 shutdown_connections 2023-07-07T18:15:08.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.849+0000 7f21f4e6a700 1 -- 172.21.15.12:0/4179911135 >> 172.21.15.12:0/4179911135 conn(0x7f21f006b920 msgr2=0x7f21f00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:08.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.849+0000 7f21f4e6a700 1 -- 172.21.15.12:0/4179911135 shutdown_connections 2023-07-07T18:15:08.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.849+0000 7f21f4e6a700 1 -- 172.21.15.12:0/4179911135 wait complete. 2023-07-07T18:15:08.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.850+0000 7f21f4e6a700 1 Processor -- start 2023-07-07T18:15:08.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.850+0000 7f21f4e6a700 1 -- start start 2023-07-07T18:15:08.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21f4e6a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21d8005200 0x7f21f0155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21f4e6a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21f0158ac0 0x7f21f00c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21f4e6a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f00b3890 0x7f21f00b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21f4e6a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f00b4270 con 0x7f21f00b3890 2023-07-07T18:15:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21f4e6a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f0156170 con 0x7f21f0158ac0 2023-07-07T18:15:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21f4e6a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f0158f30 con 0x7f21d8005200 2023-07-07T18:15:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21eed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f00b3890 0x7f21f00b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:08.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21eed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f00b3890 0x7f21f00b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57186/0 (socket says 172.21.15.12:57186) 2023-07-07T18:15:08.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21eed9d700 1 -- 172.21.15.12:0/1377537888 learned_addr learned my addr 172.21.15.12:0/1377537888 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:08.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21ee59c700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21d8005200 0x7f21f0155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:08.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21edd9b700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21f0158ac0 0x7f21f00c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:08.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21eed9d700 1 -- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21d8005200 msgr2=0x7f21f0155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:08.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21eed9d700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21d8005200 0x7f21f0155ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21eed9d700 1 -- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21f0158ac0 msgr2=0x7f21f00c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:08.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21eed9d700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21f0158ac0 0x7f21f00c2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:08.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21eed9d700 1 -- 172.21.15.12:0/1377537888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f01f2430 con 0x7f21f00b3890 2023-07-07T18:15:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21eed9d700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f00b3890 0x7f21f00b3d30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21e8015000 tx=0x7f21e8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.851+0000 7f21deffd700 1 -- 172.21.15.12:0/1377537888 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8004230 con 0x7f21f00b3890 2023-07-07T18:15:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.852+0000 7f21deffd700 1 -- 172.21.15.12:0/1377537888 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e8023070 con 0x7f21f00b3890 2023-07-07T18:15:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.852+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f01f1670 con 0x7f21f00b3890 2023-07-07T18:15:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.852+0000 7f21deffd700 1 -- 172.21.15.12:0/1377537888 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80045f0 con 0x7f21f00b3890 2023-07-07T18:15:08.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.852+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f01f1c30 con 0x7f21f00b3890 2023-07-07T18:15:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.853+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f004ea20 con 0x7f21f00b3890 2023-07-07T18:15:08.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.853+0000 7f21deffd700 1 -- 172.21.15.12:0/1377537888 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21e8025030 con 0x7f21f00b3890 2023-07-07T18:15:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.853+0000 7f21deffd700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f21d006ace0 0x7f21d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.853+0000 7f21deffd700 1 -- 172.21.15.12:0/1377537888 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f21e808b000 con 0x7f21f00b3890 2023-07-07T18:15:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.854+0000 7f21ee59c700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f21d006ace0 0x7f21d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.854+0000 7f21ee59c700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f21d006ace0 0x7f21d006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000c00 tx=0x7f21e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:08.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:08.858+0000 7f21deffd700 1 -- 172.21.15.12:0/1377537888 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f21e8055e50 con 0x7f21f00b3890 2023-07-07T18:15:09.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.105+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f21f00c6810 con 0x7f21f00b3890 2023-07-07T18:15:09.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.698+0000 7f21deffd700 1 -- 172.21.15.12:0/1377537888 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f21e8059470 con 0x7f21f00b3890 2023-07-07T18:15:09.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f21d006ace0 msgr2=0x7f21d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:09.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f21d006ace0 0x7f21d006d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21e4000c00 tx=0x7f21e4009040 comp rx=0 tx=0).stop 2023-07-07T18:15:09.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f00b3890 msgr2=0x7f21f00b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f00b3890 0x7f21f00b3d30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21e8015000 tx=0x7f21e8009750 comp rx=0 tx=0).stop 2023-07-07T18:15:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 shutdown_connections 2023-07-07T18:15:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f21d006ace0 0x7f21d006d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21f00b3890 0x7f21f00b3d30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21d8005200 0x7f21f0155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 --2- 172.21.15.12:0/1377537888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21f0158ac0 0x7f21f00c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 >> 172.21.15.12:0/1377537888 conn(0x7f21f006b920 msgr2=0x7f21f00b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 shutdown_connections 2023-07-07T18:15:09.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.701+0000 7f21f4e6a700 1 -- 172.21.15.12:0/1377537888 wait complete. 2023-07-07T18:15:09.719 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-07T18:15:09.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:15:09.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.854+0000 7f74b2fd7700 1 Processor -- start 2023-07-07T18:15:09.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.854+0000 7f74b2fd7700 1 -- start start 2023-07-07T18:15:09.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74b2fd7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f74ac0709f0 0x7f74ac0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:09.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74b2fd7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0c9510 con 0x7f74ac158ef0 2023-07-07T18:15:09.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74b2fd7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0cd6a0 con 0x7f74ac06c060 2023-07-07T18:15:09.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74b2fd7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ac0cd980 con 0x7f74ac0709f0 2023-07-07T18:15:09.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74b0d73700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f74ac158ef0 0x7f74ac0702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54388/0 (socket says 172.21.15.12:54388) 2023-07-07T18:15:09.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74b0d73700 1 -- 172.21.15.12:0/3879279059 learned_addr learned my addr 172.21.15.12:0/3879279059 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:09.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74abfff700 1 --2- 172.21.15.12:0/3879279059 >> v2:172.21.15.160:3300/0 conn(0x7f74ac0709f0 0x7f74ac0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:09.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162215158 0 0) 0x7f74ac0c9510 con 0x7f74ac158ef0 2023-07-07T18:15:09.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f749c0035b0 con 0x7f74ac158ef0 2023-07-07T18:15:09.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3057790985 0 0) 0x7f749c0035b0 con 0x7f74ac158ef0 2023-07-07T18:15:09.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 >> v2:172.21.15.160:3300/0 conn(0x7f74ac0709f0 msgr2=0x7f74ac0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:09.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 --2- 172.21.15.12:0/3879279059 >> v2:172.21.15.160:3300/0 conn(0x7f74ac0709f0 0x7f74ac0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 >> v1:172.21.15.160:6789/0 conn(0x7f74ac06c060 legacy=0x7f74ac0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0c97b0 con 0x7f74ac158ef0 2023-07-07T18:15:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f74a0001670 con 0x7f74ac158ef0 2023-07-07T18:15:09.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 >> v1:172.21.15.12:6789/0 conn(0x7f74ac158ef0 legacy=0x7f74ac0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:09.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c003a00 0x7f749c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:09.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749c004850 0x7f749c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:09.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f749c005200 0x7f749c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:09.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0cd980 con 0x7f749c005200 2023-07-07T18:15:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c00c080 con 0x7f749c004850 2023-07-07T18:15:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.855+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c00c240 con 0x7f749c003a00 2023-07-07T18:15:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b1574700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f749c005200 0x7f749c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:09.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74abfff700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749c004850 0x7f749c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b0d73700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c003a00 0x7f749c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b1574700 1 -- 172.21.15.12:0/3879279059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c003a00 msgr2=0x7f749c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b1574700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c003a00 0x7f749c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b1574700 1 -- 172.21.15.12:0/3879279059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749c004850 msgr2=0x7f749c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:09.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b1574700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f749c004850 0x7f749c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b1574700 1 -- 172.21.15.12:0/3879279059 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c0035b0 con 0x7f749c005200 2023-07-07T18:15:09.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b0d73700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c003a00 0x7f749c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b1574700 1 -- 172.21.15.12:0/3879279059 reap_dead start 2023-07-07T18:15:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74b1574700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f749c005200 0x7f749c00ba10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c190 tx=0x7f749c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff03b5369cfb2b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4001db0 con 0x7f749c005200 2023-07-07T18:15:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a400ccf0 con 0x7f749c005200 2023-07-07T18:15:09.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.856+0000 7f74ab7fe700 1 -- 172.21.15.12:0/3879279059 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4003c40 con 0x7f749c005200 2023-07-07T18:15:09.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.857+0000 7f74b2fd7700 1 -- 172.21.15.12:0/3879279059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f749c005200 msgr2=0x7f749c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:09.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.857+0000 7f74b2fd7700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f749c005200 0x7f749c00ba10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f74a400c190 tx=0x7f749c005880 comp rx=0 tx=0).stop 2023-07-07T18:15:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.857+0000 7f74b2fd7700 1 -- 172.21.15.12:0/3879279059 shutdown_connections 2023-07-07T18:15:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.857+0000 7f74b2fd7700 1 --2- 172.21.15.12:0/3879279059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f749c005200 0x7f749c00ba10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.857+0000 7f74b2fd7700 1 -- 172.21.15.12:0/3879279059 >> 172.21.15.12:0/3879279059 conn(0x7f74ac0b0ef0 msgr2=0x7f74ac0ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.857+0000 7f74b2fd7700 1 -- 172.21.15.12:0/3879279059 shutdown_connections 2023-07-07T18:15:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.857+0000 7f74b2fd7700 1 -- 172.21.15.12:0/3879279059 wait complete. 2023-07-07T18:15:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.858+0000 7f74b2fd7700 1 Processor -- start 2023-07-07T18:15:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.858+0000 7f74b2fd7700 1 -- start start 2023-07-07T18:15:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74b2fd7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c005200 0x7f74ac0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74b2fd7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74ac0c67b0 0x7f74ac0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74b2fd7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74ac1593e0 0x7f74ac145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74b2fd7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0c6c40 con 0x7f74ac0c67b0 2023-07-07T18:15:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74b2fd7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0c6f20 con 0x7f74ac1593e0 2023-07-07T18:15:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74b2fd7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0c7200 con 0x7f749c005200 2023-07-07T18:15:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74abfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74ac0c67b0 0x7f74ac0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74abfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74ac0c67b0 0x7f74ac0b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57204/0 (socket says 172.21.15.12:57204) 2023-07-07T18:15:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74abfff700 1 -- 172.21.15.12:0/414199015 learned_addr learned my addr 172.21.15.12:0/414199015 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74b1574700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74ac1593e0 0x7f74ac145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74b0d73700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c005200 0x7f74ac0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74abfff700 1 -- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c005200 msgr2=0x7f74ac0c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74abfff700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c005200 0x7f74ac0c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74abfff700 1 -- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74ac1593e0 msgr2=0x7f74ac145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74abfff700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74ac1593e0 0x7f74ac145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.859+0000 7f74abfff700 1 -- 172.21.15.12:0/414199015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0c74e0 con 0x7f74ac0c67b0 2023-07-07T18:15:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.860+0000 7f74abfff700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74ac0c67b0 0x7f74ac0b4040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7498011930 tx=0x7f7498011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.860+0000 7f74a97fa700 1 -- 172.21.15.12:0/414199015 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498011e80 con 0x7f74ac0c67b0 2023-07-07T18:15:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.860+0000 7f74a97fa700 1 -- 172.21.15.12:0/414199015 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749800f940 con 0x7f74ac0c67b0 2023-07-07T18:15:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.860+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac0c77c0 con 0x7f74ac0c67b0 2023-07-07T18:15:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.860+0000 7f74a97fa700 1 -- 172.21.15.12:0/414199015 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749800fcf0 con 0x7f74ac0c67b0 2023-07-07T18:15:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.860+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ac159860 con 0x7f74ac0c67b0 2023-07-07T18:15:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.861+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ac0c7b30 con 0x7f74ac0c67b0 2023-07-07T18:15:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.861+0000 7f74a97fa700 1 -- 172.21.15.12:0/414199015 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7498014440 con 0x7f74ac0c67b0 2023-07-07T18:15:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.862+0000 7f74a97fa700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f749006ace0 0x7f749006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.862+0000 7f74a97fa700 1 -- 172.21.15.12:0/414199015 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7498089dc0 con 0x7f74ac0c67b0 2023-07-07T18:15:09.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.862+0000 7f74b0d73700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f749006ace0 0x7f749006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:09.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.863+0000 7f74b0d73700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f749006ace0 0x7f749006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74a0005a20 tx=0x7f74a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:09.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:09.867+0000 7f74a97fa700 1 -- 172.21.15.12:0/414199015 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7498058610 con 0x7f74ac0c67b0 2023-07-07T18:15:10.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.106+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74ac073910 con 0x7f74ac0c67b0 2023-07-07T18:15:10.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.106+0000 7f74a97fa700 1 -- 172.21.15.12:0/414199015 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f74980581a0 con 0x7f74ac0c67b0 2023-07-07T18:15:10.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:10.109 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:15:09.693432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-07T18:15:10.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f749006ace0 msgr2=0x7f749006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f749006ace0 0x7f749006d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74a0005a20 tx=0x7f74a0009040 comp rx=0 tx=0).stop 2023-07-07T18:15:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74ac0c67b0 msgr2=0x7f74ac0b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74ac0c67b0 0x7f74ac0b4040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7498011930 tx=0x7f7498011c40 comp rx=0 tx=0).stop 2023-07-07T18:15:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 shutdown_connections 2023-07-07T18:15:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f749006ace0 0x7f749006d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74ac1593e0 0x7f74ac145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f749c005200 0x7f74ac0c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 --2- 172.21.15.12:0/414199015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74ac0c67b0 0x7f74ac0b4040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.108+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 >> 172.21.15.12:0/414199015 conn(0x7f74ac0b0ef0 msgr2=0x7f74ac0ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:10.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.109+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 shutdown_connections 2023-07-07T18:15:10.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.109+0000 7f74b2fd7700 1 -- 172.21.15.12:0/414199015 wait complete. 2023-07-07T18:15:10.112 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2023-07-07T18:15:10.122 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:10.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.245+0000 7f6f9198f700 1 Processor -- start 2023-07-07T18:15:10.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.245+0000 7f6f9198f700 1 -- start start 2023-07-07T18:15:10.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f9198f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c0aed30 0x7f6f8c160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f9198f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f8c0cc1d0 0x7f6f8c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f9198f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c0cee80 con 0x7f6f8c156880 2023-07-07T18:15:10.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f9198f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c0ccb90 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f9198f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0cf100 con 0x7f6f8c0aed30 2023-07-07T18:15:10.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f8b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f8c0cc1d0 0x7f6f8c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f8b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f8c0cc1d0 0x7f6f8c0cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57214/0 (socket says 172.21.15.12:57214) 2023-07-07T18:15:10.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f8b7fe700 1 -- 172.21.15.12:0/3845608448 learned_addr learned my addr 172.21.15.12:0/3845608448 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:10.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f8a7fc700 1 --2- 172.21.15.12:0/3845608448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c0aed30 0x7f6f8c160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f8b7fe700 1 -- 172.21.15.12:0/3845608448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c0aed30 msgr2=0x7f6f8c160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:10.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f8b7fe700 1 --2- 172.21.15.12:0/3845608448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c0aed30 0x7f6f8c160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f8b7fe700 1 -- 172.21.15.12:0/3845608448 >> v1:172.21.15.160:6789/0 conn(0x7f6f8c156880 legacy=0x7f6f8c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.246+0000 7f6f8b7fe700 1 -- 172.21.15.12:0/3845608448 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0cf3e0 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f8b7fe700 1 --2- 172.21.15.12:0/3845608448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 0x7f6f8c0cc650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009e50 tx=0x7f6f8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace51a0a368f636d server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:10.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f89ffb700 1 -- 172.21.15.12:0/3845608448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400e070 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f89ffb700 1 -- 172.21.15.12:0/3845608448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8400b910 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f89ffb700 1 -- 172.21.15.12:0/3845608448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400bcc0 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f9198f700 1 -- 172.21.15.12:0/3845608448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 msgr2=0x7f6f8c0cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f9198f700 1 --2- 172.21.15.12:0/3845608448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 0x7f6f8c0cc650 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009e50 tx=0x7f6f8400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:10.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f9198f700 1 -- 172.21.15.12:0/3845608448 shutdown_connections 2023-07-07T18:15:10.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f9198f700 1 --2- 172.21.15.12:0/3845608448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 0x7f6f8c0cc650 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f9198f700 1 --2- 172.21.15.12:0/3845608448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c0aed30 0x7f6f8c160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f9198f700 1 -- 172.21.15.12:0/3845608448 >> 172.21.15.12:0/3845608448 conn(0x7f6f8c06d4a0 msgr2=0x7f6f8c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:10.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f9198f700 1 -- 172.21.15.12:0/3845608448 shutdown_connections 2023-07-07T18:15:10.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.247+0000 7f6f9198f700 1 -- 172.21.15.12:0/3845608448 wait complete. 2023-07-07T18:15:10.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.249+0000 7f6f9198f700 1 Processor -- start 2023-07-07T18:15:10.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.249+0000 7f6f9198f700 1 -- start start 2023-07-07T18:15:10.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f9198f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f8c0aed30 0x7f6f8c0b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f9198f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 0x7f6f8c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f9198f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c156880 0x7f6f8c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f9198f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0b3eb0 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f9198f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0b4190 con 0x7f6f8c0aed30 2023-07-07T18:15:10.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f9198f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0b4470 con 0x7f6f8c156880 2023-07-07T18:15:10.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f8a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 0x7f6f8c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f8a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 0x7f6f8c14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57218/0 (socket says 172.21.15.12:57218) 2023-07-07T18:15:10.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f8a7fc700 1 -- 172.21.15.12:0/258053915 learned_addr learned my addr 172.21.15.12:0/258053915 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:10.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f8affd700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f8c0aed30 0x7f6f8c0b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.250+0000 7f6f8b7fe700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c156880 0x7f6f8c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f8a7fc700 1 -- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c156880 msgr2=0x7f6f8c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f8a7fc700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c156880 0x7f6f8c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f8a7fc700 1 -- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f8c0aed30 msgr2=0x7f6f8c0b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f8a7fc700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f8c0aed30 0x7f6f8c0b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f8a7fc700 1 -- 172.21.15.12:0/258053915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84009b30 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f8a7fc700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 0x7f6f8c14ebc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000e870 tx=0x7f6f8000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:10.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f73fff700 1 -- 172.21.15.12:0/258053915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80009590 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f73fff700 1 -- 172.21.15.12:0/258053915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f80013680 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c0c4270 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f73fff700 1 -- 172.21.15.12:0/258053915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800139f0 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.251+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c0c3f20 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.252+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c0cd180 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.253+0000 7f6f73fff700 1 -- 172.21.15.12:0/258053915 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f80013b50 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.253+0000 7f6f73fff700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6f7806ace0 0x7f6f7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.253+0000 7f6f73fff700 1 -- 172.21.15.12:0/258053915 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f80089550 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.253+0000 7f6f8affd700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6f7806ace0 0x7f6f7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.254+0000 7f6f8affd700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6f7806ace0 0x7f6f7806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007fd0 tx=0x7f6f7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:10.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.258+0000 7f6f73fff700 1 -- 172.21.15.12:0/258053915 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f80057e30 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.458+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f8c073910 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.459+0000 7f6f73fff700 1 -- 172.21.15.12:0/258053915 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f6f800579c0 con 0x7f6f8c0cc1d0 2023-07-07T18:15:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:10.462 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:10.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6f7806ace0 msgr2=0x7f6f7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6f7806ace0 0x7f6f7806d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007fd0 tx=0x7f6f7c009040 comp rx=0 tx=0).stop 2023-07-07T18:15:10.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 msgr2=0x7f6f8c14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 0x7f6f8c14ebc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f8000e870 tx=0x7f6f8000eb80 comp rx=0 tx=0).stop 2023-07-07T18:15:10.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 shutdown_connections 2023-07-07T18:15:10.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6f7806ace0 0x7f6f7806d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f8c156880 0x7f6f8c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f8c0aed30 0x7f6f8c0b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 --2- 172.21.15.12:0/258053915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f8c0cc1d0 0x7f6f8c14ebc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.461+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 >> 172.21.15.12:0/258053915 conn(0x7f6f8c06d4a0 msgr2=0x7f6f8c15d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:10.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.462+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 shutdown_connections 2023-07-07T18:15:10.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.462+0000 7f6f9198f700 1 -- 172.21.15.12:0/258053915 wait complete. 2023-07-07T18:15:10.476 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-07T18:15:10.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T18:15:10.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.598+0000 7fb000643700 1 Processor -- start 2023-07-07T18:15:10.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.598+0000 7fb000643700 1 -- start start 2023-07-07T18:15:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.599+0000 7fb000643700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7faff80ccf90 0x7faff80cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.599+0000 7fb000643700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff80cd8a0 con 0x7faff806a890 2023-07-07T18:15:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.599+0000 7fb000643700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff815cc30 con 0x7faff8158850 2023-07-07T18:15:10.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.599+0000 7fb000643700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff815d1f0 con 0x7faff80ccf90 2023-07-07T18:15:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.599+0000 7faffebe0700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faff806a890 0x7faff80c95e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54424/0 (socket says 172.21.15.12:54424) 2023-07-07T18:15:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.599+0000 7faffebe0700 1 -- 172.21.15.12:0/3428267035 learned_addr learned my addr 172.21.15.12:0/3428267035 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.599+0000 7faffe3df700 1 --2- 172.21.15.12:0/3428267035 >> v2:172.21.15.160:3300/0 conn(0x7faff80ccf90 0x7faff80cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffd3dd700 1 -- 172.21.15.12:0/3428267035 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285599883 0 0) 0x7faff80cd8a0 con 0x7faff806a890 2023-07-07T18:15:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffd3dd700 1 -- 172.21.15.12:0/3428267035 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe40035b0 con 0x7faff806a890 2023-07-07T18:15:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffd3dd700 1 -- 172.21.15.12:0/3428267035 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4059218334 0 0) 0x7fafe40035b0 con 0x7faff806a890 2023-07-07T18:15:10.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffe3df700 1 -- 172.21.15.12:0/3428267035 >> v1:172.21.15.160:6789/0 conn(0x7faff8158850 legacy=0x7faff815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffe3df700 1 -- 172.21.15.12:0/3428267035 >> v1:172.21.15.12:6789/0 conn(0x7faff806a890 legacy=0x7faff80c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffe3df700 1 -- 172.21.15.12:0/3428267035 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff815cf10 con 0x7faff80ccf90 2023-07-07T18:15:10.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffe3df700 1 --2- 172.21.15.12:0/3428267035 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faff80ccf90 0x7faff80cd360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fafe800a9e0 tx=0x7fafe800acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8278405dbfb4c4e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:10.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffd3dd700 1 -- 172.21.15.12:0/3428267035 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff00019f0 con 0x7faff80ccf90 2023-07-07T18:15:10.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffd3dd700 1 -- 172.21.15.12:0/3428267035 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe8004030 con 0x7faff80ccf90 2023-07-07T18:15:10.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.600+0000 7faffd3dd700 1 -- 172.21.15.12:0/3428267035 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe80043c0 con 0x7faff80ccf90 2023-07-07T18:15:10.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.601+0000 7fb000643700 1 -- 172.21.15.12:0/3428267035 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faff80ccf90 msgr2=0x7faff80cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.601+0000 7fb000643700 1 --2- 172.21.15.12:0/3428267035 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faff80ccf90 0x7faff80cd360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fafe800a9e0 tx=0x7fafe800acf0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.601+0000 7fb000643700 1 -- 172.21.15.12:0/3428267035 shutdown_connections 2023-07-07T18:15:10.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.601+0000 7fb000643700 1 --2- 172.21.15.12:0/3428267035 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faff80ccf90 0x7faff80cd360 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.601+0000 7fb000643700 1 -- 172.21.15.12:0/3428267035 >> 172.21.15.12:0/3428267035 conn(0x7faff80b1740 msgr2=0x7faff806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:10.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.601+0000 7fb000643700 1 -- 172.21.15.12:0/3428267035 shutdown_connections 2023-07-07T18:15:10.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.601+0000 7fb000643700 1 -- 172.21.15.12:0/3428267035 wait complete. 2023-07-07T18:15:10.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.602+0000 7fb000643700 1 Processor -- start 2023-07-07T18:15:10.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.602+0000 7fb000643700 1 -- start start 2023-07-07T18:15:10.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7fb000643700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff806a890 0x7faff8156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7fb000643700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faff80ccf90 0x7faff80c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7fb000643700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faff8158850 0x7faff80adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7fb000643700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff8157f60 con 0x7faff806a890 2023-07-07T18:15:10.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7fb000643700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff8157350 con 0x7faff8158850 2023-07-07T18:15:10.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7fb000643700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff8157630 con 0x7faff80ccf90 2023-07-07T18:15:10.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffe3df700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff806a890 0x7faff8156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffe3df700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff806a890 0x7faff8156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57228/0 (socket says 172.21.15.12:57228) 2023-07-07T18:15:10.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffe3df700 1 -- 172.21.15.12:0/611969033 learned_addr learned my addr 172.21.15.12:0/611969033 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:10.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffebe0700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faff8158850 0x7faff80adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffdbde700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faff80ccf90 0x7faff80c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffe3df700 1 -- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faff80ccf90 msgr2=0x7faff80c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffe3df700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faff80ccf90 0x7faff80c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffe3df700 1 -- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faff8158850 msgr2=0x7faff80adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffe3df700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faff8158850 0x7faff80adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.603+0000 7faffe3df700 1 -- 172.21.15.12:0/611969033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe800a640 con 0x7faff806a890 2023-07-07T18:15:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.604+0000 7faffe3df700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff806a890 0x7faff8156d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fafe8000c00 tx=0x7fafe8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:10.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.604+0000 7fafeeffd700 1 -- 172.21.15.12:0/611969033 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe800c9f0 con 0x7faff806a890 2023-07-07T18:15:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.604+0000 7fafeeffd700 1 -- 172.21.15.12:0/611969033 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe800cb50 con 0x7faff806a890 2023-07-07T18:15:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.604+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff8157910 con 0x7faff806a890 2023-07-07T18:15:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.604+0000 7fafeeffd700 1 -- 172.21.15.12:0/611969033 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe800cee0 con 0x7faff806a890 2023-07-07T18:15:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.604+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff80c5540 con 0x7faff806a890 2023-07-07T18:15:10.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.605+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff8073910 con 0x7faff806a890 2023-07-07T18:15:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.605+0000 7fafeeffd700 1 -- 172.21.15.12:0/611969033 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafe8020480 con 0x7faff806a890 2023-07-07T18:15:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.605+0000 7fafeeffd700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fafdc06ace0 0x7fafdc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.606+0000 7fafeeffd700 1 -- 172.21.15.12:0/611969033 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fafe8013070 con 0x7faff806a890 2023-07-07T18:15:10.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.606+0000 7faffdbde700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fafdc06ace0 0x7fafdc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:10.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.606+0000 7faffdbde700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fafdc06ace0 0x7fafdc06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faff4007fd0 tx=0x7faff4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:10.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.610+0000 7fafeeffd700 1 -- 172.21.15.12:0/611969033 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fafe8056490 con 0x7faff806a890 2023-07-07T18:15:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.804+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 --> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faff806a370 con 0x7fafdc06ace0 2023-07-07T18:15:10.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.815+0000 7fafeeffd700 1 -- 172.21.15.12:0/611969033 <== mgr.4100 v2:172.21.15.160:6832/4080099133 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367349 (secure 0 0 0) 0x7faff40050d0 con 0x7fafdc06ace0 2023-07-07T18:15:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:10.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fafdc06ace0 msgr2=0x7fafdc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fafdc06ace0 0x7fafdc06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faff4007fd0 tx=0x7faff4009040 comp rx=0 tx=0).stop 2023-07-07T18:15:10.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff806a890 msgr2=0x7faff8156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:10.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff806a890 0x7faff8156d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fafe8000c00 tx=0x7fafe8004750 comp rx=0 tx=0).stop 2023-07-07T18:15:10.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 shutdown_connections 2023-07-07T18:15:10.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fafdc06ace0 0x7fafdc06d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faff8158850 0x7faff80adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faff806a890 0x7faff8156d40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 --2- 172.21.15.12:0/611969033 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faff80ccf90 0x7faff80c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:10.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 >> 172.21.15.12:0/611969033 conn(0x7faff80b1740 msgr2=0x7faff806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:10.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 shutdown_connections 2023-07-07T18:15:10.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.819+0000 7fb000643700 1 -- 172.21.15.12:0/611969033 wait complete. 2023-07-07T18:15:10.827 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-07-07T18:15:10.833 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-07T18:15:10.595847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219268,"kb_used_data":3652,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755452,"statfs":{"total":773094113280,"available":772869582848,"internally_reserved":0,"allocated":3739648,"data_stored":2208171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003811"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287995+0000","last_change":"2023-07-07T18:14:46.251969+0000","last_active":"2023-07-07T18:14:51.287995+0000","last_peered":"2023-07-07T18:14:51.287995+0000","last_clean":"2023-07-07T18:14:51.287995+0000","last_became_active":"2023-07-07T18:14:46.251645+0000","last_became_peered":"2023-07-07T18:14:46.251645+0000","last_unstale":"2023-07-07T18:14:51.287995+0000","last_undegraded":"2023-07-07T18:14:51.287995+0000","last_fullsized":"2023-07-07T18:14:51.287995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:09:35.223387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786630+0000","last_change":"2023-07-07T18:14:46.246398+0000","last_active":"2023-07-07T18:14:50.786630+0000","last_peered":"2023-07-07T18:14:50.786630+0000","last_clean":"2023-07-07T18:14:50.786630+0000","last_became_active":"2023-07-07T18:14:46.246114+0000","last_became_peered":"2023-07-07T18:14:46.246114+0000","last_unstale":"2023-07-07T18:14:50.786630+0000","last_undegraded":"2023-07-07T18:14:50.786630+0000","last_fullsized":"2023-07-07T18:14:50.786630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:10:28.413855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696469+0000","last_change":"2023-07-07T18:14:46.260795+0000","last_active":"2023-07-07T18:14:50.696469+0000","last_peered":"2023-07-07T18:14:50.696469+0000","last_clean":"2023-07-07T18:14:50.696469+0000","last_became_active":"2023-07-07T18:14:46.260094+0000","last_became_peered":"2023-07-07T18:14:46.260094+0000","last_unstale":"2023-07-07T18:14:50.696469+0000","last_undegraded":"2023-07-07T18:14:50.696469+0000","last_fullsized":"2023-07-07T18:14:50.696469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:50:11.200504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287193+0000","last_change":"2023-07-07T18:14:46.256379+0000","last_active":"2023-07-07T18:14:51.287193+0000","last_peered":"2023-07-07T18:14:51.287193+0000","last_clean":"2023-07-07T18:14:51.287193+0000","last_became_active":"2023-07-07T18:14:46.256093+0000","last_became_peered":"2023-07-07T18:14:46.256093+0000","last_unstale":"2023-07-07T18:14:51.287193+0000","last_undegraded":"2023-07-07T18:14:51.287193+0000","last_fullsized":"2023-07-07T18:14:51.287193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:45.897131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768761+0000","last_change":"2023-07-07T18:14:46.256853+0000","last_active":"2023-07-07T18:14:50.768761+0000","last_peered":"2023-07-07T18:14:50.768761+0000","last_clean":"2023-07-07T18:14:50.768761+0000","last_became_active":"2023-07-07T18:14:46.256595+0000","last_became_peered":"2023-07-07T18:14:46.256595+0000","last_unstale":"2023-07-07T18:14:50.768761+0000","last_undegraded":"2023-07-07T18:14:50.768761+0000","last_fullsized":"2023-07-07T18:14:50.768761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:15:05.887018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694486+0000","last_change":"2023-07-07T18:14:46.256691+0000","last_active":"2023-07-07T18:14:50.694486+0000","last_peered":"2023-07-07T18:14:50.694486+0000","last_clean":"2023-07-07T18:14:50.694486+0000","last_became_active":"2023-07-07T18:14:46.254378+0000","last_became_peered":"2023-07-07T18:14:46.254378+0000","last_unstale":"2023-07-07T18:14:50.694486+0000","last_undegraded":"2023-07-07T18:14:50.694486+0000","last_fullsized":"2023-07-07T18:14:50.694486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:51:05.609476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695840+0000","last_change":"2023-07-07T18:14:46.259522+0000","last_active":"2023-07-07T18:14:50.695840+0000","last_peered":"2023-07-07T18:14:50.695840+0000","last_clean":"2023-07-07T18:14:50.695840+0000","last_became_active":"2023-07-07T18:14:46.259213+0000","last_became_peered":"2023-07-07T18:14:46.259213+0000","last_unstale":"2023-07-07T18:14:50.695840+0000","last_undegraded":"2023-07-07T18:14:50.695840+0000","last_fullsized":"2023-07-07T18:14:50.695840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:41:52.866809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786149+0000","last_change":"2023-07-07T18:14:46.257573+0000","last_active":"2023-07-07T18:14:50.786149+0000","last_peered":"2023-07-07T18:14:50.786149+0000","last_clean":"2023-07-07T18:14:50.786149+0000","last_became_active":"2023-07-07T18:14:46.257234+0000","last_became_peered":"2023-07-07T18:14:46.257234+0000","last_unstale":"2023-07-07T18:14:50.786149+0000","last_undegraded":"2023-07-07T18:14:50.786149+0000","last_fullsized":"2023-07-07T18:14:50.786149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:17.978840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769023+0000","last_change":"2023-07-07T18:14:46.256934+0000","last_active":"2023-07-07T18:14:50.769023+0000","last_peered":"2023-07-07T18:14:50.769023+0000","last_clean":"2023-07-07T18:14:50.769023+0000","last_became_active":"2023-07-07T18:14:46.256669+0000","last_became_peered":"2023-07-07T18:14:46.256669+0000","last_unstale":"2023-07-07T18:14:50.769023+0000","last_undegraded":"2023-07-07T18:14:50.769023+0000","last_fullsized":"2023-07-07T18:14:50.769023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:27.744408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786945+0000","last_change":"2023-07-07T18:14:46.253312+0000","last_active":"2023-07-07T18:14:50.786945+0000","last_peered":"2023-07-07T18:14:50.786945+0000","last_clean":"2023-07-07T18:14:50.786945+0000","last_became_active":"2023-07-07T18:14:46.253067+0000","last_became_peered":"2023-07-07T18:14:46.253067+0000","last_unstale":"2023-07-07T18:14:50.786945+0000","last_undegraded":"2023-07-07T18:14:50.786945+0000","last_fullsized":"2023-07-07T18:14:50.786945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:15:55.654834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696368+0000","last_change":"2023-07-07T18:14:46.257215+0000","last_active":"2023-07-07T18:14:50.696368+0000","last_peered":"2023-07-07T18:14:50.696368+0000","last_clean":"2023-07-07T18:14:50.696368+0000","last_became_active":"2023-07-07T18:14:46.254498+0000","last_became_peered":"2023-07-07T18:14:46.254498+0000","last_unstale":"2023-07-07T18:14:50.696368+0000","last_undegraded":"2023-07-07T18:14:50.696368+0000","last_fullsized":"2023-07-07T18:14:50.696368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:44:17.278555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287726+0000","last_change":"2023-07-07T18:14:46.261297+0000","last_active":"2023-07-07T18:14:51.287726+0000","last_peered":"2023-07-07T18:14:51.287726+0000","last_clean":"2023-07-07T18:14:51.287726+0000","last_became_active":"2023-07-07T18:14:46.260968+0000","last_became_peered":"2023-07-07T18:14:46.260968+0000","last_unstale":"2023-07-07T18:14:51.287726+0000","last_undegraded":"2023-07-07T18:14:51.287726+0000","last_fullsized":"2023-07-07T18:14:51.287726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:27:53.328227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287686+0000","last_change":"2023-07-07T18:14:46.251381+0000","last_active":"2023-07-07T18:14:51.287686+0000","last_peered":"2023-07-07T18:14:51.287686+0000","last_clean":"2023-07-07T18:14:51.287686+0000","last_became_active":"2023-07-07T18:14:46.251132+0000","last_became_peered":"2023-07-07T18:14:46.251132+0000","last_unstale":"2023-07-07T18:14:51.287686+0000","last_undegraded":"2023-07-07T18:14:51.287686+0000","last_fullsized":"2023-07-07T18:14:51.287686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:36:06.840784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786267+0000","last_change":"2023-07-07T18:14:46.237529+0000","last_active":"2023-07-07T18:14:50.786267+0000","last_peered":"2023-07-07T18:14:50.786267+0000","last_clean":"2023-07-07T18:14:50.786267+0000","last_became_active":"2023-07-07T18:14:46.237227+0000","last_became_peered":"2023-07-07T18:14:46.237227+0000","last_unstale":"2023-07-07T18:14:50.786267+0000","last_undegraded":"2023-07-07T18:14:50.786267+0000","last_fullsized":"2023-07-07T18:14:50.786267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:30.201313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695700+0000","last_change":"2023-07-07T18:14:46.250166+0000","last_active":"2023-07-07T18:14:50.695700+0000","last_peered":"2023-07-07T18:14:50.695700+0000","last_clean":"2023-07-07T18:14:50.695700+0000","last_became_active":"2023-07-07T18:14:46.249865+0000","last_became_peered":"2023-07-07T18:14:46.249865+0000","last_unstale":"2023-07-07T18:14:50.695700+0000","last_undegraded":"2023-07-07T18:14:50.695700+0000","last_fullsized":"2023-07-07T18:14:50.695700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:03:21.014607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694727+0000","last_change":"2023-07-07T18:14:46.260407+0000","last_active":"2023-07-07T18:14:50.694727+0000","last_peered":"2023-07-07T18:14:50.694727+0000","last_clean":"2023-07-07T18:14:50.694727+0000","last_became_active":"2023-07-07T18:14:46.259937+0000","last_became_peered":"2023-07-07T18:14:46.259937+0000","last_unstale":"2023-07-07T18:14:50.694727+0000","last_undegraded":"2023-07-07T18:14:50.694727+0000","last_fullsized":"2023-07-07T18:14:50.694727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:56:49.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769064+0000","last_change":"2023-07-07T18:14:46.256893+0000","last_active":"2023-07-07T18:14:50.769064+0000","last_peered":"2023-07-07T18:14:50.769064+0000","last_clean":"2023-07-07T18:14:50.769064+0000","last_became_active":"2023-07-07T18:14:46.256622+0000","last_became_peered":"2023-07-07T18:14:46.256622+0000","last_unstale":"2023-07-07T18:14:50.769064+0000","last_undegraded":"2023-07-07T18:14:50.769064+0000","last_fullsized":"2023-07-07T18:14:50.769064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:35.628378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696247+0000","last_change":"2023-07-07T18:14:46.260376+0000","last_active":"2023-07-07T18:14:50.696247+0000","last_peered":"2023-07-07T18:14:50.696247+0000","last_clean":"2023-07-07T18:14:50.696247+0000","last_became_active":"2023-07-07T18:14:46.257010+0000","last_became_peered":"2023-07-07T18:14:46.257010+0000","last_unstale":"2023-07-07T18:14:50.696247+0000","last_undegraded":"2023-07-07T18:14:50.696247+0000","last_fullsized":"2023-07-07T18:14:50.696247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:39:01.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287639+0000","last_change":"2023-07-07T18:14:46.254186+0000","last_active":"2023-07-07T18:14:51.287639+0000","last_peered":"2023-07-07T18:14:51.287639+0000","last_clean":"2023-07-07T18:14:51.287639+0000","last_became_active":"2023-07-07T18:14:46.253897+0000","last_became_peered":"2023-07-07T18:14:46.253897+0000","last_unstale":"2023-07-07T18:14:51.287639+0000","last_undegraded":"2023-07-07T18:14:51.287639+0000","last_fullsized":"2023-07-07T18:14:51.287639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:47:31.616916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695873+0000","last_change":"2023-07-07T18:14:46.260027+0000","last_active":"2023-07-07T18:14:50.695873+0000","last_peered":"2023-07-07T18:14:50.695873+0000","last_clean":"2023-07-07T18:14:50.695873+0000","last_became_active":"2023-07-07T18:14:46.259740+0000","last_became_peered":"2023-07-07T18:14:46.259740+0000","last_unstale":"2023-07-07T18:14:50.695873+0000","last_undegraded":"2023-07-07T18:14:50.695873+0000","last_fullsized":"2023-07-07T18:14:50.695873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:11:34.268952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695458+0000","last_change":"2023-07-07T18:14:46.258673+0000","last_active":"2023-07-07T18:14:50.695458+0000","last_peered":"2023-07-07T18:14:50.695458+0000","last_clean":"2023-07-07T18:14:50.695458+0000","last_became_active":"2023-07-07T18:14:46.258410+0000","last_became_peered":"2023-07-07T18:14:46.258410+0000","last_unstale":"2023-07-07T18:14:50.695458+0000","last_undegraded":"2023-07-07T18:14:50.695458+0000","last_fullsized":"2023-07-07T18:14:50.695458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:36.856794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768546+0000","last_change":"2023-07-07T18:14:46.250342+0000","last_active":"2023-07-07T18:14:50.768546+0000","last_peered":"2023-07-07T18:14:50.768546+0000","last_clean":"2023-07-07T18:14:50.768546+0000","last_became_active":"2023-07-07T18:14:46.250051+0000","last_became_peered":"2023-07-07T18:14:46.250051+0000","last_unstale":"2023-07-07T18:14:50.768546+0000","last_undegraded":"2023-07-07T18:14:50.768546+0000","last_fullsized":"2023-07-07T18:14:50.768546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:05.786354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286813+0000","last_change":"2023-07-07T18:14:46.255595+0000","last_active":"2023-07-07T18:14:51.286813+0000","last_peered":"2023-07-07T18:14:51.286813+0000","last_clean":"2023-07-07T18:14:51.286813+0000","last_became_active":"2023-07-07T18:14:46.255308+0000","last_became_peered":"2023-07-07T18:14:46.255308+0000","last_unstale":"2023-07-07T18:14:51.286813+0000","last_undegraded":"2023-07-07T18:14:51.286813+0000","last_fullsized":"2023-07-07T18:14:51.286813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:22.768246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695160+0000","last_change":"2023-07-07T18:14:46.259159+0000","last_active":"2023-07-07T18:14:50.695160+0000","last_peered":"2023-07-07T18:14:50.695160+0000","last_clean":"2023-07-07T18:14:50.695160+0000","last_became_active":"2023-07-07T18:14:46.258888+0000","last_became_peered":"2023-07-07T18:14:46.258888+0000","last_unstale":"2023-07-07T18:14:50.695160+0000","last_undegraded":"2023-07-07T18:14:50.695160+0000","last_fullsized":"2023-07-07T18:14:50.695160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:04:20.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693827+0000","last_change":"2023-07-07T18:14:46.251261+0000","last_active":"2023-07-07T18:14:50.693827+0000","last_peered":"2023-07-07T18:14:50.693827+0000","last_clean":"2023-07-07T18:14:50.693827+0000","last_became_active":"2023-07-07T18:14:46.250985+0000","last_became_peered":"2023-07-07T18:14:46.250985+0000","last_unstale":"2023-07-07T18:14:50.693827+0000","last_undegraded":"2023-07-07T18:14:50.693827+0000","last_fullsized":"2023-07-07T18:14:50.693827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:27.744408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693850+0000","last_change":"2023-07-07T18:14:46.238108+0000","last_active":"2023-07-07T18:14:50.693850+0000","last_peered":"2023-07-07T18:14:50.693850+0000","last_clean":"2023-07-07T18:14:50.693850+0000","last_became_active":"2023-07-07T18:14:46.237731+0000","last_became_peered":"2023-07-07T18:14:46.237731+0000","last_unstale":"2023-07-07T18:14:50.693850+0000","last_undegraded":"2023-07-07T18:14:50.693850+0000","last_fullsized":"2023-07-07T18:14:50.693850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:56.152988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786655+0000","last_change":"2023-07-07T18:14:46.252496+0000","last_active":"2023-07-07T18:14:50.786655+0000","last_peered":"2023-07-07T18:14:50.786655+0000","last_clean":"2023-07-07T18:14:50.786655+0000","last_became_active":"2023-07-07T18:14:46.251903+0000","last_became_peered":"2023-07-07T18:14:46.251903+0000","last_unstale":"2023-07-07T18:14:50.786655+0000","last_undegraded":"2023-07-07T18:14:50.786655+0000","last_fullsized":"2023-07-07T18:14:50.786655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:50:58.513809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696161+0000","last_change":"2023-07-07T18:14:50.275663+0000","last_active":"2023-07-07T18:14:50.696161+0000","last_peered":"2023-07-07T18:14:50.696161+0000","last_clean":"2023-07-07T18:14:50.696161+0000","last_became_active":"2023-07-07T18:14:50.274814+0000","last_became_peered":"2023-07-07T18:14:50.274814+0000","last_unstale":"2023-07-07T18:14:50.696161+0000","last_undegraded":"2023-07-07T18:14:50.696161+0000","last_fullsized":"2023-07-07T18:14:50.696161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:57:09.270949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695701+0000","last_change":"2023-07-07T18:14:45.827301+0000","last_active":"2023-07-07T18:14:50.695701+0000","last_peered":"2023-07-07T18:14:50.695701+0000","last_clean":"2023-07-07T18:14:50.695701+0000","last_became_active":"2023-07-07T18:14:45.827011+0000","last_became_peered":"2023-07-07T18:14:45.827011+0000","last_unstale":"2023-07-07T18:14:50.695701+0000","last_undegraded":"2023-07-07T18:14:50.695701+0000","last_fullsized":"2023-07-07T18:14:50.695701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:39:36.675751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288069+0000","last_change":"2023-07-07T18:14:46.238475+0000","last_active":"2023-07-07T18:14:51.288069+0000","last_peered":"2023-07-07T18:14:51.288069+0000","last_clean":"2023-07-07T18:14:51.288069+0000","last_became_active":"2023-07-07T18:14:46.238195+0000","last_became_peered":"2023-07-07T18:14:46.238195+0000","last_unstale":"2023-07-07T18:14:51.288069+0000","last_undegraded":"2023-07-07T18:14:51.288069+0000","last_fullsized":"2023-07-07T18:14:51.288069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:25:55.917107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287704+0000","last_change":"2023-07-07T18:14:50.280065+0000","last_active":"2023-07-07T18:14:51.287704+0000","last_peered":"2023-07-07T18:14:51.287704+0000","last_clean":"2023-07-07T18:14:51.287704+0000","last_became_active":"2023-07-07T18:14:50.279693+0000","last_became_peered":"2023-07-07T18:14:50.279693+0000","last_unstale":"2023-07-07T18:14:51.287704+0000","last_undegraded":"2023-07-07T18:14:51.287704+0000","last_fullsized":"2023-07-07T18:14:51.287704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:50:58.472479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693103+0000","last_change":"2023-07-07T18:14:45.823969+0000","last_active":"2023-07-07T18:14:50.693103+0000","last_peered":"2023-07-07T18:14:50.693103+0000","last_clean":"2023-07-07T18:14:50.693103+0000","last_became_active":"2023-07-07T18:14:45.823633+0000","last_became_peered":"2023-07-07T18:14:45.823633+0000","last_unstale":"2023-07-07T18:14:50.693103+0000","last_undegraded":"2023-07-07T18:14:50.693103+0000","last_fullsized":"2023-07-07T18:14:50.693103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:33:57.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769007+0000","last_change":"2023-07-07T18:14:46.252472+0000","last_active":"2023-07-07T18:14:50.769007+0000","last_peered":"2023-07-07T18:14:50.769007+0000","last_clean":"2023-07-07T18:14:50.769007+0000","last_became_active":"2023-07-07T18:14:46.251913+0000","last_became_peered":"2023-07-07T18:14:46.251913+0000","last_unstale":"2023-07-07T18:14:50.769007+0000","last_undegraded":"2023-07-07T18:14:50.769007+0000","last_fullsized":"2023-07-07T18:14:50.769007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:35.950124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769225+0000","last_change":"2023-07-07T18:14:50.279703+0000","last_active":"2023-07-07T18:14:50.769225+0000","last_peered":"2023-07-07T18:14:50.769225+0000","last_clean":"2023-07-07T18:14:50.769225+0000","last_became_active":"2023-07-07T18:14:50.278724+0000","last_became_peered":"2023-07-07T18:14:50.278724+0000","last_unstale":"2023-07-07T18:14:50.769225+0000","last_undegraded":"2023-07-07T18:14:50.769225+0000","last_fullsized":"2023-07-07T18:14:50.769225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:49:51.568617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287384+0000","last_change":"2023-07-07T18:14:45.825144+0000","last_active":"2023-07-07T18:14:51.287384+0000","last_peered":"2023-07-07T18:14:51.287384+0000","last_clean":"2023-07-07T18:14:51.287384+0000","last_became_active":"2023-07-07T18:14:45.824734+0000","last_became_peered":"2023-07-07T18:14:45.824734+0000","last_unstale":"2023-07-07T18:14:51.287384+0000","last_undegraded":"2023-07-07T18:14:51.287384+0000","last_fullsized":"2023-07-07T18:14:51.287384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:05:04.291822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287718+0000","last_change":"2023-07-07T18:14:46.250855+0000","last_active":"2023-07-07T18:14:51.287718+0000","last_peered":"2023-07-07T18:14:51.287718+0000","last_clean":"2023-07-07T18:14:51.287718+0000","last_became_active":"2023-07-07T18:14:46.250523+0000","last_became_peered":"2023-07-07T18:14:46.250523+0000","last_unstale":"2023-07-07T18:14:51.287718+0000","last_undegraded":"2023-07-07T18:14:51.287718+0000","last_fullsized":"2023-07-07T18:14:51.287718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:13:53.124487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287116+0000","last_change":"2023-07-07T18:14:50.284048+0000","last_active":"2023-07-07T18:14:51.287116+0000","last_peered":"2023-07-07T18:14:51.287116+0000","last_clean":"2023-07-07T18:14:51.287116+0000","last_became_active":"2023-07-07T18:14:50.283525+0000","last_became_peered":"2023-07-07T18:14:50.283525+0000","last_unstale":"2023-07-07T18:14:51.287116+0000","last_undegraded":"2023-07-07T18:14:51.287116+0000","last_fullsized":"2023-07-07T18:14:51.287116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:56:26.834793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769206+0000","last_change":"2023-07-07T18:14:45.820272+0000","last_active":"2023-07-07T18:14:50.769206+0000","last_peered":"2023-07-07T18:14:50.769206+0000","last_clean":"2023-07-07T18:14:50.769206+0000","last_became_active":"2023-07-07T18:14:45.819791+0000","last_became_peered":"2023-07-07T18:14:45.819791+0000","last_unstale":"2023-07-07T18:14:50.769206+0000","last_undegraded":"2023-07-07T18:14:50.769206+0000","last_fullsized":"2023-07-07T18:14:50.769206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:25:18.468002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287255+0000","last_change":"2023-07-07T18:14:46.237273+0000","last_active":"2023-07-07T18:14:51.287255+0000","last_peered":"2023-07-07T18:14:51.287255+0000","last_clean":"2023-07-07T18:14:51.287255+0000","last_became_active":"2023-07-07T18:14:46.236974+0000","last_became_peered":"2023-07-07T18:14:46.236974+0000","last_unstale":"2023-07-07T18:14:51.287255+0000","last_undegraded":"2023-07-07T18:14:51.287255+0000","last_fullsized":"2023-07-07T18:14:51.287255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:54:31.016985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694188+0000","last_change":"2023-07-07T18:14:50.273820+0000","last_active":"2023-07-07T18:14:50.694188+0000","last_peered":"2023-07-07T18:14:50.694188+0000","last_clean":"2023-07-07T18:14:50.694188+0000","last_became_active":"2023-07-07T18:14:50.273435+0000","last_became_peered":"2023-07-07T18:14:50.273435+0000","last_unstale":"2023-07-07T18:14:50.694188+0000","last_undegraded":"2023-07-07T18:14:50.694188+0000","last_fullsized":"2023-07-07T18:14:50.694188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:24.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786841+0000","last_change":"2023-07-07T18:14:45.825130+0000","last_active":"2023-07-07T18:14:50.786841+0000","last_peered":"2023-07-07T18:14:50.786841+0000","last_clean":"2023-07-07T18:14:50.786841+0000","last_became_active":"2023-07-07T18:14:45.824837+0000","last_became_peered":"2023-07-07T18:14:45.824837+0000","last_unstale":"2023-07-07T18:14:50.786841+0000","last_undegraded":"2023-07-07T18:14:50.786841+0000","last_fullsized":"2023-07-07T18:14:50.786841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:14:32.249281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286957+0000","last_change":"2023-07-07T18:14:46.251224+0000","last_active":"2023-07-07T18:14:51.286957+0000","last_peered":"2023-07-07T18:14:51.286957+0000","last_clean":"2023-07-07T18:14:51.286957+0000","last_became_active":"2023-07-07T18:14:46.250930+0000","last_became_peered":"2023-07-07T18:14:46.250930+0000","last_unstale":"2023-07-07T18:14:51.286957+0000","last_undegraded":"2023-07-07T18:14:51.286957+0000","last_fullsized":"2023-07-07T18:14:51.286957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:04:20.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287030+0000","last_change":"2023-07-07T18:14:50.279519+0000","last_active":"2023-07-07T18:14:51.287030+0000","last_peered":"2023-07-07T18:14:51.287030+0000","last_clean":"2023-07-07T18:14:51.287030+0000","last_became_active":"2023-07-07T18:14:50.279123+0000","last_became_peered":"2023-07-07T18:14:50.279123+0000","last_unstale":"2023-07-07T18:14:51.287030+0000","last_undegraded":"2023-07-07T18:14:51.287030+0000","last_fullsized":"2023-07-07T18:14:51.287030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:06:52.179086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695194+0000","last_change":"2023-07-07T18:14:45.826154+0000","last_active":"2023-07-07T18:14:50.695194+0000","last_peered":"2023-07-07T18:14:50.695194+0000","last_clean":"2023-07-07T18:14:50.695194+0000","last_became_active":"2023-07-07T18:14:45.825811+0000","last_became_peered":"2023-07-07T18:14:45.825811+0000","last_unstale":"2023-07-07T18:14:50.695194+0000","last_undegraded":"2023-07-07T18:14:50.695194+0000","last_fullsized":"2023-07-07T18:14:50.695194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:06:47.726217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693492+0000","last_change":"2023-07-07T18:14:46.253842+0000","last_active":"2023-07-07T18:14:50.693492+0000","last_peered":"2023-07-07T18:14:50.693492+0000","last_clean":"2023-07-07T18:14:50.693492+0000","last_became_active":"2023-07-07T18:14:46.253610+0000","last_became_peered":"2023-07-07T18:14:46.253610+0000","last_unstale":"2023-07-07T18:14:50.693492+0000","last_undegraded":"2023-07-07T18:14:50.693492+0000","last_fullsized":"2023-07-07T18:14:50.693492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:46:48.904277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693169+0000","last_change":"2023-07-07T18:14:50.279382+0000","last_active":"2023-07-07T18:14:50.693169+0000","last_peered":"2023-07-07T18:14:50.693169+0000","last_clean":"2023-07-07T18:14:50.693169+0000","last_became_active":"2023-07-07T18:14:50.278873+0000","last_became_peered":"2023-07-07T18:14:50.278873+0000","last_unstale":"2023-07-07T18:14:50.693169+0000","last_undegraded":"2023-07-07T18:14:50.693169+0000","last_fullsized":"2023-07-07T18:14:50.693169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:02:54.121461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:55.778055+0000","last_change":"2023-07-07T18:14:45.823952+0000","last_active":"2023-07-07T18:14:55.778055+0000","last_peered":"2023-07-07T18:14:55.778055+0000","last_clean":"2023-07-07T18:14:55.778055+0000","last_became_active":"2023-07-07T18:14:45.823624+0000","last_became_peered":"2023-07-07T18:14:45.823624+0000","last_unstale":"2023-07-07T18:14:55.778055+0000","last_undegraded":"2023-07-07T18:14:55.778055+0000","last_fullsized":"2023-07-07T18:14:55.778055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:40:13.757713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695689+0000","last_change":"2023-07-07T18:14:46.253886+0000","last_active":"2023-07-07T18:14:50.695689+0000","last_peered":"2023-07-07T18:14:50.695689+0000","last_clean":"2023-07-07T18:14:50.695689+0000","last_became_active":"2023-07-07T18:14:46.253553+0000","last_became_peered":"2023-07-07T18:14:46.253553+0000","last_unstale":"2023-07-07T18:14:50.695689+0000","last_undegraded":"2023-07-07T18:14:50.695689+0000","last_fullsized":"2023-07-07T18:14:50.695689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:50:15.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786900+0000","last_change":"2023-07-07T18:14:50.281424+0000","last_active":"2023-07-07T18:14:50.786900+0000","last_peered":"2023-07-07T18:14:50.786900+0000","last_clean":"2023-07-07T18:14:50.786900+0000","last_became_active":"2023-07-07T18:14:50.281010+0000","last_became_peered":"2023-07-07T18:14:50.281010+0000","last_unstale":"2023-07-07T18:14:50.786900+0000","last_undegraded":"2023-07-07T18:14:50.786900+0000","last_fullsized":"2023-07-07T18:14:50.786900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:25:33.168587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695467+0000","last_change":"2023-07-07T18:14:45.830163+0000","last_active":"2023-07-07T18:14:50.695467+0000","last_peered":"2023-07-07T18:14:50.695467+0000","last_clean":"2023-07-07T18:14:50.695467+0000","last_became_active":"2023-07-07T18:14:45.829928+0000","last_became_peered":"2023-07-07T18:14:45.829928+0000","last_unstale":"2023-07-07T18:14:50.695467+0000","last_undegraded":"2023-07-07T18:14:50.695467+0000","last_fullsized":"2023-07-07T18:14:50.695467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:23:48.677042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287433+0000","last_change":"2023-07-07T18:14:46.238712+0000","last_active":"2023-07-07T18:14:51.287433+0000","last_peered":"2023-07-07T18:14:51.287433+0000","last_clean":"2023-07-07T18:14:51.287433+0000","last_became_active":"2023-07-07T18:14:46.238414+0000","last_became_peered":"2023-07-07T18:14:46.238414+0000","last_unstale":"2023-07-07T18:14:51.287433+0000","last_undegraded":"2023-07-07T18:14:51.287433+0000","last_fullsized":"2023-07-07T18:14:51.287433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:01:57.247568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287657+0000","last_change":"2023-07-07T18:14:50.283995+0000","last_active":"2023-07-07T18:14:51.287657+0000","last_peered":"2023-07-07T18:14:51.287657+0000","last_clean":"2023-07-07T18:14:51.287657+0000","last_became_active":"2023-07-07T18:14:50.280787+0000","last_became_peered":"2023-07-07T18:14:50.280787+0000","last_unstale":"2023-07-07T18:14:51.287657+0000","last_undegraded":"2023-07-07T18:14:51.287657+0000","last_fullsized":"2023-07-07T18:14:51.287657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:40.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768416+0000","last_change":"2023-07-07T18:14:45.818817+0000","last_active":"2023-07-07T18:14:50.768416+0000","last_peered":"2023-07-07T18:14:50.768416+0000","last_clean":"2023-07-07T18:14:50.768416+0000","last_became_active":"2023-07-07T18:14:45.817217+0000","last_became_peered":"2023-07-07T18:14:45.817217+0000","last_unstale":"2023-07-07T18:14:50.768416+0000","last_undegraded":"2023-07-07T18:14:50.768416+0000","last_fullsized":"2023-07-07T18:14:50.768416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:35.237658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786635+0000","last_change":"2023-07-07T18:14:46.252322+0000","last_active":"2023-07-07T18:14:50.786635+0000","last_peered":"2023-07-07T18:14:50.786635+0000","last_clean":"2023-07-07T18:14:50.786635+0000","last_became_active":"2023-07-07T18:14:46.251581+0000","last_became_peered":"2023-07-07T18:14:46.251581+0000","last_unstale":"2023-07-07T18:14:50.786635+0000","last_undegraded":"2023-07-07T18:14:50.786635+0000","last_fullsized":"2023-07-07T18:14:50.786635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:25:19.477377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288314+0000","last_change":"2023-07-07T18:14:50.279662+0000","last_active":"2023-07-07T18:14:51.288314+0000","last_peered":"2023-07-07T18:14:51.288314+0000","last_clean":"2023-07-07T18:14:51.288314+0000","last_became_active":"2023-07-07T18:14:50.279182+0000","last_became_peered":"2023-07-07T18:14:50.279182+0000","last_unstale":"2023-07-07T18:14:51.288314+0000","last_undegraded":"2023-07-07T18:14:51.288314+0000","last_fullsized":"2023-07-07T18:14:51.288314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:29.387286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695766+0000","last_change":"2023-07-07T18:14:45.828779+0000","last_active":"2023-07-07T18:14:50.695766+0000","last_peered":"2023-07-07T18:14:50.695766+0000","last_clean":"2023-07-07T18:14:50.695766+0000","last_became_active":"2023-07-07T18:14:45.828387+0000","last_became_peered":"2023-07-07T18:14:45.828387+0000","last_unstale":"2023-07-07T18:14:50.695766+0000","last_undegraded":"2023-07-07T18:14:50.695766+0000","last_fullsized":"2023-07-07T18:14:50.695766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:25:54.907733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769086+0000","last_change":"2023-07-07T18:14:46.258991+0000","last_active":"2023-07-07T18:14:50.769086+0000","last_peered":"2023-07-07T18:14:50.769086+0000","last_clean":"2023-07-07T18:14:50.769086+0000","last_became_active":"2023-07-07T18:14:46.258711+0000","last_became_peered":"2023-07-07T18:14:46.258711+0000","last_unstale":"2023-07-07T18:14:50.769086+0000","last_undegraded":"2023-07-07T18:14:50.769086+0000","last_fullsized":"2023-07-07T18:14:50.769086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:10.136646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786752+0000","last_change":"2023-07-07T18:14:50.275066+0000","last_active":"2023-07-07T18:14:50.786752+0000","last_peered":"2023-07-07T18:14:50.786752+0000","last_clean":"2023-07-07T18:14:50.786752+0000","last_became_active":"2023-07-07T18:14:50.274631+0000","last_became_peered":"2023-07-07T18:14:50.274631+0000","last_unstale":"2023-07-07T18:14:50.786752+0000","last_undegraded":"2023-07-07T18:14:50.786752+0000","last_fullsized":"2023-07-07T18:14:50.786752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:26:07.680601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287040+0000","last_change":"2023-07-07T18:14:45.819945+0000","last_active":"2023-07-07T18:14:51.287040+0000","last_peered":"2023-07-07T18:14:51.287040+0000","last_clean":"2023-07-07T18:14:51.287040+0000","last_became_active":"2023-07-07T18:14:45.819662+0000","last_became_peered":"2023-07-07T18:14:45.819662+0000","last_unstale":"2023-07-07T18:14:51.287040+0000","last_undegraded":"2023-07-07T18:14:51.287040+0000","last_fullsized":"2023-07-07T18:14:51.287040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:05:21.194016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288364+0000","last_change":"2023-07-07T18:14:46.253586+0000","last_active":"2023-07-07T18:14:51.288364+0000","last_peered":"2023-07-07T18:14:51.288364+0000","last_clean":"2023-07-07T18:14:51.288364+0000","last_became_active":"2023-07-07T18:14:46.250668+0000","last_became_peered":"2023-07-07T18:14:46.250668+0000","last_unstale":"2023-07-07T18:14:51.288364+0000","last_undegraded":"2023-07-07T18:14:51.288364+0000","last_fullsized":"2023-07-07T18:14:51.288364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:18:50.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695970+0000","last_change":"2023-07-07T18:14:50.278682+0000","last_active":"2023-07-07T18:14:50.695970+0000","last_peered":"2023-07-07T18:14:50.695970+0000","last_clean":"2023-07-07T18:14:50.695970+0000","last_became_active":"2023-07-07T18:14:50.278199+0000","last_became_peered":"2023-07-07T18:14:50.278199+0000","last_unstale":"2023-07-07T18:14:50.695970+0000","last_undegraded":"2023-07-07T18:14:50.695970+0000","last_fullsized":"2023-07-07T18:14:50.695970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:29.387286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695323+0000","last_change":"2023-07-07T18:14:45.828517+0000","last_active":"2023-07-07T18:14:50.695323+0000","last_peered":"2023-07-07T18:14:50.695323+0000","last_clean":"2023-07-07T18:14:50.695323+0000","last_became_active":"2023-07-07T18:14:45.828221+0000","last_became_peered":"2023-07-07T18:14:45.828221+0000","last_unstale":"2023-07-07T18:14:50.695323+0000","last_undegraded":"2023-07-07T18:14:50.695323+0000","last_fullsized":"2023-07-07T18:14:50.695323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:55.691985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786013+0000","last_change":"2023-07-07T18:14:46.243955+0000","last_active":"2023-07-07T18:14:50.786013+0000","last_peered":"2023-07-07T18:14:50.786013+0000","last_clean":"2023-07-07T18:14:50.786013+0000","last_became_active":"2023-07-07T18:14:46.243697+0000","last_became_peered":"2023-07-07T18:14:46.243697+0000","last_unstale":"2023-07-07T18:14:50.786013+0000","last_undegraded":"2023-07-07T18:14:50.786013+0000","last_fullsized":"2023-07-07T18:14:50.786013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286669+0000","last_change":"2023-07-07T18:14:50.283314+0000","last_active":"2023-07-07T18:14:51.286669+0000","last_peered":"2023-07-07T18:14:51.286669+0000","last_clean":"2023-07-07T18:14:51.286669+0000","last_became_active":"2023-07-07T18:14:50.282741+0000","last_became_peered":"2023-07-07T18:14:50.282741+0000","last_unstale":"2023-07-07T18:14:51.286669+0000","last_undegraded":"2023-07-07T18:14:51.286669+0000","last_fullsized":"2023-07-07T18:14:51.286669+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:24:24.468449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695371+0000","last_change":"2023-07-07T18:14:45.828552+0000","last_active":"2023-07-07T18:14:50.695371+0000","last_peered":"2023-07-07T18:14:50.695371+0000","last_clean":"2023-07-07T18:14:50.695371+0000","last_became_active":"2023-07-07T18:14:45.828251+0000","last_became_peered":"2023-07-07T18:14:45.828251+0000","last_unstale":"2023-07-07T18:14:50.695371+0000","last_undegraded":"2023-07-07T18:14:50.695371+0000","last_fullsized":"2023-07-07T18:14:50.695371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:05:04.291822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694453+0000","last_change":"2023-07-07T18:14:46.254474+0000","last_active":"2023-07-07T18:14:50.694453+0000","last_peered":"2023-07-07T18:14:50.694453+0000","last_clean":"2023-07-07T18:14:50.694453+0000","last_became_active":"2023-07-07T18:14:46.253792+0000","last_became_peered":"2023-07-07T18:14:46.253792+0000","last_unstale":"2023-07-07T18:14:50.694453+0000","last_undegraded":"2023-07-07T18:14:50.694453+0000","last_fullsized":"2023-07-07T18:14:50.694453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:32:22.705610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287527+0000","last_change":"2023-07-07T18:14:50.275935+0000","last_active":"2023-07-07T18:14:51.287527+0000","last_peered":"2023-07-07T18:14:51.287527+0000","last_clean":"2023-07-07T18:14:51.287527+0000","last_became_active":"2023-07-07T18:14:50.275504+0000","last_became_peered":"2023-07-07T18:14:50.275504+0000","last_unstale":"2023-07-07T18:14:51.287527+0000","last_undegraded":"2023-07-07T18:14:51.287527+0000","last_fullsized":"2023-07-07T18:14:51.287527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:46:53.498090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695560+0000","last_change":"2023-07-07T18:14:45.824161+0000","last_active":"2023-07-07T18:14:50.695560+0000","last_peered":"2023-07-07T18:14:50.695560+0000","last_clean":"2023-07-07T18:14:50.695560+0000","last_became_active":"2023-07-07T18:14:45.823845+0000","last_became_peered":"2023-07-07T18:14:45.823845+0000","last_unstale":"2023-07-07T18:14:50.695560+0000","last_undegraded":"2023-07-07T18:14:50.695560+0000","last_fullsized":"2023-07-07T18:14:50.695560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:01:56.238194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287041+0000","last_change":"2023-07-07T18:14:46.251483+0000","last_active":"2023-07-07T18:14:51.287041+0000","last_peered":"2023-07-07T18:14:51.287041+0000","last_clean":"2023-07-07T18:14:51.287041+0000","last_became_active":"2023-07-07T18:14:46.251186+0000","last_became_peered":"2023-07-07T18:14:46.251186+0000","last_unstale":"2023-07-07T18:14:51.287041+0000","last_undegraded":"2023-07-07T18:14:51.287041+0000","last_fullsized":"2023-07-07T18:14:51.287041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:49:31.365534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287561+0000","last_change":"2023-07-07T18:14:50.284553+0000","last_active":"2023-07-07T18:14:51.287561+0000","last_peered":"2023-07-07T18:14:51.287561+0000","last_clean":"2023-07-07T18:14:51.287561+0000","last_became_active":"2023-07-07T18:14:50.284133+0000","last_became_peered":"2023-07-07T18:14:50.284133+0000","last_unstale":"2023-07-07T18:14:51.287561+0000","last_undegraded":"2023-07-07T18:14:51.287561+0000","last_fullsized":"2023-07-07T18:14:51.287561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:32:21.452429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786401+0000","last_change":"2023-07-07T18:14:45.825329+0000","last_active":"2023-07-07T18:14:50.786401+0000","last_peered":"2023-07-07T18:14:50.786401+0000","last_clean":"2023-07-07T18:14:50.786401+0000","last_became_active":"2023-07-07T18:14:45.824977+0000","last_became_peered":"2023-07-07T18:14:45.824977+0000","last_unstale":"2023-07-07T18:14:50.786401+0000","last_undegraded":"2023-07-07T18:14:50.786401+0000","last_fullsized":"2023-07-07T18:14:50.786401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:26.735034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769180+0000","last_change":"2023-07-07T18:14:46.253430+0000","last_active":"2023-07-07T18:14:50.769180+0000","last_peered":"2023-07-07T18:14:50.769180+0000","last_clean":"2023-07-07T18:14:50.769180+0000","last_became_active":"2023-07-07T18:14:46.252998+0000","last_became_peered":"2023-07-07T18:14:46.252998+0000","last_unstale":"2023-07-07T18:14:50.769180+0000","last_undegraded":"2023-07-07T18:14:50.769180+0000","last_fullsized":"2023-07-07T18:14:50.769180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:10:28.413855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287751+0000","last_change":"2023-07-07T18:14:50.281644+0000","last_active":"2023-07-07T18:14:51.287751+0000","last_peered":"2023-07-07T18:14:51.287751+0000","last_clean":"2023-07-07T18:14:51.287751+0000","last_became_active":"2023-07-07T18:14:50.281288+0000","last_became_peered":"2023-07-07T18:14:50.281288+0000","last_unstale":"2023-07-07T18:14:51.287751+0000","last_undegraded":"2023-07-07T18:14:51.287751+0000","last_fullsized":"2023-07-07T18:14:51.287751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:05:38.716449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286765+0000","last_change":"2023-07-07T18:14:45.825137+0000","last_active":"2023-07-07T18:14:51.286765+0000","last_peered":"2023-07-07T18:14:51.286765+0000","last_clean":"2023-07-07T18:14:51.286765+0000","last_became_active":"2023-07-07T18:14:45.824813+0000","last_became_peered":"2023-07-07T18:14:45.824813+0000","last_unstale":"2023-07-07T18:14:51.286765+0000","last_undegraded":"2023-07-07T18:14:51.286765+0000","last_fullsized":"2023-07-07T18:14:51.286765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:39:11.889878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695709+0000","last_change":"2023-07-07T18:14:46.261872+0000","last_active":"2023-07-07T18:14:50.695709+0000","last_peered":"2023-07-07T18:14:50.695709+0000","last_clean":"2023-07-07T18:14:50.695709+0000","last_became_active":"2023-07-07T18:14:46.261503+0000","last_became_peered":"2023-07-07T18:14:46.261503+0000","last_unstale":"2023-07-07T18:14:50.695709+0000","last_undegraded":"2023-07-07T18:14:50.695709+0000","last_fullsized":"2023-07-07T18:14:50.695709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:28:13.350106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693444+0000","last_change":"2023-07-07T18:14:50.282090+0000","last_active":"2023-07-07T18:14:50.693444+0000","last_peered":"2023-07-07T18:14:50.693444+0000","last_clean":"2023-07-07T18:14:50.693444+0000","last_became_active":"2023-07-07T18:14:50.281530+0000","last_became_peered":"2023-07-07T18:14:50.281530+0000","last_unstale":"2023-07-07T18:14:50.693444+0000","last_undegraded":"2023-07-07T18:14:50.693444+0000","last_fullsized":"2023-07-07T18:14:50.693444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:39.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287090+0000","last_change":"2023-07-07T18:14:45.827877+0000","last_active":"2023-07-07T18:14:51.287090+0000","last_peered":"2023-07-07T18:14:51.287090+0000","last_clean":"2023-07-07T18:14:51.287090+0000","last_became_active":"2023-07-07T18:14:45.827533+0000","last_became_peered":"2023-07-07T18:14:45.827533+0000","last_unstale":"2023-07-07T18:14:51.287090+0000","last_undegraded":"2023-07-07T18:14:51.287090+0000","last_fullsized":"2023-07-07T18:14:51.287090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:32:52.527564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696156+0000","last_change":"2023-07-07T18:14:46.256950+0000","last_active":"2023-07-07T18:14:50.696156+0000","last_peered":"2023-07-07T18:14:50.696156+0000","last_clean":"2023-07-07T18:14:50.696156+0000","last_became_active":"2023-07-07T18:14:46.254597+0000","last_became_peered":"2023-07-07T18:14:46.254597+0000","last_unstale":"2023-07-07T18:14:50.696156+0000","last_undegraded":"2023-07-07T18:14:50.696156+0000","last_fullsized":"2023-07-07T18:14:50.696156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:51:19.489510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786947+0000","last_change":"2023-07-07T18:14:50.275061+0000","last_active":"2023-07-07T18:14:50.786947+0000","last_peered":"2023-07-07T18:14:50.786947+0000","last_clean":"2023-07-07T18:14:50.786947+0000","last_became_active":"2023-07-07T18:14:50.274636+0000","last_became_peered":"2023-07-07T18:14:50.274636+0000","last_unstale":"2023-07-07T18:14:50.786947+0000","last_undegraded":"2023-07-07T18:14:50.786947+0000","last_fullsized":"2023-07-07T18:14:50.786947+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:17:32.136223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694160+0000","last_change":"2023-07-07T18:14:45.816489+0000","last_active":"2023-07-07T18:14:50.694160+0000","last_peered":"2023-07-07T18:14:50.694160+0000","last_clean":"2023-07-07T18:14:50.694160+0000","last_became_active":"2023-07-07T18:14:45.816126+0000","last_became_peered":"2023-07-07T18:14:45.816126+0000","last_unstale":"2023-07-07T18:14:50.694160+0000","last_undegraded":"2023-07-07T18:14:50.694160+0000","last_fullsized":"2023-07-07T18:14:50.694160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:19:43.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696412+0000","last_change":"2023-07-07T18:14:46.260154+0000","last_active":"2023-07-07T18:14:50.696412+0000","last_peered":"2023-07-07T18:14:50.696412+0000","last_clean":"2023-07-07T18:14:50.696412+0000","last_became_active":"2023-07-07T18:14:46.254390+0000","last_became_peered":"2023-07-07T18:14:46.254390+0000","last_unstale":"2023-07-07T18:14:50.696412+0000","last_undegraded":"2023-07-07T18:14:50.696412+0000","last_fullsized":"2023-07-07T18:14:50.696412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:39:54.707650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696102+0000","last_change":"2023-07-07T18:14:50.275972+0000","last_active":"2023-07-07T18:14:50.696102+0000","last_peered":"2023-07-07T18:14:50.696102+0000","last_clean":"2023-07-07T18:14:50.696102+0000","last_became_active":"2023-07-07T18:14:50.275539+0000","last_became_peered":"2023-07-07T18:14:50.275539+0000","last_unstale":"2023-07-07T18:14:50.696102+0000","last_undegraded":"2023-07-07T18:14:50.696102+0000","last_fullsized":"2023-07-07T18:14:50.696102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:48:45.018589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287119+0000","last_change":"2023-07-07T18:14:45.825399+0000","last_active":"2023-07-07T18:14:51.287119+0000","last_peered":"2023-07-07T18:14:51.287119+0000","last_clean":"2023-07-07T18:14:51.287119+0000","last_became_active":"2023-07-07T18:14:45.825119+0000","last_became_peered":"2023-07-07T18:14:45.825119+0000","last_unstale":"2023-07-07T18:14:51.287119+0000","last_undegraded":"2023-07-07T18:14:51.287119+0000","last_fullsized":"2023-07-07T18:14:51.287119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:58:05.705920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693893+0000","last_change":"2023-07-07T18:14:46.240829+0000","last_active":"2023-07-07T18:14:50.693893+0000","last_peered":"2023-07-07T18:14:50.693893+0000","last_clean":"2023-07-07T18:14:50.693893+0000","last_became_active":"2023-07-07T18:14:46.239938+0000","last_became_peered":"2023-07-07T18:14:46.239938+0000","last_unstale":"2023-07-07T18:14:50.693893+0000","last_undegraded":"2023-07-07T18:14:50.693893+0000","last_fullsized":"2023-07-07T18:14:50.693893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:35.628378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768716+0000","last_change":"2023-07-07T18:14:50.274346+0000","last_active":"2023-07-07T18:14:50.768716+0000","last_peered":"2023-07-07T18:14:50.768716+0000","last_clean":"2023-07-07T18:14:50.768716+0000","last_became_active":"2023-07-07T18:14:50.271130+0000","last_became_peered":"2023-07-07T18:14:50.271130+0000","last_unstale":"2023-07-07T18:14:50.768716+0000","last_undegraded":"2023-07-07T18:14:50.768716+0000","last_fullsized":"2023-07-07T18:14:50.768716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:46:52.347771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693665+0000","last_change":"2023-07-07T18:14:41.010006+0000","last_active":"2023-07-07T18:14:50.693665+0000","last_peered":"2023-07-07T18:14:50.693665+0000","last_clean":"2023-07-07T18:14:50.693665+0000","last_became_active":"2023-07-07T18:14:41.009625+0000","last_became_peered":"2023-07-07T18:14:41.009625+0000","last_unstale":"2023-07-07T18:14:50.693665+0000","last_undegraded":"2023-07-07T18:14:50.693665+0000","last_fullsized":"2023-07-07T18:14:50.693665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:11.821985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786501+0000","last_change":"2023-07-07T18:14:45.825558+0000","last_active":"2023-07-07T18:14:50.786501+0000","last_peered":"2023-07-07T18:14:50.786501+0000","last_clean":"2023-07-07T18:14:50.786501+0000","last_became_active":"2023-07-07T18:14:45.824990+0000","last_became_peered":"2023-07-07T18:14:45.824990+0000","last_unstale":"2023-07-07T18:14:50.786501+0000","last_undegraded":"2023-07-07T18:14:50.786501+0000","last_fullsized":"2023-07-07T18:14:50.786501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:49:47.115748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693078+0000","last_change":"2023-07-07T18:14:46.236943+0000","last_active":"2023-07-07T18:14:50.693078+0000","last_peered":"2023-07-07T18:14:50.693078+0000","last_clean":"2023-07-07T18:14:50.693078+0000","last_became_active":"2023-07-07T18:14:46.236679+0000","last_became_peered":"2023-07-07T18:14:46.236679+0000","last_unstale":"2023-07-07T18:14:50.693078+0000","last_undegraded":"2023-07-07T18:14:50.693078+0000","last_fullsized":"2023-07-07T18:14:50.693078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:32:08.214196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768915+0000","last_change":"2023-07-07T18:14:50.274560+0000","last_active":"2023-07-07T18:14:50.768915+0000","last_peered":"2023-07-07T18:14:50.768915+0000","last_clean":"2023-07-07T18:14:50.768915+0000","last_became_active":"2023-07-07T18:14:50.273900+0000","last_became_peered":"2023-07-07T18:14:50.273900+0000","last_unstale":"2023-07-07T18:14:50.768915+0000","last_undegraded":"2023-07-07T18:14:50.768915+0000","last_fullsized":"2023-07-07T18:14:50.768915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:21.422334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786290+0000","last_change":"2023-07-07T18:14:40.652460+0000","last_active":"2023-07-07T18:14:50.786290+0000","last_peered":"2023-07-07T18:14:50.786290+0000","last_clean":"2023-07-07T18:14:50.786290+0000","last_became_active":"2023-07-07T18:14:40.652046+0000","last_became_peered":"2023-07-07T18:14:40.652046+0000","last_unstale":"2023-07-07T18:14:50.786290+0000","last_undegraded":"2023-07-07T18:14:50.786290+0000","last_fullsized":"2023-07-07T18:14:50.786290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:29.793269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694562+0000","last_change":"2023-07-07T18:14:45.827286+0000","last_active":"2023-07-07T18:14:50.694562+0000","last_peered":"2023-07-07T18:14:50.694562+0000","last_clean":"2023-07-07T18:14:50.694562+0000","last_became_active":"2023-07-07T18:14:45.826913+0000","last_became_peered":"2023-07-07T18:14:45.826913+0000","last_unstale":"2023-07-07T18:14:50.694562+0000","last_undegraded":"2023-07-07T18:14:50.694562+0000","last_fullsized":"2023-07-07T18:14:50.694562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:36:09.401587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693546+0000","last_change":"2023-07-07T18:14:46.239120+0000","last_active":"2023-07-07T18:14:50.693546+0000","last_peered":"2023-07-07T18:14:50.693546+0000","last_clean":"2023-07-07T18:14:50.693546+0000","last_became_active":"2023-07-07T18:14:46.238876+0000","last_became_peered":"2023-07-07T18:14:46.238876+0000","last_unstale":"2023-07-07T18:14:50.693546+0000","last_undegraded":"2023-07-07T18:14:50.693546+0000","last_fullsized":"2023-07-07T18:14:50.693546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287928+0000","last_change":"2023-07-07T18:14:50.282994+0000","last_active":"2023-07-07T18:14:51.287928+0000","last_peered":"2023-07-07T18:14:51.287928+0000","last_clean":"2023-07-07T18:14:51.287928+0000","last_became_active":"2023-07-07T18:14:50.282569+0000","last_became_peered":"2023-07-07T18:14:50.282569+0000","last_unstale":"2023-07-07T18:14:51.287928+0000","last_undegraded":"2023-07-07T18:14:51.287928+0000","last_fullsized":"2023-07-07T18:14:51.287928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:00:27.527355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287831+0000","last_change":"2023-07-07T18:14:41.009938+0000","last_active":"2023-07-07T18:14:51.287831+0000","last_peered":"2023-07-07T18:14:51.287831+0000","last_clean":"2023-07-07T18:14:51.287831+0000","last_became_active":"2023-07-07T18:14:41.009637+0000","last_became_peered":"2023-07-07T18:14:41.009637+0000","last_unstale":"2023-07-07T18:14:51.287831+0000","last_undegraded":"2023-07-07T18:14:51.287831+0000","last_fullsized":"2023-07-07T18:14:51.287831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:47:01.369288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693129+0000","last_change":"2023-07-07T18:14:45.813731+0000","last_active":"2023-07-07T18:14:50.693129+0000","last_peered":"2023-07-07T18:14:50.693129+0000","last_clean":"2023-07-07T18:14:50.693129+0000","last_became_active":"2023-07-07T18:14:45.813444+0000","last_became_peered":"2023-07-07T18:14:45.813444+0000","last_unstale":"2023-07-07T18:14:50.693129+0000","last_undegraded":"2023-07-07T18:14:50.693129+0000","last_fullsized":"2023-07-07T18:14:50.693129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:04.776980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693755+0000","last_change":"2023-07-07T18:14:46.238296+0000","last_active":"2023-07-07T18:14:50.693755+0000","last_peered":"2023-07-07T18:14:50.693755+0000","last_clean":"2023-07-07T18:14:50.693755+0000","last_became_active":"2023-07-07T18:14:46.237650+0000","last_became_peered":"2023-07-07T18:14:46.237650+0000","last_unstale":"2023-07-07T18:14:50.693755+0000","last_undegraded":"2023-07-07T18:14:50.693755+0000","last_fullsized":"2023-07-07T18:14:50.693755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:35.950124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695160+0000","last_change":"2023-07-07T18:14:50.276840+0000","last_active":"2023-07-07T18:14:50.695160+0000","last_peered":"2023-07-07T18:14:50.695160+0000","last_clean":"2023-07-07T18:14:50.695160+0000","last_became_active":"2023-07-07T18:14:50.276444+0000","last_became_peered":"2023-07-07T18:14:50.276444+0000","last_unstale":"2023-07-07T18:14:50.695160+0000","last_undegraded":"2023-07-07T18:14:50.695160+0000","last_fullsized":"2023-07-07T18:14:50.695160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:26:07.867774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786425+0000","last_change":"2023-07-07T18:14:40.652887+0000","last_active":"2023-07-07T18:14:50.786425+0000","last_peered":"2023-07-07T18:14:50.786425+0000","last_clean":"2023-07-07T18:14:50.786425+0000","last_became_active":"2023-07-07T18:14:40.652550+0000","last_became_peered":"2023-07-07T18:14:40.652550+0000","last_unstale":"2023-07-07T18:14:50.786425+0000","last_undegraded":"2023-07-07T18:14:50.786425+0000","last_fullsized":"2023-07-07T18:14:50.786425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:29.471523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694978+0000","last_change":"2023-07-07T18:14:34.464008+0000","last_active":"2023-07-07T18:14:50.694978+0000","last_peered":"2023-07-07T18:14:50.694978+0000","last_clean":"2023-07-07T18:14:50.694978+0000","last_became_active":"2023-07-07T18:14:34.463018+0000","last_became_peered":"2023-07-07T18:14:34.463018+0000","last_unstale":"2023-07-07T18:14:50.694978+0000","last_undegraded":"2023-07-07T18:14:50.694978+0000","last_fullsized":"2023-07-07T18:14:50.694978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_clean_scrub_stamp":"2023-07-07T18:14:33.057285+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:10.029083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287082+0000","last_change":"2023-07-07T18:14:45.825928+0000","last_active":"2023-07-07T18:14:51.287082+0000","last_peered":"2023-07-07T18:14:51.287082+0000","last_clean":"2023-07-07T18:14:51.287082+0000","last_became_active":"2023-07-07T18:14:45.825599+0000","last_became_peered":"2023-07-07T18:14:45.825599+0000","last_unstale":"2023-07-07T18:14:51.287082+0000","last_undegraded":"2023-07-07T18:14:51.287082+0000","last_fullsized":"2023-07-07T18:14:51.287082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:04:44.156178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287267+0000","last_change":"2023-07-07T18:14:46.262476+0000","last_active":"2023-07-07T18:14:51.287267+0000","last_peered":"2023-07-07T18:14:51.287267+0000","last_clean":"2023-07-07T18:14:51.287267+0000","last_became_active":"2023-07-07T18:14:46.262165+0000","last_became_peered":"2023-07-07T18:14:46.262165+0000","last_unstale":"2023-07-07T18:14:51.287267+0000","last_undegraded":"2023-07-07T18:14:51.287267+0000","last_fullsized":"2023-07-07T18:14:51.287267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:21:36.267002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786724+0000","last_change":"2023-07-07T18:14:50.282211+0000","last_active":"2023-07-07T18:14:50.786724+0000","last_peered":"2023-07-07T18:14:50.786724+0000","last_clean":"2023-07-07T18:14:50.786724+0000","last_became_active":"2023-07-07T18:14:50.281448+0000","last_became_peered":"2023-07-07T18:14:50.281448+0000","last_unstale":"2023-07-07T18:14:50.786724+0000","last_undegraded":"2023-07-07T18:14:50.786724+0000","last_fullsized":"2023-07-07T18:14:50.786724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:17:53.884605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695381+0000","last_change":"2023-07-07T18:14:40.649525+0000","last_active":"2023-07-07T18:14:50.695381+0000","last_peered":"2023-07-07T18:14:50.695381+0000","last_clean":"2023-07-07T18:14:50.695381+0000","last_became_active":"2023-07-07T18:14:40.649168+0000","last_became_peered":"2023-07-07T18:14:40.649168+0000","last_unstale":"2023-07-07T18:14:50.695381+0000","last_undegraded":"2023-07-07T18:14:50.695381+0000","last_fullsized":"2023-07-07T18:14:50.695381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:04:39.008697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768373+0000","last_change":"2023-07-07T18:14:45.825496+0000","last_active":"2023-07-07T18:14:50.768373+0000","last_peered":"2023-07-07T18:14:50.768373+0000","last_clean":"2023-07-07T18:14:50.768373+0000","last_became_active":"2023-07-07T18:14:45.825173+0000","last_became_peered":"2023-07-07T18:14:45.825173+0000","last_unstale":"2023-07-07T18:14:50.768373+0000","last_undegraded":"2023-07-07T18:14:50.768373+0000","last_fullsized":"2023-07-07T18:14:50.768373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:32:07.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768857+0000","last_change":"2023-07-07T18:14:46.252633+0000","last_active":"2023-07-07T18:14:50.768857+0000","last_peered":"2023-07-07T18:14:50.768857+0000","last_clean":"2023-07-07T18:14:50.768857+0000","last_became_active":"2023-07-07T18:14:46.252199+0000","last_became_peered":"2023-07-07T18:14:46.252199+0000","last_unstale":"2023-07-07T18:14:50.768857+0000","last_undegraded":"2023-07-07T18:14:50.768857+0000","last_fullsized":"2023-07-07T18:14:50.768857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287489+0000","last_change":"2023-07-07T18:14:50.276895+0000","last_active":"2023-07-07T18:14:51.287489+0000","last_peered":"2023-07-07T18:14:51.287489+0000","last_clean":"2023-07-07T18:14:51.287489+0000","last_became_active":"2023-07-07T18:14:50.276507+0000","last_became_peered":"2023-07-07T18:14:50.276507+0000","last_unstale":"2023-07-07T18:14:51.287489+0000","last_undegraded":"2023-07-07T18:14:51.287489+0000","last_fullsized":"2023-07-07T18:14:51.287489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:34:18.314525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695369+0000","last_change":"2023-07-07T18:14:41.009946+0000","last_active":"2023-07-07T18:14:50.695369+0000","last_peered":"2023-07-07T18:14:50.695369+0000","last_clean":"2023-07-07T18:14:50.695369+0000","last_became_active":"2023-07-07T18:14:41.009627+0000","last_became_peered":"2023-07-07T18:14:41.009627+0000","last_unstale":"2023-07-07T18:14:50.695369+0000","last_undegraded":"2023-07-07T18:14:50.695369+0000","last_fullsized":"2023-07-07T18:14:50.695369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:58:00.558439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693986+0000","last_change":"2023-07-07T18:14:45.814432+0000","last_active":"2023-07-07T18:14:50.693986+0000","last_peered":"2023-07-07T18:14:50.693986+0000","last_clean":"2023-07-07T18:14:50.693986+0000","last_became_active":"2023-07-07T18:14:45.814128+0000","last_became_peered":"2023-07-07T18:14:45.814128+0000","last_unstale":"2023-07-07T18:14:50.693986+0000","last_undegraded":"2023-07-07T18:14:50.693986+0000","last_fullsized":"2023-07-07T18:14:50.693986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:09.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769002+0000","last_change":"2023-07-07T18:14:46.253259+0000","last_active":"2023-07-07T18:14:50.769002+0000","last_peered":"2023-07-07T18:14:50.769002+0000","last_clean":"2023-07-07T18:14:50.769002+0000","last_became_active":"2023-07-07T18:14:46.252670+0000","last_became_peered":"2023-07-07T18:14:46.252670+0000","last_unstale":"2023-07-07T18:14:50.769002+0000","last_undegraded":"2023-07-07T18:14:50.769002+0000","last_fullsized":"2023-07-07T18:14:50.769002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:56.152988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695641+0000","last_change":"2023-07-07T18:14:50.279532+0000","last_active":"2023-07-07T18:14:50.695641+0000","last_peered":"2023-07-07T18:14:50.695641+0000","last_clean":"2023-07-07T18:14:50.695641+0000","last_became_active":"2023-07-07T18:14:50.279056+0000","last_became_peered":"2023-07-07T18:14:50.279056+0000","last_unstale":"2023-07-07T18:14:50.695641+0000","last_undegraded":"2023-07-07T18:14:50.695641+0000","last_fullsized":"2023-07-07T18:14:50.695641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:08:30.223728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288438+0000","last_change":"2023-07-07T18:14:45.825994+0000","last_active":"2023-07-07T18:14:51.288438+0000","last_peered":"2023-07-07T18:14:51.288438+0000","last_clean":"2023-07-07T18:14:51.288438+0000","last_became_active":"2023-07-07T18:14:45.825663+0000","last_became_peered":"2023-07-07T18:14:45.825663+0000","last_unstale":"2023-07-07T18:14:51.288438+0000","last_undegraded":"2023-07-07T18:14:51.288438+0000","last_fullsized":"2023-07-07T18:14:51.288438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:39:19.689182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693519+0000","last_change":"2023-07-07T18:14:40.651911+0000","last_active":"2023-07-07T18:14:50.693519+0000","last_peered":"2023-07-07T18:14:50.693519+0000","last_clean":"2023-07-07T18:14:50.693519+0000","last_became_active":"2023-07-07T18:14:40.651592+0000","last_became_peered":"2023-07-07T18:14:40.651592+0000","last_unstale":"2023-07-07T18:14:50.693519+0000","last_undegraded":"2023-07-07T18:14:50.693519+0000","last_fullsized":"2023-07-07T18:14:50.693519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:14:59.730163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286989+0000","last_change":"2023-07-07T18:14:46.251841+0000","last_active":"2023-07-07T18:14:51.286989+0000","last_peered":"2023-07-07T18:14:51.286989+0000","last_clean":"2023-07-07T18:14:51.286989+0000","last_became_active":"2023-07-07T18:14:46.251574+0000","last_became_peered":"2023-07-07T18:14:46.251574+0000","last_unstale":"2023-07-07T18:14:51.286989+0000","last_undegraded":"2023-07-07T18:14:51.286989+0000","last_fullsized":"2023-07-07T18:14:51.286989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:56.701359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286832+0000","last_change":"2023-07-07T18:14:50.280371+0000","last_active":"2023-07-07T18:14:51.286832+0000","last_peered":"2023-07-07T18:14:51.286832+0000","last_clean":"2023-07-07T18:14:51.286832+0000","last_became_active":"2023-07-07T18:14:50.279833+0000","last_became_peered":"2023-07-07T18:14:50.279833+0000","last_unstale":"2023-07-07T18:14:51.286832+0000","last_undegraded":"2023-07-07T18:14:51.286832+0000","last_fullsized":"2023-07-07T18:14:51.286832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:24.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287631+0000","last_change":"2023-07-07T18:14:40.653854+0000","last_active":"2023-07-07T18:14:51.287631+0000","last_peered":"2023-07-07T18:14:51.287631+0000","last_clean":"2023-07-07T18:14:51.287631+0000","last_became_active":"2023-07-07T18:14:40.653556+0000","last_became_peered":"2023-07-07T18:14:40.653556+0000","last_unstale":"2023-07-07T18:14:51.287631+0000","last_undegraded":"2023-07-07T18:14:51.287631+0000","last_fullsized":"2023-07-07T18:14:51.287631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:49:03.953888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:15:00.768001+0000","last_change":"2023-07-07T18:14:45.813532+0000","last_active":"2023-07-07T18:15:00.768001+0000","last_peered":"2023-07-07T18:15:00.768001+0000","last_clean":"2023-07-07T18:15:00.768001+0000","last_became_active":"2023-07-07T18:14:45.813237+0000","last_became_peered":"2023-07-07T18:14:45.813237+0000","last_unstale":"2023-07-07T18:15:00.768001+0000","last_undegraded":"2023-07-07T18:15:00.768001+0000","last_fullsized":"2023-07-07T18:15:00.768001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:29.191939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694299+0000","last_change":"2023-07-07T18:14:46.256921+0000","last_active":"2023-07-07T18:14:50.694299+0000","last_peered":"2023-07-07T18:14:50.694299+0000","last_clean":"2023-07-07T18:14:50.694299+0000","last_became_active":"2023-07-07T18:14:46.255057+0000","last_became_peered":"2023-07-07T18:14:46.255057+0000","last_unstale":"2023-07-07T18:14:50.694299+0000","last_undegraded":"2023-07-07T18:14:50.694299+0000","last_fullsized":"2023-07-07T18:14:50.694299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:01:33.602440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693740+0000","last_change":"2023-07-07T18:14:50.281352+0000","last_active":"2023-07-07T18:14:50.693740+0000","last_peered":"2023-07-07T18:14:50.693740+0000","last_clean":"2023-07-07T18:14:50.693740+0000","last_became_active":"2023-07-07T18:14:50.280740+0000","last_became_peered":"2023-07-07T18:14:50.280740+0000","last_unstale":"2023-07-07T18:14:50.693740+0000","last_undegraded":"2023-07-07T18:14:50.693740+0000","last_fullsized":"2023-07-07T18:14:50.693740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:33.644807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768930+0000","last_change":"2023-07-07T18:14:45.828162+0000","last_active":"2023-07-07T18:14:50.768930+0000","last_peered":"2023-07-07T18:14:50.768930+0000","last_clean":"2023-07-07T18:14:50.768930+0000","last_became_active":"2023-07-07T18:14:45.827811+0000","last_became_peered":"2023-07-07T18:14:45.827811+0000","last_unstale":"2023-07-07T18:14:50.768930+0000","last_undegraded":"2023-07-07T18:14:50.768930+0000","last_fullsized":"2023-07-07T18:14:50.768930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:24.297526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287464+0000","last_change":"2023-07-07T18:14:46.246578+0000","last_active":"2023-07-07T18:14:51.287464+0000","last_peered":"2023-07-07T18:14:51.287464+0000","last_clean":"2023-07-07T18:14:51.287464+0000","last_became_active":"2023-07-07T18:14:46.246295+0000","last_became_peered":"2023-07-07T18:14:46.246295+0000","last_unstale":"2023-07-07T18:14:51.287464+0000","last_undegraded":"2023-07-07T18:14:51.287464+0000","last_fullsized":"2023-07-07T18:14:51.287464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:48:00.728010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695529+0000","last_change":"2023-07-07T18:14:50.272282+0000","last_active":"2023-07-07T18:14:50.695529+0000","last_peered":"2023-07-07T18:14:50.695529+0000","last_clean":"2023-07-07T18:14:50.695529+0000","last_became_active":"2023-07-07T18:14:50.271865+0000","last_became_peered":"2023-07-07T18:14:50.271865+0000","last_unstale":"2023-07-07T18:14:50.695529+0000","last_undegraded":"2023-07-07T18:14:50.695529+0000","last_fullsized":"2023-07-07T18:14:50.695529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:54:34.460479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786378+0000","last_change":"2023-07-07T18:14:45.827922+0000","last_active":"2023-07-07T18:14:50.786378+0000","last_peered":"2023-07-07T18:14:50.786378+0000","last_clean":"2023-07-07T18:14:50.786378+0000","last_became_active":"2023-07-07T18:14:45.827638+0000","last_became_peered":"2023-07-07T18:14:45.827638+0000","last_unstale":"2023-07-07T18:14:50.786378+0000","last_undegraded":"2023-07-07T18:14:50.786378+0000","last_fullsized":"2023-07-07T18:14:50.786378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:24.297526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694444+0000","last_change":"2023-07-07T18:14:46.261660+0000","last_active":"2023-07-07T18:14:50.694444+0000","last_peered":"2023-07-07T18:14:50.694444+0000","last_clean":"2023-07-07T18:14:50.694444+0000","last_became_active":"2023-07-07T18:14:46.260861+0000","last_became_peered":"2023-07-07T18:14:46.260861+0000","last_unstale":"2023-07-07T18:14:50.694444+0000","last_undegraded":"2023-07-07T18:14:50.694444+0000","last_fullsized":"2023-07-07T18:14:50.694444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:47:43.651762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786504+0000","last_change":"2023-07-07T18:14:50.281633+0000","last_active":"2023-07-07T18:14:50.786504+0000","last_peered":"2023-07-07T18:14:50.786504+0000","last_clean":"2023-07-07T18:14:50.786504+0000","last_became_active":"2023-07-07T18:14:50.280606+0000","last_became_peered":"2023-07-07T18:14:50.280606+0000","last_unstale":"2023-07-07T18:14:50.786504+0000","last_undegraded":"2023-07-07T18:14:50.786504+0000","last_fullsized":"2023-07-07T18:14:50.786504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:59.596483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786476+0000","last_change":"2023-07-07T18:14:45.828754+0000","last_active":"2023-07-07T18:14:50.786476+0000","last_peered":"2023-07-07T18:14:50.786476+0000","last_clean":"2023-07-07T18:14:50.786476+0000","last_became_active":"2023-07-07T18:14:45.828425+0000","last_became_peered":"2023-07-07T18:14:45.828425+0000","last_unstale":"2023-07-07T18:14:50.786476+0000","last_undegraded":"2023-07-07T18:14:50.786476+0000","last_fullsized":"2023-07-07T18:14:50.786476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:09.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694287+0000","last_change":"2023-07-07T18:14:46.261672+0000","last_active":"2023-07-07T18:14:50.694287+0000","last_peered":"2023-07-07T18:14:50.694287+0000","last_clean":"2023-07-07T18:14:50.694287+0000","last_became_active":"2023-07-07T18:14:46.260782+0000","last_became_peered":"2023-07-07T18:14:46.260782+0000","last_unstale":"2023-07-07T18:14:50.694287+0000","last_undegraded":"2023-07-07T18:14:50.694287+0000","last_fullsized":"2023-07-07T18:14:50.694287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:51:02.683189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694186+0000","last_change":"2023-07-07T18:14:50.280851+0000","last_active":"2023-07-07T18:14:50.694186+0000","last_peered":"2023-07-07T18:14:50.694186+0000","last_clean":"2023-07-07T18:14:50.694186+0000","last_became_active":"2023-07-07T18:14:50.280316+0000","last_became_peered":"2023-07-07T18:14:50.280316+0000","last_unstale":"2023-07-07T18:14:50.694186+0000","last_undegraded":"2023-07-07T18:14:50.694186+0000","last_fullsized":"2023-07-07T18:14:50.694186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:28:18.418331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288205+0000","last_change":"2023-07-07T18:14:45.827930+0000","last_active":"2023-07-07T18:14:51.288205+0000","last_peered":"2023-07-07T18:14:51.288205+0000","last_clean":"2023-07-07T18:14:51.288205+0000","last_became_active":"2023-07-07T18:14:45.827650+0000","last_became_peered":"2023-07-07T18:14:45.827650+0000","last_unstale":"2023-07-07T18:14:51.288205+0000","last_undegraded":"2023-07-07T18:14:51.288205+0000","last_fullsized":"2023-07-07T18:14:51.288205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:41:51.857434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287208+0000","last_change":"2023-07-07T18:14:46.238211+0000","last_active":"2023-07-07T18:14:51.287208+0000","last_peered":"2023-07-07T18:14:51.287208+0000","last_clean":"2023-07-07T18:14:51.287208+0000","last_became_active":"2023-07-07T18:14:46.237822+0000","last_became_peered":"2023-07-07T18:14:46.237822+0000","last_unstale":"2023-07-07T18:14:51.287208+0000","last_undegraded":"2023-07-07T18:14:51.287208+0000","last_fullsized":"2023-07-07T18:14:51.287208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:23:49.686417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693146+0000","last_change":"2023-07-07T18:14:50.279713+0000","last_active":"2023-07-07T18:14:50.693146+0000","last_peered":"2023-07-07T18:14:50.693146+0000","last_clean":"2023-07-07T18:14:50.693146+0000","last_became_active":"2023-07-07T18:14:50.278898+0000","last_became_peered":"2023-07-07T18:14:50.278898+0000","last_unstale":"2023-07-07T18:14:50.693146+0000","last_undegraded":"2023-07-07T18:14:50.693146+0000","last_fullsized":"2023-07-07T18:14:50.693146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:41:35.250768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769299+0000","last_change":"2023-07-07T18:14:45.820079+0000","last_active":"2023-07-07T18:14:50.769299+0000","last_peered":"2023-07-07T18:14:50.769299+0000","last_clean":"2023-07-07T18:14:50.769299+0000","last_became_active":"2023-07-07T18:14:45.819405+0000","last_became_peered":"2023-07-07T18:14:45.819405+0000","last_unstale":"2023-07-07T18:14:50.769299+0000","last_undegraded":"2023-07-07T18:14:50.769299+0000","last_fullsized":"2023-07-07T18:14:50.769299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:50:57.504435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695320+0000","last_change":"2023-07-07T18:14:46.256641+0000","last_active":"2023-07-07T18:14:50.695320+0000","last_peered":"2023-07-07T18:14:50.695320+0000","last_clean":"2023-07-07T18:14:50.695320+0000","last_became_active":"2023-07-07T18:14:46.253883+0000","last_became_peered":"2023-07-07T18:14:46.253883+0000","last_unstale":"2023-07-07T18:14:50.695320+0000","last_undegraded":"2023-07-07T18:14:50.695320+0000","last_fullsized":"2023-07-07T18:14:50.695320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:00:41.025452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287193+0000","last_change":"2023-07-07T18:14:46.253192+0000","last_active":"2023-07-07T18:14:51.287193+0000","last_peered":"2023-07-07T18:14:51.287193+0000","last_clean":"2023-07-07T18:14:51.287193+0000","last_became_active":"2023-07-07T18:14:46.250853+0000","last_became_peered":"2023-07-07T18:14:46.250853+0000","last_unstale":"2023-07-07T18:14:51.287193+0000","last_undegraded":"2023-07-07T18:14:51.287193+0000","last_fullsized":"2023-07-07T18:14:51.287193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:29:26.486548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287484+0000","last_change":"2023-07-07T18:14:46.238908+0000","last_active":"2023-07-07T18:14:51.287484+0000","last_peered":"2023-07-07T18:14:51.287484+0000","last_clean":"2023-07-07T18:14:51.287484+0000","last_became_active":"2023-07-07T18:14:46.238441+0000","last_became_peered":"2023-07-07T18:14:46.238441+0000","last_unstale":"2023-07-07T18:14:51.287484+0000","last_undegraded":"2023-07-07T18:14:51.287484+0000","last_fullsized":"2023-07-07T18:14:51.287484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:03:21.014607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694640+0000","last_change":"2023-07-07T18:14:46.256362+0000","last_active":"2023-07-07T18:14:50.694640+0000","last_peered":"2023-07-07T18:14:50.694640+0000","last_clean":"2023-07-07T18:14:50.694640+0000","last_became_active":"2023-07-07T18:14:46.254215+0000","last_became_peered":"2023-07-07T18:14:46.254215+0000","last_unstale":"2023-07-07T18:14:50.694640+0000","last_undegraded":"2023-07-07T18:14:50.694640+0000","last_fullsized":"2023-07-07T18:14:50.694640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:51.783149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286797+0000","last_change":"2023-07-07T18:14:46.254566+0000","last_active":"2023-07-07T18:14:51.286797+0000","last_peered":"2023-07-07T18:14:51.286797+0000","last_clean":"2023-07-07T18:14:51.286797+0000","last_became_active":"2023-07-07T18:14:46.250615+0000","last_became_peered":"2023-07-07T18:14:46.250615+0000","last_unstale":"2023-07-07T18:14:51.286797+0000","last_undegraded":"2023-07-07T18:14:51.286797+0000","last_fullsized":"2023-07-07T18:14:51.286797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:26:04.424280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693785+0000","last_change":"2023-07-07T18:14:46.245808+0000","last_active":"2023-07-07T18:14:50.693785+0000","last_peered":"2023-07-07T18:14:50.693785+0000","last_clean":"2023-07-07T18:14:50.693785+0000","last_became_active":"2023-07-07T18:14:46.245489+0000","last_became_peered":"2023-07-07T18:14:46.245489+0000","last_unstale":"2023-07-07T18:14:50.693785+0000","last_undegraded":"2023-07-07T18:14:50.693785+0000","last_fullsized":"2023-07-07T18:14:50.693785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:25.306900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":933888,"data_stored":721743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":717646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":127455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":131215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":128017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T18:15:10.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T18:15:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.996+0000 7f28377ad700 1 Processor -- start 2023-07-07T18:15:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.997+0000 7f28377ad700 1 -- start start 2023-07-07T18:15:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.997+0000 7f28377ad700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f283015c2e0 0x7f28300ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.997+0000 7f28377ad700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 0x7f283015fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.997+0000 7f28377ad700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28300afdb0 con 0x7f2830160340 2023-07-07T18:15:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.997+0000 7f28377ad700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283015c6b0 con 0x7f283015c2e0 2023-07-07T18:15:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.997+0000 7f28377ad700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28300b0000 con 0x7f283006ccc0 2023-07-07T18:15:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.997+0000 7f2835549700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f283015c2e0 0x7f28300ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2835549700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f283015c2e0 0x7f28300ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57236/0 (socket says 172.21.15.12:57236) 2023-07-07T18:15:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2835549700 1 -- 172.21.15.12:0/1232935292 learned_addr learned my addr 172.21.15.12:0/1232935292 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2834d48700 1 --2- 172.21.15.12:0/1232935292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 0x7f283015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2835549700 1 -- 172.21.15.12:0/1232935292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 msgr2=0x7f283015fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2835549700 1 --2- 172.21.15.12:0/1232935292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 0x7f283015fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2835549700 1 -- 172.21.15.12:0/1232935292 >> v1:172.21.15.160:6789/0 conn(0x7f2830160340 legacy=0x7f28300d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2835549700 1 -- 172.21.15.12:0/1232935292 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283006ba10 con 0x7f283015c2e0 2023-07-07T18:15:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2835549700 1 --2- 172.21.15.12:0/1232935292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 0x7f28300ce480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f282c0098f0 tx=0x7f282c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6326999369f7f13 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2823fff700 1 -- 172.21.15.12:0/1232935292 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c00b8a0 con 0x7f283015c2e0 2023-07-07T18:15:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2823fff700 1 -- 172.21.15.12:0/1232935292 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c00ba00 con 0x7f283015c2e0 2023-07-07T18:15:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.998+0000 7f2823fff700 1 -- 172.21.15.12:0/1232935292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c00bd90 con 0x7f283015c2e0 2023-07-07T18:15:11.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.999+0000 7f28377ad700 1 -- 172.21.15.12:0/1232935292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 msgr2=0x7f28300ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.999+0000 7f28377ad700 1 --2- 172.21.15.12:0/1232935292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 0x7f28300ce480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f282c0098f0 tx=0x7f282c009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:11.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.999+0000 7f28377ad700 1 -- 172.21.15.12:0/1232935292 shutdown_connections 2023-07-07T18:15:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.999+0000 7f28377ad700 1 --2- 172.21.15.12:0/1232935292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 0x7f28300ce480 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.999+0000 7f28377ad700 1 --2- 172.21.15.12:0/1232935292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 0x7f283015fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.999+0000 7f28377ad700 1 -- 172.21.15.12:0/1232935292 >> 172.21.15.12:0/1232935292 conn(0x7f283006e530 msgr2=0x7f283006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.999+0000 7f28377ad700 1 -- 172.21.15.12:0/1232935292 shutdown_connections 2023-07-07T18:15:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:10.999+0000 7f28377ad700 1 -- 172.21.15.12:0/1232935292 wait complete. 2023-07-07T18:15:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.000+0000 7f28377ad700 1 Processor -- start 2023-07-07T18:15:11.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.001+0000 7f28377ad700 1 -- start start 2023-07-07T18:15:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.001+0000 7f28377ad700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 0x7f28300b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.001+0000 7f28377ad700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 0x7f28301f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.001+0000 7f28377ad700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2830160340 0x7f28300b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.001+0000 7f28377ad700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28301f31b0 con 0x7f283015c2e0 2023-07-07T18:15:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.001+0000 7f28377ad700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28300b0940 con 0x7f2830160340 2023-07-07T18:15:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.001+0000 7f28377ad700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28300b0c20 con 0x7f283006ccc0 2023-07-07T18:15:11.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2834d48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 0x7f28301f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2834d48700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 0x7f28301f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57244/0 (socket says 172.21.15.12:57244) 2023-07-07T18:15:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2834d48700 1 -- 172.21.15.12:0/1721599096 learned_addr learned my addr 172.21.15.12:0/1721599096 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2835549700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 0x7f28300b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2835d4a700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2830160340 0x7f28300b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2834d48700 1 -- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 msgr2=0x7f28300b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2834d48700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 0x7f28300b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2834d48700 1 -- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2830160340 msgr2=0x7f28300b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2834d48700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2830160340 0x7f28300b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2834d48700 1 -- 172.21.15.12:0/1721599096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c009550 con 0x7f283015c2e0 2023-07-07T18:15:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2834d48700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 0x7f28301f2c70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f282400d800 tx=0x7f282400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2821ffb700 1 -- 172.21.15.12:0/1721599096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28240125f0 con 0x7f283015c2e0 2023-07-07T18:15:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2821ffb700 1 -- 172.21.15.12:0/1721599096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2824012750 con 0x7f283015c2e0 2023-07-07T18:15:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f2821ffb700 1 -- 172.21.15.12:0/1721599096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824012b00 con 0x7f283015c2e0 2023-07-07T18:15:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.002+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28300b0f00 con 0x7f283015c2e0 2023-07-07T18:15:11.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.003+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28300b14c0 con 0x7f283015c2e0 2023-07-07T18:15:11.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.003+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28300b1680 con 0x7f283015c2e0 2023-07-07T18:15:11.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.004+0000 7f2821ffb700 1 -- 172.21.15.12:0/1721599096 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2824012c60 con 0x7f283015c2e0 2023-07-07T18:15:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.004+0000 7f2821ffb700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f281406ace0 0x7f281406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.004+0000 7f2821ffb700 1 -- 172.21.15.12:0/1721599096 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2824089b60 con 0x7f283015c2e0 2023-07-07T18:15:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.004+0000 7f2835549700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f281406ace0 0x7f281406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.005+0000 7f2835549700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f281406ace0 0x7f281406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f282c009c40 tx=0x7f282c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:11.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.009+0000 7f2821ffb700 1 -- 172.21.15.12:0/1721599096 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2824054920 con 0x7f283015c2e0 2023-07-07T18:15:11.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.199+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 --> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28300cff70 con 0x7f281406ace0 2023-07-07T18:15:11.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.210+0000 7f2821ffb700 1 -- 172.21.15.12:0/1721599096 <== mgr.4100 v2:172.21.15.160:6832/4080099133 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367349 (secure 0 0 0) 0x7f282c00bb70 con 0x7f281406ace0 2023-07-07T18:15:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:11.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f281406ace0 msgr2=0x7f281406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f281406ace0 0x7f281406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f282c009c40 tx=0x7f282c008030 comp rx=0 tx=0).stop 2023-07-07T18:15:11.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 msgr2=0x7f28301f2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 0x7f28301f2c70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f282400d800 tx=0x7f282400dbc0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 shutdown_connections 2023-07-07T18:15:11.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f281406ace0 0x7f281406d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2830160340 0x7f28300b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f283006ccc0 0x7f28300b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 --2- 172.21.15.12:0/1721599096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f283015c2e0 0x7f28301f2c70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 >> 172.21.15.12:0/1721599096 conn(0x7f283006e530 msgr2=0x7f283006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:11.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 shutdown_connections 2023-07-07T18:15:11.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.213+0000 7f28377ad700 1 -- 172.21.15.12:0/1721599096 wait complete. 2023-07-07T18:15:11.219 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-07-07T18:15:11.227 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-07T18:15:10.595847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219268,"kb_used_data":3652,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755452,"statfs":{"total":773094113280,"available":772869582848,"internally_reserved":0,"allocated":3739648,"data_stored":2208171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003811"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287995+0000","last_change":"2023-07-07T18:14:46.251969+0000","last_active":"2023-07-07T18:14:51.287995+0000","last_peered":"2023-07-07T18:14:51.287995+0000","last_clean":"2023-07-07T18:14:51.287995+0000","last_became_active":"2023-07-07T18:14:46.251645+0000","last_became_peered":"2023-07-07T18:14:46.251645+0000","last_unstale":"2023-07-07T18:14:51.287995+0000","last_undegraded":"2023-07-07T18:14:51.287995+0000","last_fullsized":"2023-07-07T18:14:51.287995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:09:35.223387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786630+0000","last_change":"2023-07-07T18:14:46.246398+0000","last_active":"2023-07-07T18:14:50.786630+0000","last_peered":"2023-07-07T18:14:50.786630+0000","last_clean":"2023-07-07T18:14:50.786630+0000","last_became_active":"2023-07-07T18:14:46.246114+0000","last_became_peered":"2023-07-07T18:14:46.246114+0000","last_unstale":"2023-07-07T18:14:50.786630+0000","last_undegraded":"2023-07-07T18:14:50.786630+0000","last_fullsized":"2023-07-07T18:14:50.786630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:10:28.413855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696469+0000","last_change":"2023-07-07T18:14:46.260795+0000","last_active":"2023-07-07T18:14:50.696469+0000","last_peered":"2023-07-07T18:14:50.696469+0000","last_clean":"2023-07-07T18:14:50.696469+0000","last_became_active":"2023-07-07T18:14:46.260094+0000","last_became_peered":"2023-07-07T18:14:46.260094+0000","last_unstale":"2023-07-07T18:14:50.696469+0000","last_undegraded":"2023-07-07T18:14:50.696469+0000","last_fullsized":"2023-07-07T18:14:50.696469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:50:11.200504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287193+0000","last_change":"2023-07-07T18:14:46.256379+0000","last_active":"2023-07-07T18:14:51.287193+0000","last_peered":"2023-07-07T18:14:51.287193+0000","last_clean":"2023-07-07T18:14:51.287193+0000","last_became_active":"2023-07-07T18:14:46.256093+0000","last_became_peered":"2023-07-07T18:14:46.256093+0000","last_unstale":"2023-07-07T18:14:51.287193+0000","last_undegraded":"2023-07-07T18:14:51.287193+0000","last_fullsized":"2023-07-07T18:14:51.287193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:45.897131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768761+0000","last_change":"2023-07-07T18:14:46.256853+0000","last_active":"2023-07-07T18:14:50.768761+0000","last_peered":"2023-07-07T18:14:50.768761+0000","last_clean":"2023-07-07T18:14:50.768761+0000","last_became_active":"2023-07-07T18:14:46.256595+0000","last_became_peered":"2023-07-07T18:14:46.256595+0000","last_unstale":"2023-07-07T18:14:50.768761+0000","last_undegraded":"2023-07-07T18:14:50.768761+0000","last_fullsized":"2023-07-07T18:14:50.768761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:15:05.887018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694486+0000","last_change":"2023-07-07T18:14:46.256691+0000","last_active":"2023-07-07T18:14:50.694486+0000","last_peered":"2023-07-07T18:14:50.694486+0000","last_clean":"2023-07-07T18:14:50.694486+0000","last_became_active":"2023-07-07T18:14:46.254378+0000","last_became_peered":"2023-07-07T18:14:46.254378+0000","last_unstale":"2023-07-07T18:14:50.694486+0000","last_undegraded":"2023-07-07T18:14:50.694486+0000","last_fullsized":"2023-07-07T18:14:50.694486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:51:05.609476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695840+0000","last_change":"2023-07-07T18:14:46.259522+0000","last_active":"2023-07-07T18:14:50.695840+0000","last_peered":"2023-07-07T18:14:50.695840+0000","last_clean":"2023-07-07T18:14:50.695840+0000","last_became_active":"2023-07-07T18:14:46.259213+0000","last_became_peered":"2023-07-07T18:14:46.259213+0000","last_unstale":"2023-07-07T18:14:50.695840+0000","last_undegraded":"2023-07-07T18:14:50.695840+0000","last_fullsized":"2023-07-07T18:14:50.695840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:41:52.866809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786149+0000","last_change":"2023-07-07T18:14:46.257573+0000","last_active":"2023-07-07T18:14:50.786149+0000","last_peered":"2023-07-07T18:14:50.786149+0000","last_clean":"2023-07-07T18:14:50.786149+0000","last_became_active":"2023-07-07T18:14:46.257234+0000","last_became_peered":"2023-07-07T18:14:46.257234+0000","last_unstale":"2023-07-07T18:14:50.786149+0000","last_undegraded":"2023-07-07T18:14:50.786149+0000","last_fullsized":"2023-07-07T18:14:50.786149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:17.978840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769023+0000","last_change":"2023-07-07T18:14:46.256934+0000","last_active":"2023-07-07T18:14:50.769023+0000","last_peered":"2023-07-07T18:14:50.769023+0000","last_clean":"2023-07-07T18:14:50.769023+0000","last_became_active":"2023-07-07T18:14:46.256669+0000","last_became_peered":"2023-07-07T18:14:46.256669+0000","last_unstale":"2023-07-07T18:14:50.769023+0000","last_undegraded":"2023-07-07T18:14:50.769023+0000","last_fullsized":"2023-07-07T18:14:50.769023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:27.744408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786945+0000","last_change":"2023-07-07T18:14:46.253312+0000","last_active":"2023-07-07T18:14:50.786945+0000","last_peered":"2023-07-07T18:14:50.786945+0000","last_clean":"2023-07-07T18:14:50.786945+0000","last_became_active":"2023-07-07T18:14:46.253067+0000","last_became_peered":"2023-07-07T18:14:46.253067+0000","last_unstale":"2023-07-07T18:14:50.786945+0000","last_undegraded":"2023-07-07T18:14:50.786945+0000","last_fullsized":"2023-07-07T18:14:50.786945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:15:55.654834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696368+0000","last_change":"2023-07-07T18:14:46.257215+0000","last_active":"2023-07-07T18:14:50.696368+0000","last_peered":"2023-07-07T18:14:50.696368+0000","last_clean":"2023-07-07T18:14:50.696368+0000","last_became_active":"2023-07-07T18:14:46.254498+0000","last_became_peered":"2023-07-07T18:14:46.254498+0000","last_unstale":"2023-07-07T18:14:50.696368+0000","last_undegraded":"2023-07-07T18:14:50.696368+0000","last_fullsized":"2023-07-07T18:14:50.696368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:44:17.278555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287726+0000","last_change":"2023-07-07T18:14:46.261297+0000","last_active":"2023-07-07T18:14:51.287726+0000","last_peered":"2023-07-07T18:14:51.287726+0000","last_clean":"2023-07-07T18:14:51.287726+0000","last_became_active":"2023-07-07T18:14:46.260968+0000","last_became_peered":"2023-07-07T18:14:46.260968+0000","last_unstale":"2023-07-07T18:14:51.287726+0000","last_undegraded":"2023-07-07T18:14:51.287726+0000","last_fullsized":"2023-07-07T18:14:51.287726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:27:53.328227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287686+0000","last_change":"2023-07-07T18:14:46.251381+0000","last_active":"2023-07-07T18:14:51.287686+0000","last_peered":"2023-07-07T18:14:51.287686+0000","last_clean":"2023-07-07T18:14:51.287686+0000","last_became_active":"2023-07-07T18:14:46.251132+0000","last_became_peered":"2023-07-07T18:14:46.251132+0000","last_unstale":"2023-07-07T18:14:51.287686+0000","last_undegraded":"2023-07-07T18:14:51.287686+0000","last_fullsized":"2023-07-07T18:14:51.287686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:36:06.840784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786267+0000","last_change":"2023-07-07T18:14:46.237529+0000","last_active":"2023-07-07T18:14:50.786267+0000","last_peered":"2023-07-07T18:14:50.786267+0000","last_clean":"2023-07-07T18:14:50.786267+0000","last_became_active":"2023-07-07T18:14:46.237227+0000","last_became_peered":"2023-07-07T18:14:46.237227+0000","last_unstale":"2023-07-07T18:14:50.786267+0000","last_undegraded":"2023-07-07T18:14:50.786267+0000","last_fullsized":"2023-07-07T18:14:50.786267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:30.201313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695700+0000","last_change":"2023-07-07T18:14:46.250166+0000","last_active":"2023-07-07T18:14:50.695700+0000","last_peered":"2023-07-07T18:14:50.695700+0000","last_clean":"2023-07-07T18:14:50.695700+0000","last_became_active":"2023-07-07T18:14:46.249865+0000","last_became_peered":"2023-07-07T18:14:46.249865+0000","last_unstale":"2023-07-07T18:14:50.695700+0000","last_undegraded":"2023-07-07T18:14:50.695700+0000","last_fullsized":"2023-07-07T18:14:50.695700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:03:21.014607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694727+0000","last_change":"2023-07-07T18:14:46.260407+0000","last_active":"2023-07-07T18:14:50.694727+0000","last_peered":"2023-07-07T18:14:50.694727+0000","last_clean":"2023-07-07T18:14:50.694727+0000","last_became_active":"2023-07-07T18:14:46.259937+0000","last_became_peered":"2023-07-07T18:14:46.259937+0000","last_unstale":"2023-07-07T18:14:50.694727+0000","last_undegraded":"2023-07-07T18:14:50.694727+0000","last_fullsized":"2023-07-07T18:14:50.694727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:56:49.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769064+0000","last_change":"2023-07-07T18:14:46.256893+0000","last_active":"2023-07-07T18:14:50.769064+0000","last_peered":"2023-07-07T18:14:50.769064+0000","last_clean":"2023-07-07T18:14:50.769064+0000","last_became_active":"2023-07-07T18:14:46.256622+0000","last_became_peered":"2023-07-07T18:14:46.256622+0000","last_unstale":"2023-07-07T18:14:50.769064+0000","last_undegraded":"2023-07-07T18:14:50.769064+0000","last_fullsized":"2023-07-07T18:14:50.769064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:35.628378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696247+0000","last_change":"2023-07-07T18:14:46.260376+0000","last_active":"2023-07-07T18:14:50.696247+0000","last_peered":"2023-07-07T18:14:50.696247+0000","last_clean":"2023-07-07T18:14:50.696247+0000","last_became_active":"2023-07-07T18:14:46.257010+0000","last_became_peered":"2023-07-07T18:14:46.257010+0000","last_unstale":"2023-07-07T18:14:50.696247+0000","last_undegraded":"2023-07-07T18:14:50.696247+0000","last_fullsized":"2023-07-07T18:14:50.696247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:39:01.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287639+0000","last_change":"2023-07-07T18:14:46.254186+0000","last_active":"2023-07-07T18:14:51.287639+0000","last_peered":"2023-07-07T18:14:51.287639+0000","last_clean":"2023-07-07T18:14:51.287639+0000","last_became_active":"2023-07-07T18:14:46.253897+0000","last_became_peered":"2023-07-07T18:14:46.253897+0000","last_unstale":"2023-07-07T18:14:51.287639+0000","last_undegraded":"2023-07-07T18:14:51.287639+0000","last_fullsized":"2023-07-07T18:14:51.287639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:47:31.616916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695873+0000","last_change":"2023-07-07T18:14:46.260027+0000","last_active":"2023-07-07T18:14:50.695873+0000","last_peered":"2023-07-07T18:14:50.695873+0000","last_clean":"2023-07-07T18:14:50.695873+0000","last_became_active":"2023-07-07T18:14:46.259740+0000","last_became_peered":"2023-07-07T18:14:46.259740+0000","last_unstale":"2023-07-07T18:14:50.695873+0000","last_undegraded":"2023-07-07T18:14:50.695873+0000","last_fullsized":"2023-07-07T18:14:50.695873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:11:34.268952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695458+0000","last_change":"2023-07-07T18:14:46.258673+0000","last_active":"2023-07-07T18:14:50.695458+0000","last_peered":"2023-07-07T18:14:50.695458+0000","last_clean":"2023-07-07T18:14:50.695458+0000","last_became_active":"2023-07-07T18:14:46.258410+0000","last_became_peered":"2023-07-07T18:14:46.258410+0000","last_unstale":"2023-07-07T18:14:50.695458+0000","last_undegraded":"2023-07-07T18:14:50.695458+0000","last_fullsized":"2023-07-07T18:14:50.695458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:36.856794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768546+0000","last_change":"2023-07-07T18:14:46.250342+0000","last_active":"2023-07-07T18:14:50.768546+0000","last_peered":"2023-07-07T18:14:50.768546+0000","last_clean":"2023-07-07T18:14:50.768546+0000","last_became_active":"2023-07-07T18:14:46.250051+0000","last_became_peered":"2023-07-07T18:14:46.250051+0000","last_unstale":"2023-07-07T18:14:50.768546+0000","last_undegraded":"2023-07-07T18:14:50.768546+0000","last_fullsized":"2023-07-07T18:14:50.768546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:05.786354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286813+0000","last_change":"2023-07-07T18:14:46.255595+0000","last_active":"2023-07-07T18:14:51.286813+0000","last_peered":"2023-07-07T18:14:51.286813+0000","last_clean":"2023-07-07T18:14:51.286813+0000","last_became_active":"2023-07-07T18:14:46.255308+0000","last_became_peered":"2023-07-07T18:14:46.255308+0000","last_unstale":"2023-07-07T18:14:51.286813+0000","last_undegraded":"2023-07-07T18:14:51.286813+0000","last_fullsized":"2023-07-07T18:14:51.286813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:22.768246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695160+0000","last_change":"2023-07-07T18:14:46.259159+0000","last_active":"2023-07-07T18:14:50.695160+0000","last_peered":"2023-07-07T18:14:50.695160+0000","last_clean":"2023-07-07T18:14:50.695160+0000","last_became_active":"2023-07-07T18:14:46.258888+0000","last_became_peered":"2023-07-07T18:14:46.258888+0000","last_unstale":"2023-07-07T18:14:50.695160+0000","last_undegraded":"2023-07-07T18:14:50.695160+0000","last_fullsized":"2023-07-07T18:14:50.695160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:04:20.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693827+0000","last_change":"2023-07-07T18:14:46.251261+0000","last_active":"2023-07-07T18:14:50.693827+0000","last_peered":"2023-07-07T18:14:50.693827+0000","last_clean":"2023-07-07T18:14:50.693827+0000","last_became_active":"2023-07-07T18:14:46.250985+0000","last_became_peered":"2023-07-07T18:14:46.250985+0000","last_unstale":"2023-07-07T18:14:50.693827+0000","last_undegraded":"2023-07-07T18:14:50.693827+0000","last_fullsized":"2023-07-07T18:14:50.693827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:27.744408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693850+0000","last_change":"2023-07-07T18:14:46.238108+0000","last_active":"2023-07-07T18:14:50.693850+0000","last_peered":"2023-07-07T18:14:50.693850+0000","last_clean":"2023-07-07T18:14:50.693850+0000","last_became_active":"2023-07-07T18:14:46.237731+0000","last_became_peered":"2023-07-07T18:14:46.237731+0000","last_unstale":"2023-07-07T18:14:50.693850+0000","last_undegraded":"2023-07-07T18:14:50.693850+0000","last_fullsized":"2023-07-07T18:14:50.693850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:56.152988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786655+0000","last_change":"2023-07-07T18:14:46.252496+0000","last_active":"2023-07-07T18:14:50.786655+0000","last_peered":"2023-07-07T18:14:50.786655+0000","last_clean":"2023-07-07T18:14:50.786655+0000","last_became_active":"2023-07-07T18:14:46.251903+0000","last_became_peered":"2023-07-07T18:14:46.251903+0000","last_unstale":"2023-07-07T18:14:50.786655+0000","last_undegraded":"2023-07-07T18:14:50.786655+0000","last_fullsized":"2023-07-07T18:14:50.786655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:50:58.513809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696161+0000","last_change":"2023-07-07T18:14:50.275663+0000","last_active":"2023-07-07T18:14:50.696161+0000","last_peered":"2023-07-07T18:14:50.696161+0000","last_clean":"2023-07-07T18:14:50.696161+0000","last_became_active":"2023-07-07T18:14:50.274814+0000","last_became_peered":"2023-07-07T18:14:50.274814+0000","last_unstale":"2023-07-07T18:14:50.696161+0000","last_undegraded":"2023-07-07T18:14:50.696161+0000","last_fullsized":"2023-07-07T18:14:50.696161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:57:09.270949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695701+0000","last_change":"2023-07-07T18:14:45.827301+0000","last_active":"2023-07-07T18:14:50.695701+0000","last_peered":"2023-07-07T18:14:50.695701+0000","last_clean":"2023-07-07T18:14:50.695701+0000","last_became_active":"2023-07-07T18:14:45.827011+0000","last_became_peered":"2023-07-07T18:14:45.827011+0000","last_unstale":"2023-07-07T18:14:50.695701+0000","last_undegraded":"2023-07-07T18:14:50.695701+0000","last_fullsized":"2023-07-07T18:14:50.695701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:39:36.675751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288069+0000","last_change":"2023-07-07T18:14:46.238475+0000","last_active":"2023-07-07T18:14:51.288069+0000","last_peered":"2023-07-07T18:14:51.288069+0000","last_clean":"2023-07-07T18:14:51.288069+0000","last_became_active":"2023-07-07T18:14:46.238195+0000","last_became_peered":"2023-07-07T18:14:46.238195+0000","last_unstale":"2023-07-07T18:14:51.288069+0000","last_undegraded":"2023-07-07T18:14:51.288069+0000","last_fullsized":"2023-07-07T18:14:51.288069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:25:55.917107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287704+0000","last_change":"2023-07-07T18:14:50.280065+0000","last_active":"2023-07-07T18:14:51.287704+0000","last_peered":"2023-07-07T18:14:51.287704+0000","last_clean":"2023-07-07T18:14:51.287704+0000","last_became_active":"2023-07-07T18:14:50.279693+0000","last_became_peered":"2023-07-07T18:14:50.279693+0000","last_unstale":"2023-07-07T18:14:51.287704+0000","last_undegraded":"2023-07-07T18:14:51.287704+0000","last_fullsized":"2023-07-07T18:14:51.287704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:50:58.472479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693103+0000","last_change":"2023-07-07T18:14:45.823969+0000","last_active":"2023-07-07T18:14:50.693103+0000","last_peered":"2023-07-07T18:14:50.693103+0000","last_clean":"2023-07-07T18:14:50.693103+0000","last_became_active":"2023-07-07T18:14:45.823633+0000","last_became_peered":"2023-07-07T18:14:45.823633+0000","last_unstale":"2023-07-07T18:14:50.693103+0000","last_undegraded":"2023-07-07T18:14:50.693103+0000","last_fullsized":"2023-07-07T18:14:50.693103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:33:57.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769007+0000","last_change":"2023-07-07T18:14:46.252472+0000","last_active":"2023-07-07T18:14:50.769007+0000","last_peered":"2023-07-07T18:14:50.769007+0000","last_clean":"2023-07-07T18:14:50.769007+0000","last_became_active":"2023-07-07T18:14:46.251913+0000","last_became_peered":"2023-07-07T18:14:46.251913+0000","last_unstale":"2023-07-07T18:14:50.769007+0000","last_undegraded":"2023-07-07T18:14:50.769007+0000","last_fullsized":"2023-07-07T18:14:50.769007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:35.950124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769225+0000","last_change":"2023-07-07T18:14:50.279703+0000","last_active":"2023-07-07T18:14:50.769225+0000","last_peered":"2023-07-07T18:14:50.769225+0000","last_clean":"2023-07-07T18:14:50.769225+0000","last_became_active":"2023-07-07T18:14:50.278724+0000","last_became_peered":"2023-07-07T18:14:50.278724+0000","last_unstale":"2023-07-07T18:14:50.769225+0000","last_undegraded":"2023-07-07T18:14:50.769225+0000","last_fullsized":"2023-07-07T18:14:50.769225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:49:51.568617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287384+0000","last_change":"2023-07-07T18:14:45.825144+0000","last_active":"2023-07-07T18:14:51.287384+0000","last_peered":"2023-07-07T18:14:51.287384+0000","last_clean":"2023-07-07T18:14:51.287384+0000","last_became_active":"2023-07-07T18:14:45.824734+0000","last_became_peered":"2023-07-07T18:14:45.824734+0000","last_unstale":"2023-07-07T18:14:51.287384+0000","last_undegraded":"2023-07-07T18:14:51.287384+0000","last_fullsized":"2023-07-07T18:14:51.287384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:05:04.291822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287718+0000","last_change":"2023-07-07T18:14:46.250855+0000","last_active":"2023-07-07T18:14:51.287718+0000","last_peered":"2023-07-07T18:14:51.287718+0000","last_clean":"2023-07-07T18:14:51.287718+0000","last_became_active":"2023-07-07T18:14:46.250523+0000","last_became_peered":"2023-07-07T18:14:46.250523+0000","last_unstale":"2023-07-07T18:14:51.287718+0000","last_undegraded":"2023-07-07T18:14:51.287718+0000","last_fullsized":"2023-07-07T18:14:51.287718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:13:53.124487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287116+0000","last_change":"2023-07-07T18:14:50.284048+0000","last_active":"2023-07-07T18:14:51.287116+0000","last_peered":"2023-07-07T18:14:51.287116+0000","last_clean":"2023-07-07T18:14:51.287116+0000","last_became_active":"2023-07-07T18:14:50.283525+0000","last_became_peered":"2023-07-07T18:14:50.283525+0000","last_unstale":"2023-07-07T18:14:51.287116+0000","last_undegraded":"2023-07-07T18:14:51.287116+0000","last_fullsized":"2023-07-07T18:14:51.287116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:56:26.834793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769206+0000","last_change":"2023-07-07T18:14:45.820272+0000","last_active":"2023-07-07T18:14:50.769206+0000","last_peered":"2023-07-07T18:14:50.769206+0000","last_clean":"2023-07-07T18:14:50.769206+0000","last_became_active":"2023-07-07T18:14:45.819791+0000","last_became_peered":"2023-07-07T18:14:45.819791+0000","last_unstale":"2023-07-07T18:14:50.769206+0000","last_undegraded":"2023-07-07T18:14:50.769206+0000","last_fullsized":"2023-07-07T18:14:50.769206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:25:18.468002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287255+0000","last_change":"2023-07-07T18:14:46.237273+0000","last_active":"2023-07-07T18:14:51.287255+0000","last_peered":"2023-07-07T18:14:51.287255+0000","last_clean":"2023-07-07T18:14:51.287255+0000","last_became_active":"2023-07-07T18:14:46.236974+0000","last_became_peered":"2023-07-07T18:14:46.236974+0000","last_unstale":"2023-07-07T18:14:51.287255+0000","last_undegraded":"2023-07-07T18:14:51.287255+0000","last_fullsized":"2023-07-07T18:14:51.287255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:54:31.016985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694188+0000","last_change":"2023-07-07T18:14:50.273820+0000","last_active":"2023-07-07T18:14:50.694188+0000","last_peered":"2023-07-07T18:14:50.694188+0000","last_clean":"2023-07-07T18:14:50.694188+0000","last_became_active":"2023-07-07T18:14:50.273435+0000","last_became_peered":"2023-07-07T18:14:50.273435+0000","last_unstale":"2023-07-07T18:14:50.694188+0000","last_undegraded":"2023-07-07T18:14:50.694188+0000","last_fullsized":"2023-07-07T18:14:50.694188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:24.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786841+0000","last_change":"2023-07-07T18:14:45.825130+0000","last_active":"2023-07-07T18:14:50.786841+0000","last_peered":"2023-07-07T18:14:50.786841+0000","last_clean":"2023-07-07T18:14:50.786841+0000","last_became_active":"2023-07-07T18:14:45.824837+0000","last_became_peered":"2023-07-07T18:14:45.824837+0000","last_unstale":"2023-07-07T18:14:50.786841+0000","last_undegraded":"2023-07-07T18:14:50.786841+0000","last_fullsized":"2023-07-07T18:14:50.786841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:14:32.249281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286957+0000","last_change":"2023-07-07T18:14:46.251224+0000","last_active":"2023-07-07T18:14:51.286957+0000","last_peered":"2023-07-07T18:14:51.286957+0000","last_clean":"2023-07-07T18:14:51.286957+0000","last_became_active":"2023-07-07T18:14:46.250930+0000","last_became_peered":"2023-07-07T18:14:46.250930+0000","last_unstale":"2023-07-07T18:14:51.286957+0000","last_undegraded":"2023-07-07T18:14:51.286957+0000","last_fullsized":"2023-07-07T18:14:51.286957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:04:20.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287030+0000","last_change":"2023-07-07T18:14:50.279519+0000","last_active":"2023-07-07T18:14:51.287030+0000","last_peered":"2023-07-07T18:14:51.287030+0000","last_clean":"2023-07-07T18:14:51.287030+0000","last_became_active":"2023-07-07T18:14:50.279123+0000","last_became_peered":"2023-07-07T18:14:50.279123+0000","last_unstale":"2023-07-07T18:14:51.287030+0000","last_undegraded":"2023-07-07T18:14:51.287030+0000","last_fullsized":"2023-07-07T18:14:51.287030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:06:52.179086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695194+0000","last_change":"2023-07-07T18:14:45.826154+0000","last_active":"2023-07-07T18:14:50.695194+0000","last_peered":"2023-07-07T18:14:50.695194+0000","last_clean":"2023-07-07T18:14:50.695194+0000","last_became_active":"2023-07-07T18:14:45.825811+0000","last_became_peered":"2023-07-07T18:14:45.825811+0000","last_unstale":"2023-07-07T18:14:50.695194+0000","last_undegraded":"2023-07-07T18:14:50.695194+0000","last_fullsized":"2023-07-07T18:14:50.695194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:06:47.726217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693492+0000","last_change":"2023-07-07T18:14:46.253842+0000","last_active":"2023-07-07T18:14:50.693492+0000","last_peered":"2023-07-07T18:14:50.693492+0000","last_clean":"2023-07-07T18:14:50.693492+0000","last_became_active":"2023-07-07T18:14:46.253610+0000","last_became_peered":"2023-07-07T18:14:46.253610+0000","last_unstale":"2023-07-07T18:14:50.693492+0000","last_undegraded":"2023-07-07T18:14:50.693492+0000","last_fullsized":"2023-07-07T18:14:50.693492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:46:48.904277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693169+0000","last_change":"2023-07-07T18:14:50.279382+0000","last_active":"2023-07-07T18:14:50.693169+0000","last_peered":"2023-07-07T18:14:50.693169+0000","last_clean":"2023-07-07T18:14:50.693169+0000","last_became_active":"2023-07-07T18:14:50.278873+0000","last_became_peered":"2023-07-07T18:14:50.278873+0000","last_unstale":"2023-07-07T18:14:50.693169+0000","last_undegraded":"2023-07-07T18:14:50.693169+0000","last_fullsized":"2023-07-07T18:14:50.693169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:02:54.121461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:55.778055+0000","last_change":"2023-07-07T18:14:45.823952+0000","last_active":"2023-07-07T18:14:55.778055+0000","last_peered":"2023-07-07T18:14:55.778055+0000","last_clean":"2023-07-07T18:14:55.778055+0000","last_became_active":"2023-07-07T18:14:45.823624+0000","last_became_peered":"2023-07-07T18:14:45.823624+0000","last_unstale":"2023-07-07T18:14:55.778055+0000","last_undegraded":"2023-07-07T18:14:55.778055+0000","last_fullsized":"2023-07-07T18:14:55.778055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:40:13.757713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695689+0000","last_change":"2023-07-07T18:14:46.253886+0000","last_active":"2023-07-07T18:14:50.695689+0000","last_peered":"2023-07-07T18:14:50.695689+0000","last_clean":"2023-07-07T18:14:50.695689+0000","last_became_active":"2023-07-07T18:14:46.253553+0000","last_became_peered":"2023-07-07T18:14:46.253553+0000","last_unstale":"2023-07-07T18:14:50.695689+0000","last_undegraded":"2023-07-07T18:14:50.695689+0000","last_fullsized":"2023-07-07T18:14:50.695689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:50:15.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786900+0000","last_change":"2023-07-07T18:14:50.281424+0000","last_active":"2023-07-07T18:14:50.786900+0000","last_peered":"2023-07-07T18:14:50.786900+0000","last_clean":"2023-07-07T18:14:50.786900+0000","last_became_active":"2023-07-07T18:14:50.281010+0000","last_became_peered":"2023-07-07T18:14:50.281010+0000","last_unstale":"2023-07-07T18:14:50.786900+0000","last_undegraded":"2023-07-07T18:14:50.786900+0000","last_fullsized":"2023-07-07T18:14:50.786900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:25:33.168587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695467+0000","last_change":"2023-07-07T18:14:45.830163+0000","last_active":"2023-07-07T18:14:50.695467+0000","last_peered":"2023-07-07T18:14:50.695467+0000","last_clean":"2023-07-07T18:14:50.695467+0000","last_became_active":"2023-07-07T18:14:45.829928+0000","last_became_peered":"2023-07-07T18:14:45.829928+0000","last_unstale":"2023-07-07T18:14:50.695467+0000","last_undegraded":"2023-07-07T18:14:50.695467+0000","last_fullsized":"2023-07-07T18:14:50.695467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:23:48.677042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287433+0000","last_change":"2023-07-07T18:14:46.238712+0000","last_active":"2023-07-07T18:14:51.287433+0000","last_peered":"2023-07-07T18:14:51.287433+0000","last_clean":"2023-07-07T18:14:51.287433+0000","last_became_active":"2023-07-07T18:14:46.238414+0000","last_became_peered":"2023-07-07T18:14:46.238414+0000","last_unstale":"2023-07-07T18:14:51.287433+0000","last_undegraded":"2023-07-07T18:14:51.287433+0000","last_fullsized":"2023-07-07T18:14:51.287433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:01:57.247568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287657+0000","last_change":"2023-07-07T18:14:50.283995+0000","last_active":"2023-07-07T18:14:51.287657+0000","last_peered":"2023-07-07T18:14:51.287657+0000","last_clean":"2023-07-07T18:14:51.287657+0000","last_became_active":"2023-07-07T18:14:50.280787+0000","last_became_peered":"2023-07-07T18:14:50.280787+0000","last_unstale":"2023-07-07T18:14:51.287657+0000","last_undegraded":"2023-07-07T18:14:51.287657+0000","last_fullsized":"2023-07-07T18:14:51.287657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:40.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768416+0000","last_change":"2023-07-07T18:14:45.818817+0000","last_active":"2023-07-07T18:14:50.768416+0000","last_peered":"2023-07-07T18:14:50.768416+0000","last_clean":"2023-07-07T18:14:50.768416+0000","last_became_active":"2023-07-07T18:14:45.817217+0000","last_became_peered":"2023-07-07T18:14:45.817217+0000","last_unstale":"2023-07-07T18:14:50.768416+0000","last_undegraded":"2023-07-07T18:14:50.768416+0000","last_fullsized":"2023-07-07T18:14:50.768416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:35.237658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786635+0000","last_change":"2023-07-07T18:14:46.252322+0000","last_active":"2023-07-07T18:14:50.786635+0000","last_peered":"2023-07-07T18:14:50.786635+0000","last_clean":"2023-07-07T18:14:50.786635+0000","last_became_active":"2023-07-07T18:14:46.251581+0000","last_became_peered":"2023-07-07T18:14:46.251581+0000","last_unstale":"2023-07-07T18:14:50.786635+0000","last_undegraded":"2023-07-07T18:14:50.786635+0000","last_fullsized":"2023-07-07T18:14:50.786635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:25:19.477377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288314+0000","last_change":"2023-07-07T18:14:50.279662+0000","last_active":"2023-07-07T18:14:51.288314+0000","last_peered":"2023-07-07T18:14:51.288314+0000","last_clean":"2023-07-07T18:14:51.288314+0000","last_became_active":"2023-07-07T18:14:50.279182+0000","last_became_peered":"2023-07-07T18:14:50.279182+0000","last_unstale":"2023-07-07T18:14:51.288314+0000","last_undegraded":"2023-07-07T18:14:51.288314+0000","last_fullsized":"2023-07-07T18:14:51.288314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:29.387286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695766+0000","last_change":"2023-07-07T18:14:45.828779+0000","last_active":"2023-07-07T18:14:50.695766+0000","last_peered":"2023-07-07T18:14:50.695766+0000","last_clean":"2023-07-07T18:14:50.695766+0000","last_became_active":"2023-07-07T18:14:45.828387+0000","last_became_peered":"2023-07-07T18:14:45.828387+0000","last_unstale":"2023-07-07T18:14:50.695766+0000","last_undegraded":"2023-07-07T18:14:50.695766+0000","last_fullsized":"2023-07-07T18:14:50.695766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:25:54.907733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769086+0000","last_change":"2023-07-07T18:14:46.258991+0000","last_active":"2023-07-07T18:14:50.769086+0000","last_peered":"2023-07-07T18:14:50.769086+0000","last_clean":"2023-07-07T18:14:50.769086+0000","last_became_active":"2023-07-07T18:14:46.258711+0000","last_became_peered":"2023-07-07T18:14:46.258711+0000","last_unstale":"2023-07-07T18:14:50.769086+0000","last_undegraded":"2023-07-07T18:14:50.769086+0000","last_fullsized":"2023-07-07T18:14:50.769086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:10.136646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786752+0000","last_change":"2023-07-07T18:14:50.275066+0000","last_active":"2023-07-07T18:14:50.786752+0000","last_peered":"2023-07-07T18:14:50.786752+0000","last_clean":"2023-07-07T18:14:50.786752+0000","last_became_active":"2023-07-07T18:14:50.274631+0000","last_became_peered":"2023-07-07T18:14:50.274631+0000","last_unstale":"2023-07-07T18:14:50.786752+0000","last_undegraded":"2023-07-07T18:14:50.786752+0000","last_fullsized":"2023-07-07T18:14:50.786752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:26:07.680601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287040+0000","last_change":"2023-07-07T18:14:45.819945+0000","last_active":"2023-07-07T18:14:51.287040+0000","last_peered":"2023-07-07T18:14:51.287040+0000","last_clean":"2023-07-07T18:14:51.287040+0000","last_became_active":"2023-07-07T18:14:45.819662+0000","last_became_peered":"2023-07-07T18:14:45.819662+0000","last_unstale":"2023-07-07T18:14:51.287040+0000","last_undegraded":"2023-07-07T18:14:51.287040+0000","last_fullsized":"2023-07-07T18:14:51.287040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:05:21.194016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288364+0000","last_change":"2023-07-07T18:14:46.253586+0000","last_active":"2023-07-07T18:14:51.288364+0000","last_peered":"2023-07-07T18:14:51.288364+0000","last_clean":"2023-07-07T18:14:51.288364+0000","last_became_active":"2023-07-07T18:14:46.250668+0000","last_became_peered":"2023-07-07T18:14:46.250668+0000","last_unstale":"2023-07-07T18:14:51.288364+0000","last_undegraded":"2023-07-07T18:14:51.288364+0000","last_fullsized":"2023-07-07T18:14:51.288364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:18:50.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695970+0000","last_change":"2023-07-07T18:14:50.278682+0000","last_active":"2023-07-07T18:14:50.695970+0000","last_peered":"2023-07-07T18:14:50.695970+0000","last_clean":"2023-07-07T18:14:50.695970+0000","last_became_active":"2023-07-07T18:14:50.278199+0000","last_became_peered":"2023-07-07T18:14:50.278199+0000","last_unstale":"2023-07-07T18:14:50.695970+0000","last_undegraded":"2023-07-07T18:14:50.695970+0000","last_fullsized":"2023-07-07T18:14:50.695970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:29.387286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695323+0000","last_change":"2023-07-07T18:14:45.828517+0000","last_active":"2023-07-07T18:14:50.695323+0000","last_peered":"2023-07-07T18:14:50.695323+0000","last_clean":"2023-07-07T18:14:50.695323+0000","last_became_active":"2023-07-07T18:14:45.828221+0000","last_became_peered":"2023-07-07T18:14:45.828221+0000","last_unstale":"2023-07-07T18:14:50.695323+0000","last_undegraded":"2023-07-07T18:14:50.695323+0000","last_fullsized":"2023-07-07T18:14:50.695323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:55.691985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786013+0000","last_change":"2023-07-07T18:14:46.243955+0000","last_active":"2023-07-07T18:14:50.786013+0000","last_peered":"2023-07-07T18:14:50.786013+0000","last_clean":"2023-07-07T18:14:50.786013+0000","last_became_active":"2023-07-07T18:14:46.243697+0000","last_became_peered":"2023-07-07T18:14:46.243697+0000","last_unstale":"2023-07-07T18:14:50.786013+0000","last_undegraded":"2023-07-07T18:14:50.786013+0000","last_fullsized":"2023-07-07T18:14:50.786013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286669+0000","last_change":"2023-07-07T18:14:50.283314+0000","last_active":"2023-07-07T18:14:51.286669+0000","last_peered":"2023-07-07T18:14:51.286669+0000","last_clean":"2023-07-07T18:14:51.286669+0000","last_became_active":"2023-07-07T18:14:50.282741+0000","last_became_peered":"2023-07-07T18:14:50.282741+0000","last_unstale":"2023-07-07T18:14:51.286669+0000","last_undegraded":"2023-07-07T18:14:51.286669+0000","last_fullsized":"2023-07-07T18:14:51.286669+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:24:24.468449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695371+0000","last_change":"2023-07-07T18:14:45.828552+0000","last_active":"2023-07-07T18:14:50.695371+0000","last_peered":"2023-07-07T18:14:50.695371+0000","last_clean":"2023-07-07T18:14:50.695371+0000","last_became_active":"2023-07-07T18:14:45.828251+0000","last_became_peered":"2023-07-07T18:14:45.828251+0000","last_unstale":"2023-07-07T18:14:50.695371+0000","last_undegraded":"2023-07-07T18:14:50.695371+0000","last_fullsized":"2023-07-07T18:14:50.695371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:05:04.291822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694453+0000","last_change":"2023-07-07T18:14:46.254474+0000","last_active":"2023-07-07T18:14:50.694453+0000","last_peered":"2023-07-07T18:14:50.694453+0000","last_clean":"2023-07-07T18:14:50.694453+0000","last_became_active":"2023-07-07T18:14:46.253792+0000","last_became_peered":"2023-07-07T18:14:46.253792+0000","last_unstale":"2023-07-07T18:14:50.694453+0000","last_undegraded":"2023-07-07T18:14:50.694453+0000","last_fullsized":"2023-07-07T18:14:50.694453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:32:22.705610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287527+0000","last_change":"2023-07-07T18:14:50.275935+0000","last_active":"2023-07-07T18:14:51.287527+0000","last_peered":"2023-07-07T18:14:51.287527+0000","last_clean":"2023-07-07T18:14:51.287527+0000","last_became_active":"2023-07-07T18:14:50.275504+0000","last_became_peered":"2023-07-07T18:14:50.275504+0000","last_unstale":"2023-07-07T18:14:51.287527+0000","last_undegraded":"2023-07-07T18:14:51.287527+0000","last_fullsized":"2023-07-07T18:14:51.287527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:46:53.498090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695560+0000","last_change":"2023-07-07T18:14:45.824161+0000","last_active":"2023-07-07T18:14:50.695560+0000","last_peered":"2023-07-07T18:14:50.695560+0000","last_clean":"2023-07-07T18:14:50.695560+0000","last_became_active":"2023-07-07T18:14:45.823845+0000","last_became_peered":"2023-07-07T18:14:45.823845+0000","last_unstale":"2023-07-07T18:14:50.695560+0000","last_undegraded":"2023-07-07T18:14:50.695560+0000","last_fullsized":"2023-07-07T18:14:50.695560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:01:56.238194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287041+0000","last_change":"2023-07-07T18:14:46.251483+0000","last_active":"2023-07-07T18:14:51.287041+0000","last_peered":"2023-07-07T18:14:51.287041+0000","last_clean":"2023-07-07T18:14:51.287041+0000","last_became_active":"2023-07-07T18:14:46.251186+0000","last_became_peered":"2023-07-07T18:14:46.251186+0000","last_unstale":"2023-07-07T18:14:51.287041+0000","last_undegraded":"2023-07-07T18:14:51.287041+0000","last_fullsized":"2023-07-07T18:14:51.287041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:49:31.365534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287561+0000","last_change":"2023-07-07T18:14:50.284553+0000","last_active":"2023-07-07T18:14:51.287561+0000","last_peered":"2023-07-07T18:14:51.287561+0000","last_clean":"2023-07-07T18:14:51.287561+0000","last_became_active":"2023-07-07T18:14:50.284133+0000","last_became_peered":"2023-07-07T18:14:50.284133+0000","last_unstale":"2023-07-07T18:14:51.287561+0000","last_undegraded":"2023-07-07T18:14:51.287561+0000","last_fullsized":"2023-07-07T18:14:51.287561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:32:21.452429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786401+0000","last_change":"2023-07-07T18:14:45.825329+0000","last_active":"2023-07-07T18:14:50.786401+0000","last_peered":"2023-07-07T18:14:50.786401+0000","last_clean":"2023-07-07T18:14:50.786401+0000","last_became_active":"2023-07-07T18:14:45.824977+0000","last_became_peered":"2023-07-07T18:14:45.824977+0000","last_unstale":"2023-07-07T18:14:50.786401+0000","last_undegraded":"2023-07-07T18:14:50.786401+0000","last_fullsized":"2023-07-07T18:14:50.786401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:26.735034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769180+0000","last_change":"2023-07-07T18:14:46.253430+0000","last_active":"2023-07-07T18:14:50.769180+0000","last_peered":"2023-07-07T18:14:50.769180+0000","last_clean":"2023-07-07T18:14:50.769180+0000","last_became_active":"2023-07-07T18:14:46.252998+0000","last_became_peered":"2023-07-07T18:14:46.252998+0000","last_unstale":"2023-07-07T18:14:50.769180+0000","last_undegraded":"2023-07-07T18:14:50.769180+0000","last_fullsized":"2023-07-07T18:14:50.769180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:10:28.413855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287751+0000","last_change":"2023-07-07T18:14:50.281644+0000","last_active":"2023-07-07T18:14:51.287751+0000","last_peered":"2023-07-07T18:14:51.287751+0000","last_clean":"2023-07-07T18:14:51.287751+0000","last_became_active":"2023-07-07T18:14:50.281288+0000","last_became_peered":"2023-07-07T18:14:50.281288+0000","last_unstale":"2023-07-07T18:14:51.287751+0000","last_undegraded":"2023-07-07T18:14:51.287751+0000","last_fullsized":"2023-07-07T18:14:51.287751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:05:38.716449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286765+0000","last_change":"2023-07-07T18:14:45.825137+0000","last_active":"2023-07-07T18:14:51.286765+0000","last_peered":"2023-07-07T18:14:51.286765+0000","last_clean":"2023-07-07T18:14:51.286765+0000","last_became_active":"2023-07-07T18:14:45.824813+0000","last_became_peered":"2023-07-07T18:14:45.824813+0000","last_unstale":"2023-07-07T18:14:51.286765+0000","last_undegraded":"2023-07-07T18:14:51.286765+0000","last_fullsized":"2023-07-07T18:14:51.286765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:39:11.889878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695709+0000","last_change":"2023-07-07T18:14:46.261872+0000","last_active":"2023-07-07T18:14:50.695709+0000","last_peered":"2023-07-07T18:14:50.695709+0000","last_clean":"2023-07-07T18:14:50.695709+0000","last_became_active":"2023-07-07T18:14:46.261503+0000","last_became_peered":"2023-07-07T18:14:46.261503+0000","last_unstale":"2023-07-07T18:14:50.695709+0000","last_undegraded":"2023-07-07T18:14:50.695709+0000","last_fullsized":"2023-07-07T18:14:50.695709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:28:13.350106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693444+0000","last_change":"2023-07-07T18:14:50.282090+0000","last_active":"2023-07-07T18:14:50.693444+0000","last_peered":"2023-07-07T18:14:50.693444+0000","last_clean":"2023-07-07T18:14:50.693444+0000","last_became_active":"2023-07-07T18:14:50.281530+0000","last_became_peered":"2023-07-07T18:14:50.281530+0000","last_unstale":"2023-07-07T18:14:50.693444+0000","last_undegraded":"2023-07-07T18:14:50.693444+0000","last_fullsized":"2023-07-07T18:14:50.693444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:39.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287090+0000","last_change":"2023-07-07T18:14:45.827877+0000","last_active":"2023-07-07T18:14:51.287090+0000","last_peered":"2023-07-07T18:14:51.287090+0000","last_clean":"2023-07-07T18:14:51.287090+0000","last_became_active":"2023-07-07T18:14:45.827533+0000","last_became_peered":"2023-07-07T18:14:45.827533+0000","last_unstale":"2023-07-07T18:14:51.287090+0000","last_undegraded":"2023-07-07T18:14:51.287090+0000","last_fullsized":"2023-07-07T18:14:51.287090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:32:52.527564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696156+0000","last_change":"2023-07-07T18:14:46.256950+0000","last_active":"2023-07-07T18:14:50.696156+0000","last_peered":"2023-07-07T18:14:50.696156+0000","last_clean":"2023-07-07T18:14:50.696156+0000","last_became_active":"2023-07-07T18:14:46.254597+0000","last_became_peered":"2023-07-07T18:14:46.254597+0000","last_unstale":"2023-07-07T18:14:50.696156+0000","last_undegraded":"2023-07-07T18:14:50.696156+0000","last_fullsized":"2023-07-07T18:14:50.696156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:51:19.489510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786947+0000","last_change":"2023-07-07T18:14:50.275061+0000","last_active":"2023-07-07T18:14:50.786947+0000","last_peered":"2023-07-07T18:14:50.786947+0000","last_clean":"2023-07-07T18:14:50.786947+0000","last_became_active":"2023-07-07T18:14:50.274636+0000","last_became_peered":"2023-07-07T18:14:50.274636+0000","last_unstale":"2023-07-07T18:14:50.786947+0000","last_undegraded":"2023-07-07T18:14:50.786947+0000","last_fullsized":"2023-07-07T18:14:50.786947+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:17:32.136223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694160+0000","last_change":"2023-07-07T18:14:45.816489+0000","last_active":"2023-07-07T18:14:50.694160+0000","last_peered":"2023-07-07T18:14:50.694160+0000","last_clean":"2023-07-07T18:14:50.694160+0000","last_became_active":"2023-07-07T18:14:45.816126+0000","last_became_peered":"2023-07-07T18:14:45.816126+0000","last_unstale":"2023-07-07T18:14:50.694160+0000","last_undegraded":"2023-07-07T18:14:50.694160+0000","last_fullsized":"2023-07-07T18:14:50.694160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:19:43.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696412+0000","last_change":"2023-07-07T18:14:46.260154+0000","last_active":"2023-07-07T18:14:50.696412+0000","last_peered":"2023-07-07T18:14:50.696412+0000","last_clean":"2023-07-07T18:14:50.696412+0000","last_became_active":"2023-07-07T18:14:46.254390+0000","last_became_peered":"2023-07-07T18:14:46.254390+0000","last_unstale":"2023-07-07T18:14:50.696412+0000","last_undegraded":"2023-07-07T18:14:50.696412+0000","last_fullsized":"2023-07-07T18:14:50.696412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:39:54.707650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696102+0000","last_change":"2023-07-07T18:14:50.275972+0000","last_active":"2023-07-07T18:14:50.696102+0000","last_peered":"2023-07-07T18:14:50.696102+0000","last_clean":"2023-07-07T18:14:50.696102+0000","last_became_active":"2023-07-07T18:14:50.275539+0000","last_became_peered":"2023-07-07T18:14:50.275539+0000","last_unstale":"2023-07-07T18:14:50.696102+0000","last_undegraded":"2023-07-07T18:14:50.696102+0000","last_fullsized":"2023-07-07T18:14:50.696102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:48:45.018589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287119+0000","last_change":"2023-07-07T18:14:45.825399+0000","last_active":"2023-07-07T18:14:51.287119+0000","last_peered":"2023-07-07T18:14:51.287119+0000","last_clean":"2023-07-07T18:14:51.287119+0000","last_became_active":"2023-07-07T18:14:45.825119+0000","last_became_peered":"2023-07-07T18:14:45.825119+0000","last_unstale":"2023-07-07T18:14:51.287119+0000","last_undegraded":"2023-07-07T18:14:51.287119+0000","last_fullsized":"2023-07-07T18:14:51.287119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:58:05.705920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693893+0000","last_change":"2023-07-07T18:14:46.240829+0000","last_active":"2023-07-07T18:14:50.693893+0000","last_peered":"2023-07-07T18:14:50.693893+0000","last_clean":"2023-07-07T18:14:50.693893+0000","last_became_active":"2023-07-07T18:14:46.239938+0000","last_became_peered":"2023-07-07T18:14:46.239938+0000","last_unstale":"2023-07-07T18:14:50.693893+0000","last_undegraded":"2023-07-07T18:14:50.693893+0000","last_fullsized":"2023-07-07T18:14:50.693893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:35.628378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768716+0000","last_change":"2023-07-07T18:14:50.274346+0000","last_active":"2023-07-07T18:14:50.768716+0000","last_peered":"2023-07-07T18:14:50.768716+0000","last_clean":"2023-07-07T18:14:50.768716+0000","last_became_active":"2023-07-07T18:14:50.271130+0000","last_became_peered":"2023-07-07T18:14:50.271130+0000","last_unstale":"2023-07-07T18:14:50.768716+0000","last_undegraded":"2023-07-07T18:14:50.768716+0000","last_fullsized":"2023-07-07T18:14:50.768716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:46:52.347771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693665+0000","last_change":"2023-07-07T18:14:41.010006+0000","last_active":"2023-07-07T18:14:50.693665+0000","last_peered":"2023-07-07T18:14:50.693665+0000","last_clean":"2023-07-07T18:14:50.693665+0000","last_became_active":"2023-07-07T18:14:41.009625+0000","last_became_peered":"2023-07-07T18:14:41.009625+0000","last_unstale":"2023-07-07T18:14:50.693665+0000","last_undegraded":"2023-07-07T18:14:50.693665+0000","last_fullsized":"2023-07-07T18:14:50.693665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:11.821985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786501+0000","last_change":"2023-07-07T18:14:45.825558+0000","last_active":"2023-07-07T18:14:50.786501+0000","last_peered":"2023-07-07T18:14:50.786501+0000","last_clean":"2023-07-07T18:14:50.786501+0000","last_became_active":"2023-07-07T18:14:45.824990+0000","last_became_peered":"2023-07-07T18:14:45.824990+0000","last_unstale":"2023-07-07T18:14:50.786501+0000","last_undegraded":"2023-07-07T18:14:50.786501+0000","last_fullsized":"2023-07-07T18:14:50.786501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:49:47.115748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693078+0000","last_change":"2023-07-07T18:14:46.236943+0000","last_active":"2023-07-07T18:14:50.693078+0000","last_peered":"2023-07-07T18:14:50.693078+0000","last_clean":"2023-07-07T18:14:50.693078+0000","last_became_active":"2023-07-07T18:14:46.236679+0000","last_became_peered":"2023-07-07T18:14:46.236679+0000","last_unstale":"2023-07-07T18:14:50.693078+0000","last_undegraded":"2023-07-07T18:14:50.693078+0000","last_fullsized":"2023-07-07T18:14:50.693078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:32:08.214196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768915+0000","last_change":"2023-07-07T18:14:50.274560+0000","last_active":"2023-07-07T18:14:50.768915+0000","last_peered":"2023-07-07T18:14:50.768915+0000","last_clean":"2023-07-07T18:14:50.768915+0000","last_became_active":"2023-07-07T18:14:50.273900+0000","last_became_peered":"2023-07-07T18:14:50.273900+0000","last_unstale":"2023-07-07T18:14:50.768915+0000","last_undegraded":"2023-07-07T18:14:50.768915+0000","last_fullsized":"2023-07-07T18:14:50.768915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:21.422334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786290+0000","last_change":"2023-07-07T18:14:40.652460+0000","last_active":"2023-07-07T18:14:50.786290+0000","last_peered":"2023-07-07T18:14:50.786290+0000","last_clean":"2023-07-07T18:14:50.786290+0000","last_became_active":"2023-07-07T18:14:40.652046+0000","last_became_peered":"2023-07-07T18:14:40.652046+0000","last_unstale":"2023-07-07T18:14:50.786290+0000","last_undegraded":"2023-07-07T18:14:50.786290+0000","last_fullsized":"2023-07-07T18:14:50.786290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:29.793269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694562+0000","last_change":"2023-07-07T18:14:45.827286+0000","last_active":"2023-07-07T18:14:50.694562+0000","last_peered":"2023-07-07T18:14:50.694562+0000","last_clean":"2023-07-07T18:14:50.694562+0000","last_became_active":"2023-07-07T18:14:45.826913+0000","last_became_peered":"2023-07-07T18:14:45.826913+0000","last_unstale":"2023-07-07T18:14:50.694562+0000","last_undegraded":"2023-07-07T18:14:50.694562+0000","last_fullsized":"2023-07-07T18:14:50.694562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:36:09.401587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693546+0000","last_change":"2023-07-07T18:14:46.239120+0000","last_active":"2023-07-07T18:14:50.693546+0000","last_peered":"2023-07-07T18:14:50.693546+0000","last_clean":"2023-07-07T18:14:50.693546+0000","last_became_active":"2023-07-07T18:14:46.238876+0000","last_became_peered":"2023-07-07T18:14:46.238876+0000","last_unstale":"2023-07-07T18:14:50.693546+0000","last_undegraded":"2023-07-07T18:14:50.693546+0000","last_fullsized":"2023-07-07T18:14:50.693546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287928+0000","last_change":"2023-07-07T18:14:50.282994+0000","last_active":"2023-07-07T18:14:51.287928+0000","last_peered":"2023-07-07T18:14:51.287928+0000","last_clean":"2023-07-07T18:14:51.287928+0000","last_became_active":"2023-07-07T18:14:50.282569+0000","last_became_peered":"2023-07-07T18:14:50.282569+0000","last_unstale":"2023-07-07T18:14:51.287928+0000","last_undegraded":"2023-07-07T18:14:51.287928+0000","last_fullsized":"2023-07-07T18:14:51.287928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:00:27.527355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287831+0000","last_change":"2023-07-07T18:14:41.009938+0000","last_active":"2023-07-07T18:14:51.287831+0000","last_peered":"2023-07-07T18:14:51.287831+0000","last_clean":"2023-07-07T18:14:51.287831+0000","last_became_active":"2023-07-07T18:14:41.009637+0000","last_became_peered":"2023-07-07T18:14:41.009637+0000","last_unstale":"2023-07-07T18:14:51.287831+0000","last_undegraded":"2023-07-07T18:14:51.287831+0000","last_fullsized":"2023-07-07T18:14:51.287831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:47:01.369288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693129+0000","last_change":"2023-07-07T18:14:45.813731+0000","last_active":"2023-07-07T18:14:50.693129+0000","last_peered":"2023-07-07T18:14:50.693129+0000","last_clean":"2023-07-07T18:14:50.693129+0000","last_became_active":"2023-07-07T18:14:45.813444+0000","last_became_peered":"2023-07-07T18:14:45.813444+0000","last_unstale":"2023-07-07T18:14:50.693129+0000","last_undegraded":"2023-07-07T18:14:50.693129+0000","last_fullsized":"2023-07-07T18:14:50.693129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:04.776980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693755+0000","last_change":"2023-07-07T18:14:46.238296+0000","last_active":"2023-07-07T18:14:50.693755+0000","last_peered":"2023-07-07T18:14:50.693755+0000","last_clean":"2023-07-07T18:14:50.693755+0000","last_became_active":"2023-07-07T18:14:46.237650+0000","last_became_peered":"2023-07-07T18:14:46.237650+0000","last_unstale":"2023-07-07T18:14:50.693755+0000","last_undegraded":"2023-07-07T18:14:50.693755+0000","last_fullsized":"2023-07-07T18:14:50.693755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:35.950124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695160+0000","last_change":"2023-07-07T18:14:50.276840+0000","last_active":"2023-07-07T18:14:50.695160+0000","last_peered":"2023-07-07T18:14:50.695160+0000","last_clean":"2023-07-07T18:14:50.695160+0000","last_became_active":"2023-07-07T18:14:50.276444+0000","last_became_peered":"2023-07-07T18:14:50.276444+0000","last_unstale":"2023-07-07T18:14:50.695160+0000","last_undegraded":"2023-07-07T18:14:50.695160+0000","last_fullsized":"2023-07-07T18:14:50.695160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:26:07.867774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786425+0000","last_change":"2023-07-07T18:14:40.652887+0000","last_active":"2023-07-07T18:14:50.786425+0000","last_peered":"2023-07-07T18:14:50.786425+0000","last_clean":"2023-07-07T18:14:50.786425+0000","last_became_active":"2023-07-07T18:14:40.652550+0000","last_became_peered":"2023-07-07T18:14:40.652550+0000","last_unstale":"2023-07-07T18:14:50.786425+0000","last_undegraded":"2023-07-07T18:14:50.786425+0000","last_fullsized":"2023-07-07T18:14:50.786425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:29.471523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694978+0000","last_change":"2023-07-07T18:14:34.464008+0000","last_active":"2023-07-07T18:14:50.694978+0000","last_peered":"2023-07-07T18:14:50.694978+0000","last_clean":"2023-07-07T18:14:50.694978+0000","last_became_active":"2023-07-07T18:14:34.463018+0000","last_became_peered":"2023-07-07T18:14:34.463018+0000","last_unstale":"2023-07-07T18:14:50.694978+0000","last_undegraded":"2023-07-07T18:14:50.694978+0000","last_fullsized":"2023-07-07T18:14:50.694978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_clean_scrub_stamp":"2023-07-07T18:14:33.057285+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:10.029083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287082+0000","last_change":"2023-07-07T18:14:45.825928+0000","last_active":"2023-07-07T18:14:51.287082+0000","last_peered":"2023-07-07T18:14:51.287082+0000","last_clean":"2023-07-07T18:14:51.287082+0000","last_became_active":"2023-07-07T18:14:45.825599+0000","last_became_peered":"2023-07-07T18:14:45.825599+0000","last_unstale":"2023-07-07T18:14:51.287082+0000","last_undegraded":"2023-07-07T18:14:51.287082+0000","last_fullsized":"2023-07-07T18:14:51.287082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:04:44.156178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287267+0000","last_change":"2023-07-07T18:14:46.262476+0000","last_active":"2023-07-07T18:14:51.287267+0000","last_peered":"2023-07-07T18:14:51.287267+0000","last_clean":"2023-07-07T18:14:51.287267+0000","last_became_active":"2023-07-07T18:14:46.262165+0000","last_became_peered":"2023-07-07T18:14:46.262165+0000","last_unstale":"2023-07-07T18:14:51.287267+0000","last_undegraded":"2023-07-07T18:14:51.287267+0000","last_fullsized":"2023-07-07T18:14:51.287267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:21:36.267002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786724+0000","last_change":"2023-07-07T18:14:50.282211+0000","last_active":"2023-07-07T18:14:50.786724+0000","last_peered":"2023-07-07T18:14:50.786724+0000","last_clean":"2023-07-07T18:14:50.786724+0000","last_became_active":"2023-07-07T18:14:50.281448+0000","last_became_peered":"2023-07-07T18:14:50.281448+0000","last_unstale":"2023-07-07T18:14:50.786724+0000","last_undegraded":"2023-07-07T18:14:50.786724+0000","last_fullsized":"2023-07-07T18:14:50.786724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:17:53.884605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695381+0000","last_change":"2023-07-07T18:14:40.649525+0000","last_active":"2023-07-07T18:14:50.695381+0000","last_peered":"2023-07-07T18:14:50.695381+0000","last_clean":"2023-07-07T18:14:50.695381+0000","last_became_active":"2023-07-07T18:14:40.649168+0000","last_became_peered":"2023-07-07T18:14:40.649168+0000","last_unstale":"2023-07-07T18:14:50.695381+0000","last_undegraded":"2023-07-07T18:14:50.695381+0000","last_fullsized":"2023-07-07T18:14:50.695381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:04:39.008697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768373+0000","last_change":"2023-07-07T18:14:45.825496+0000","last_active":"2023-07-07T18:14:50.768373+0000","last_peered":"2023-07-07T18:14:50.768373+0000","last_clean":"2023-07-07T18:14:50.768373+0000","last_became_active":"2023-07-07T18:14:45.825173+0000","last_became_peered":"2023-07-07T18:14:45.825173+0000","last_unstale":"2023-07-07T18:14:50.768373+0000","last_undegraded":"2023-07-07T18:14:50.768373+0000","last_fullsized":"2023-07-07T18:14:50.768373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:32:07.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768857+0000","last_change":"2023-07-07T18:14:46.252633+0000","last_active":"2023-07-07T18:14:50.768857+0000","last_peered":"2023-07-07T18:14:50.768857+0000","last_clean":"2023-07-07T18:14:50.768857+0000","last_became_active":"2023-07-07T18:14:46.252199+0000","last_became_peered":"2023-07-07T18:14:46.252199+0000","last_unstale":"2023-07-07T18:14:50.768857+0000","last_undegraded":"2023-07-07T18:14:50.768857+0000","last_fullsized":"2023-07-07T18:14:50.768857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287489+0000","last_change":"2023-07-07T18:14:50.276895+0000","last_active":"2023-07-07T18:14:51.287489+0000","last_peered":"2023-07-07T18:14:51.287489+0000","last_clean":"2023-07-07T18:14:51.287489+0000","last_became_active":"2023-07-07T18:14:50.276507+0000","last_became_peered":"2023-07-07T18:14:50.276507+0000","last_unstale":"2023-07-07T18:14:51.287489+0000","last_undegraded":"2023-07-07T18:14:51.287489+0000","last_fullsized":"2023-07-07T18:14:51.287489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:34:18.314525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695369+0000","last_change":"2023-07-07T18:14:41.009946+0000","last_active":"2023-07-07T18:14:50.695369+0000","last_peered":"2023-07-07T18:14:50.695369+0000","last_clean":"2023-07-07T18:14:50.695369+0000","last_became_active":"2023-07-07T18:14:41.009627+0000","last_became_peered":"2023-07-07T18:14:41.009627+0000","last_unstale":"2023-07-07T18:14:50.695369+0000","last_undegraded":"2023-07-07T18:14:50.695369+0000","last_fullsized":"2023-07-07T18:14:50.695369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:58:00.558439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693986+0000","last_change":"2023-07-07T18:14:45.814432+0000","last_active":"2023-07-07T18:14:50.693986+0000","last_peered":"2023-07-07T18:14:50.693986+0000","last_clean":"2023-07-07T18:14:50.693986+0000","last_became_active":"2023-07-07T18:14:45.814128+0000","last_became_peered":"2023-07-07T18:14:45.814128+0000","last_unstale":"2023-07-07T18:14:50.693986+0000","last_undegraded":"2023-07-07T18:14:50.693986+0000","last_fullsized":"2023-07-07T18:14:50.693986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:09.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769002+0000","last_change":"2023-07-07T18:14:46.253259+0000","last_active":"2023-07-07T18:14:50.769002+0000","last_peered":"2023-07-07T18:14:50.769002+0000","last_clean":"2023-07-07T18:14:50.769002+0000","last_became_active":"2023-07-07T18:14:46.252670+0000","last_became_peered":"2023-07-07T18:14:46.252670+0000","last_unstale":"2023-07-07T18:14:50.769002+0000","last_undegraded":"2023-07-07T18:14:50.769002+0000","last_fullsized":"2023-07-07T18:14:50.769002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:56.152988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695641+0000","last_change":"2023-07-07T18:14:50.279532+0000","last_active":"2023-07-07T18:14:50.695641+0000","last_peered":"2023-07-07T18:14:50.695641+0000","last_clean":"2023-07-07T18:14:50.695641+0000","last_became_active":"2023-07-07T18:14:50.279056+0000","last_became_peered":"2023-07-07T18:14:50.279056+0000","last_unstale":"2023-07-07T18:14:50.695641+0000","last_undegraded":"2023-07-07T18:14:50.695641+0000","last_fullsized":"2023-07-07T18:14:50.695641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:08:30.223728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288438+0000","last_change":"2023-07-07T18:14:45.825994+0000","last_active":"2023-07-07T18:14:51.288438+0000","last_peered":"2023-07-07T18:14:51.288438+0000","last_clean":"2023-07-07T18:14:51.288438+0000","last_became_active":"2023-07-07T18:14:45.825663+0000","last_became_peered":"2023-07-07T18:14:45.825663+0000","last_unstale":"2023-07-07T18:14:51.288438+0000","last_undegraded":"2023-07-07T18:14:51.288438+0000","last_fullsized":"2023-07-07T18:14:51.288438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:39:19.689182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693519+0000","last_change":"2023-07-07T18:14:40.651911+0000","last_active":"2023-07-07T18:14:50.693519+0000","last_peered":"2023-07-07T18:14:50.693519+0000","last_clean":"2023-07-07T18:14:50.693519+0000","last_became_active":"2023-07-07T18:14:40.651592+0000","last_became_peered":"2023-07-07T18:14:40.651592+0000","last_unstale":"2023-07-07T18:14:50.693519+0000","last_undegraded":"2023-07-07T18:14:50.693519+0000","last_fullsized":"2023-07-07T18:14:50.693519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:14:59.730163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286989+0000","last_change":"2023-07-07T18:14:46.251841+0000","last_active":"2023-07-07T18:14:51.286989+0000","last_peered":"2023-07-07T18:14:51.286989+0000","last_clean":"2023-07-07T18:14:51.286989+0000","last_became_active":"2023-07-07T18:14:46.251574+0000","last_became_peered":"2023-07-07T18:14:46.251574+0000","last_unstale":"2023-07-07T18:14:51.286989+0000","last_undegraded":"2023-07-07T18:14:51.286989+0000","last_fullsized":"2023-07-07T18:14:51.286989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:56.701359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286832+0000","last_change":"2023-07-07T18:14:50.280371+0000","last_active":"2023-07-07T18:14:51.286832+0000","last_peered":"2023-07-07T18:14:51.286832+0000","last_clean":"2023-07-07T18:14:51.286832+0000","last_became_active":"2023-07-07T18:14:50.279833+0000","last_became_peered":"2023-07-07T18:14:50.279833+0000","last_unstale":"2023-07-07T18:14:51.286832+0000","last_undegraded":"2023-07-07T18:14:51.286832+0000","last_fullsized":"2023-07-07T18:14:51.286832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:24.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287631+0000","last_change":"2023-07-07T18:14:40.653854+0000","last_active":"2023-07-07T18:14:51.287631+0000","last_peered":"2023-07-07T18:14:51.287631+0000","last_clean":"2023-07-07T18:14:51.287631+0000","last_became_active":"2023-07-07T18:14:40.653556+0000","last_became_peered":"2023-07-07T18:14:40.653556+0000","last_unstale":"2023-07-07T18:14:51.287631+0000","last_undegraded":"2023-07-07T18:14:51.287631+0000","last_fullsized":"2023-07-07T18:14:51.287631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:49:03.953888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:15:00.768001+0000","last_change":"2023-07-07T18:14:45.813532+0000","last_active":"2023-07-07T18:15:00.768001+0000","last_peered":"2023-07-07T18:15:00.768001+0000","last_clean":"2023-07-07T18:15:00.768001+0000","last_became_active":"2023-07-07T18:14:45.813237+0000","last_became_peered":"2023-07-07T18:14:45.813237+0000","last_unstale":"2023-07-07T18:15:00.768001+0000","last_undegraded":"2023-07-07T18:15:00.768001+0000","last_fullsized":"2023-07-07T18:15:00.768001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:29.191939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694299+0000","last_change":"2023-07-07T18:14:46.256921+0000","last_active":"2023-07-07T18:14:50.694299+0000","last_peered":"2023-07-07T18:14:50.694299+0000","last_clean":"2023-07-07T18:14:50.694299+0000","last_became_active":"2023-07-07T18:14:46.255057+0000","last_became_peered":"2023-07-07T18:14:46.255057+0000","last_unstale":"2023-07-07T18:14:50.694299+0000","last_undegraded":"2023-07-07T18:14:50.694299+0000","last_fullsized":"2023-07-07T18:14:50.694299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:01:33.602440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693740+0000","last_change":"2023-07-07T18:14:50.281352+0000","last_active":"2023-07-07T18:14:50.693740+0000","last_peered":"2023-07-07T18:14:50.693740+0000","last_clean":"2023-07-07T18:14:50.693740+0000","last_became_active":"2023-07-07T18:14:50.280740+0000","last_became_peered":"2023-07-07T18:14:50.280740+0000","last_unstale":"2023-07-07T18:14:50.693740+0000","last_undegraded":"2023-07-07T18:14:50.693740+0000","last_fullsized":"2023-07-07T18:14:50.693740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:33.644807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768930+0000","last_change":"2023-07-07T18:14:45.828162+0000","last_active":"2023-07-07T18:14:50.768930+0000","last_peered":"2023-07-07T18:14:50.768930+0000","last_clean":"2023-07-07T18:14:50.768930+0000","last_became_active":"2023-07-07T18:14:45.827811+0000","last_became_peered":"2023-07-07T18:14:45.827811+0000","last_unstale":"2023-07-07T18:14:50.768930+0000","last_undegraded":"2023-07-07T18:14:50.768930+0000","last_fullsized":"2023-07-07T18:14:50.768930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:24.297526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287464+0000","last_change":"2023-07-07T18:14:46.246578+0000","last_active":"2023-07-07T18:14:51.287464+0000","last_peered":"2023-07-07T18:14:51.287464+0000","last_clean":"2023-07-07T18:14:51.287464+0000","last_became_active":"2023-07-07T18:14:46.246295+0000","last_became_peered":"2023-07-07T18:14:46.246295+0000","last_unstale":"2023-07-07T18:14:51.287464+0000","last_undegraded":"2023-07-07T18:14:51.287464+0000","last_fullsized":"2023-07-07T18:14:51.287464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:48:00.728010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695529+0000","last_change":"2023-07-07T18:14:50.272282+0000","last_active":"2023-07-07T18:14:50.695529+0000","last_peered":"2023-07-07T18:14:50.695529+0000","last_clean":"2023-07-07T18:14:50.695529+0000","last_became_active":"2023-07-07T18:14:50.271865+0000","last_became_peered":"2023-07-07T18:14:50.271865+0000","last_unstale":"2023-07-07T18:14:50.695529+0000","last_undegraded":"2023-07-07T18:14:50.695529+0000","last_fullsized":"2023-07-07T18:14:50.695529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:54:34.460479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786378+0000","last_change":"2023-07-07T18:14:45.827922+0000","last_active":"2023-07-07T18:14:50.786378+0000","last_peered":"2023-07-07T18:14:50.786378+0000","last_clean":"2023-07-07T18:14:50.786378+0000","last_became_active":"2023-07-07T18:14:45.827638+0000","last_became_peered":"2023-07-07T18:14:45.827638+0000","last_unstale":"2023-07-07T18:14:50.786378+0000","last_undegraded":"2023-07-07T18:14:50.786378+0000","last_fullsized":"2023-07-07T18:14:50.786378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:24.297526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694444+0000","last_change":"2023-07-07T18:14:46.261660+0000","last_active":"2023-07-07T18:14:50.694444+0000","last_peered":"2023-07-07T18:14:50.694444+0000","last_clean":"2023-07-07T18:14:50.694444+0000","last_became_active":"2023-07-07T18:14:46.260861+0000","last_became_peered":"2023-07-07T18:14:46.260861+0000","last_unstale":"2023-07-07T18:14:50.694444+0000","last_undegraded":"2023-07-07T18:14:50.694444+0000","last_fullsized":"2023-07-07T18:14:50.694444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:47:43.651762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786504+0000","last_change":"2023-07-07T18:14:50.281633+0000","last_active":"2023-07-07T18:14:50.786504+0000","last_peered":"2023-07-07T18:14:50.786504+0000","last_clean":"2023-07-07T18:14:50.786504+0000","last_became_active":"2023-07-07T18:14:50.280606+0000","last_became_peered":"2023-07-07T18:14:50.280606+0000","last_unstale":"2023-07-07T18:14:50.786504+0000","last_undegraded":"2023-07-07T18:14:50.786504+0000","last_fullsized":"2023-07-07T18:14:50.786504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:59.596483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786476+0000","last_change":"2023-07-07T18:14:45.828754+0000","last_active":"2023-07-07T18:14:50.786476+0000","last_peered":"2023-07-07T18:14:50.786476+0000","last_clean":"2023-07-07T18:14:50.786476+0000","last_became_active":"2023-07-07T18:14:45.828425+0000","last_became_peered":"2023-07-07T18:14:45.828425+0000","last_unstale":"2023-07-07T18:14:50.786476+0000","last_undegraded":"2023-07-07T18:14:50.786476+0000","last_fullsized":"2023-07-07T18:14:50.786476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:09.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694287+0000","last_change":"2023-07-07T18:14:46.261672+0000","last_active":"2023-07-07T18:14:50.694287+0000","last_peered":"2023-07-07T18:14:50.694287+0000","last_clean":"2023-07-07T18:14:50.694287+0000","last_became_active":"2023-07-07T18:14:46.260782+0000","last_became_peered":"2023-07-07T18:14:46.260782+0000","last_unstale":"2023-07-07T18:14:50.694287+0000","last_undegraded":"2023-07-07T18:14:50.694287+0000","last_fullsized":"2023-07-07T18:14:50.694287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:51:02.683189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694186+0000","last_change":"2023-07-07T18:14:50.280851+0000","last_active":"2023-07-07T18:14:50.694186+0000","last_peered":"2023-07-07T18:14:50.694186+0000","last_clean":"2023-07-07T18:14:50.694186+0000","last_became_active":"2023-07-07T18:14:50.280316+0000","last_became_peered":"2023-07-07T18:14:50.280316+0000","last_unstale":"2023-07-07T18:14:50.694186+0000","last_undegraded":"2023-07-07T18:14:50.694186+0000","last_fullsized":"2023-07-07T18:14:50.694186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:28:18.418331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288205+0000","last_change":"2023-07-07T18:14:45.827930+0000","last_active":"2023-07-07T18:14:51.288205+0000","last_peered":"2023-07-07T18:14:51.288205+0000","last_clean":"2023-07-07T18:14:51.288205+0000","last_became_active":"2023-07-07T18:14:45.827650+0000","last_became_peered":"2023-07-07T18:14:45.827650+0000","last_unstale":"2023-07-07T18:14:51.288205+0000","last_undegraded":"2023-07-07T18:14:51.288205+0000","last_fullsized":"2023-07-07T18:14:51.288205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:41:51.857434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287208+0000","last_change":"2023-07-07T18:14:46.238211+0000","last_active":"2023-07-07T18:14:51.287208+0000","last_peered":"2023-07-07T18:14:51.287208+0000","last_clean":"2023-07-07T18:14:51.287208+0000","last_became_active":"2023-07-07T18:14:46.237822+0000","last_became_peered":"2023-07-07T18:14:46.237822+0000","last_unstale":"2023-07-07T18:14:51.287208+0000","last_undegraded":"2023-07-07T18:14:51.287208+0000","last_fullsized":"2023-07-07T18:14:51.287208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:23:49.686417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693146+0000","last_change":"2023-07-07T18:14:50.279713+0000","last_active":"2023-07-07T18:14:50.693146+0000","last_peered":"2023-07-07T18:14:50.693146+0000","last_clean":"2023-07-07T18:14:50.693146+0000","last_became_active":"2023-07-07T18:14:50.278898+0000","last_became_peered":"2023-07-07T18:14:50.278898+0000","last_unstale":"2023-07-07T18:14:50.693146+0000","last_undegraded":"2023-07-07T18:14:50.693146+0000","last_fullsized":"2023-07-07T18:14:50.693146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:41:35.250768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769299+0000","last_change":"2023-07-07T18:14:45.820079+0000","last_active":"2023-07-07T18:14:50.769299+0000","last_peered":"2023-07-07T18:14:50.769299+0000","last_clean":"2023-07-07T18:14:50.769299+0000","last_became_active":"2023-07-07T18:14:45.819405+0000","last_became_peered":"2023-07-07T18:14:45.819405+0000","last_unstale":"2023-07-07T18:14:50.769299+0000","last_undegraded":"2023-07-07T18:14:50.769299+0000","last_fullsized":"2023-07-07T18:14:50.769299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:50:57.504435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695320+0000","last_change":"2023-07-07T18:14:46.256641+0000","last_active":"2023-07-07T18:14:50.695320+0000","last_peered":"2023-07-07T18:14:50.695320+0000","last_clean":"2023-07-07T18:14:50.695320+0000","last_became_active":"2023-07-07T18:14:46.253883+0000","last_became_peered":"2023-07-07T18:14:46.253883+0000","last_unstale":"2023-07-07T18:14:50.695320+0000","last_undegraded":"2023-07-07T18:14:50.695320+0000","last_fullsized":"2023-07-07T18:14:50.695320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:00:41.025452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287193+0000","last_change":"2023-07-07T18:14:46.253192+0000","last_active":"2023-07-07T18:14:51.287193+0000","last_peered":"2023-07-07T18:14:51.287193+0000","last_clean":"2023-07-07T18:14:51.287193+0000","last_became_active":"2023-07-07T18:14:46.250853+0000","last_became_peered":"2023-07-07T18:14:46.250853+0000","last_unstale":"2023-07-07T18:14:51.287193+0000","last_undegraded":"2023-07-07T18:14:51.287193+0000","last_fullsized":"2023-07-07T18:14:51.287193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:29:26.486548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287484+0000","last_change":"2023-07-07T18:14:46.238908+0000","last_active":"2023-07-07T18:14:51.287484+0000","last_peered":"2023-07-07T18:14:51.287484+0000","last_clean":"2023-07-07T18:14:51.287484+0000","last_became_active":"2023-07-07T18:14:46.238441+0000","last_became_peered":"2023-07-07T18:14:46.238441+0000","last_unstale":"2023-07-07T18:14:51.287484+0000","last_undegraded":"2023-07-07T18:14:51.287484+0000","last_fullsized":"2023-07-07T18:14:51.287484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:03:21.014607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694640+0000","last_change":"2023-07-07T18:14:46.256362+0000","last_active":"2023-07-07T18:14:50.694640+0000","last_peered":"2023-07-07T18:14:50.694640+0000","last_clean":"2023-07-07T18:14:50.694640+0000","last_became_active":"2023-07-07T18:14:46.254215+0000","last_became_peered":"2023-07-07T18:14:46.254215+0000","last_unstale":"2023-07-07T18:14:50.694640+0000","last_undegraded":"2023-07-07T18:14:50.694640+0000","last_fullsized":"2023-07-07T18:14:50.694640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:51.783149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286797+0000","last_change":"2023-07-07T18:14:46.254566+0000","last_active":"2023-07-07T18:14:51.286797+0000","last_peered":"2023-07-07T18:14:51.286797+0000","last_clean":"2023-07-07T18:14:51.286797+0000","last_became_active":"2023-07-07T18:14:46.250615+0000","last_became_peered":"2023-07-07T18:14:46.250615+0000","last_unstale":"2023-07-07T18:14:51.286797+0000","last_undegraded":"2023-07-07T18:14:51.286797+0000","last_fullsized":"2023-07-07T18:14:51.286797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:26:04.424280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693785+0000","last_change":"2023-07-07T18:14:46.245808+0000","last_active":"2023-07-07T18:14:50.693785+0000","last_peered":"2023-07-07T18:14:50.693785+0000","last_clean":"2023-07-07T18:14:50.693785+0000","last_became_active":"2023-07-07T18:14:46.245489+0000","last_became_peered":"2023-07-07T18:14:46.245489+0000","last_unstale":"2023-07-07T18:14:50.693785+0000","last_undegraded":"2023-07-07T18:14:50.693785+0000","last_fullsized":"2023-07-07T18:14:50.693785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:25.306900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":933888,"data_stored":721743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":717646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":127455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":131215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":128017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T18:15:11.235 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-07T18:15:11.236 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-07T18:15:11.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-07T18:15:11.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-07T18:15:11.237 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-07T18:15:11.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.390+0000 7f76236b4700 1 Processor -- start 2023-07-07T18:15:11.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.390+0000 7f76236b4700 1 -- start start 2023-07-07T18:15:11.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f76236b4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f761c15a640 0x7f761c06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f76236b4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f761c0cec80 0x7f761c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f76236b4700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761c0ae580 con 0x7f761c0d05d0 2023-07-07T18:15:11.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f76236b4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761c06f610 con 0x7f761c15a640 2023-07-07T18:15:11.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f76236b4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761c0adf70 con 0x7f761c0cec80 2023-07-07T18:15:11.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7621450700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f761c15a640 0x7f761c06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7620c4f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f761c0d05d0 0x7f761c0ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54448/0 (socket says 172.21.15.12:54448) 2023-07-07T18:15:11.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7620c4f700 1 -- 172.21.15.12:0/978015672 learned_addr learned my addr 172.21.15.12:0/978015672 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:11.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7621c51700 1 --2- 172.21.15.12:0/978015672 >> v2:172.21.15.160:3300/0 conn(0x7f761c0cec80 0x7f761c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7621450700 1 -- 172.21.15.12:0/978015672 >> v2:172.21.15.160:3300/0 conn(0x7f761c0cec80 msgr2=0x7f761c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:11.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7621450700 1 --2- 172.21.15.12:0/978015672 >> v2:172.21.15.160:3300/0 conn(0x7f761c0cec80 0x7f761c0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7621450700 1 -- 172.21.15.12:0/978015672 >> v1:172.21.15.12:6789/0 conn(0x7f761c0d05d0 legacy=0x7f761c0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7613fff700 1 -- 172.21.15.12:0/978015672 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063581024 0 0) 0x7f761c0ae580 con 0x7f761c0d05d0 2023-07-07T18:15:11.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7621450700 1 -- 172.21.15.12:0/978015672 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761c06f860 con 0x7f761c15a640 2023-07-07T18:15:11.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7621c51700 1 --2- 172.21.15.12:0/978015672 >> v2:172.21.15.160:3300/0 conn(0x7f761c0cec80 0x7f761c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:11.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7621450700 1 --2- 172.21.15.12:0/978015672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c15a640 0x7f761c06fe80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f761c070510 tx=0x7f7618009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e9828abf4e39da server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:11.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7613fff700 1 -- 172.21.15.12:0/978015672 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618011830 con 0x7f761c15a640 2023-07-07T18:15:11.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.391+0000 7f7613fff700 1 -- 172.21.15.12:0/978015672 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7618011990 con 0x7f761c15a640 2023-07-07T18:15:11.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.392+0000 7f7613fff700 1 -- 172.21.15.12:0/978015672 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618011d20 con 0x7f761c15a640 2023-07-07T18:15:11.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.392+0000 7f76236b4700 1 -- 172.21.15.12:0/978015672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c15a640 msgr2=0x7f761c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.392+0000 7f76236b4700 1 --2- 172.21.15.12:0/978015672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c15a640 0x7f761c06fe80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f761c070510 tx=0x7f7618009b20 comp rx=0 tx=0).stop 2023-07-07T18:15:11.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.392+0000 7f76236b4700 1 -- 172.21.15.12:0/978015672 shutdown_connections 2023-07-07T18:15:11.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.392+0000 7f76236b4700 1 --2- 172.21.15.12:0/978015672 >> v2:172.21.15.160:3300/0 conn(0x7f761c0cec80 0x7f761c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.392+0000 7f76236b4700 1 --2- 172.21.15.12:0/978015672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c15a640 0x7f761c06fe80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.392+0000 7f76236b4700 1 -- 172.21.15.12:0/978015672 >> 172.21.15.12:0/978015672 conn(0x7f761c089fe0 msgr2=0x7f761c0d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:11.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.392+0000 7f76236b4700 1 -- 172.21.15.12:0/978015672 shutdown_connections 2023-07-07T18:15:11.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.392+0000 7f76236b4700 1 -- 172.21.15.12:0/978015672 wait complete. 2023-07-07T18:15:11.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.393+0000 7f76236b4700 1 Processor -- start 2023-07-07T18:15:11.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.393+0000 7f76236b4700 1 -- start start 2023-07-07T18:15:11.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f76236b4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f761c0cec80 0x7f761c14a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f76236b4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c0d05d0 0x7f761c1f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f76236b4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f761c15a640 0x7f761c158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f76236b4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c0b1d90 con 0x7f761c0d05d0 2023-07-07T18:15:11.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f76236b4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c1f6680 con 0x7f761c15a640 2023-07-07T18:15:11.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f76236b4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761c0b05d0 con 0x7f761c0cec80 2023-07-07T18:15:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f7620c4f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c0d05d0 0x7f761c1f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f7620c4f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c0d05d0 0x7f761c1f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57258/0 (socket says 172.21.15.12:57258) 2023-07-07T18:15:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f7620c4f700 1 -- 172.21.15.12:0/2984087128 learned_addr learned my addr 172.21.15.12:0/2984087128 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f7621c51700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f761c15a640 0x7f761c158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.394+0000 7f7621450700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f761c0cec80 0x7f761c14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f7620c4f700 1 -- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f761c0cec80 msgr2=0x7f761c14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f7620c4f700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f761c0cec80 0x7f761c14a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f7620c4f700 1 -- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f761c15a640 msgr2=0x7f761c158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f7620c4f700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f761c15a640 0x7f761c158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f7620c4f700 1 -- 172.21.15.12:0/2984087128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180094a0 con 0x7f761c0d05d0 2023-07-07T18:15:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f7620c4f700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c0d05d0 0x7f761c1f6140 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f760c0011e0 tx=0x7f760c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f7611ffb700 1 -- 172.21.15.12:0/2984087128 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c004c80 con 0x7f761c0d05d0 2023-07-07T18:15:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f7611ffb700 1 -- 172.21.15.12:0/2984087128 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c004e00 con 0x7f761c0d05d0 2023-07-07T18:15:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f7611ffb700 1 -- 172.21.15.12:0/2984087128 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c007310 con 0x7f761c0d05d0 2023-07-07T18:15:11.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c06caa0 con 0x7f761c0d05d0 2023-07-07T18:15:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.395+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c0b08b0 con 0x7f761c0d05d0 2023-07-07T18:15:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.396+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c073910 con 0x7f761c0d05d0 2023-07-07T18:15:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.396+0000 7f7611ffb700 1 -- 172.21.15.12:0/2984087128 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f760c007470 con 0x7f761c0d05d0 2023-07-07T18:15:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.397+0000 7f7611ffb700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f760006ace0 0x7f760006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.397+0000 7f7611ffb700 1 -- 172.21.15.12:0/2984087128 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f760c089310 con 0x7f761c0d05d0 2023-07-07T18:15:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.397+0000 7f7621450700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f760006ace0 0x7f760006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.397+0000 7f7621450700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f760006ace0 0x7f760006d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76180090b0 tx=0x7f7618008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:11.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.401+0000 7f7611ffb700 1 -- 172.21.15.12:0/2984087128 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f760c054160 con 0x7f761c0d05d0 2023-07-07T18:15:11.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.656+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f761c0d1570 con 0x7f761c0d05d0 2023-07-07T18:15:11.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.659+0000 7f7611ffb700 1 -- 172.21.15.12:0/2984087128 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170849 (secure 0 0 0) 0x7f760c057780 con 0x7f761c0d05d0 2023-07-07T18:15:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.661+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f760006ace0 msgr2=0x7f760006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.661+0000 7f76236b4700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f760006ace0 0x7f760006d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76180090b0 tx=0x7f7618008030 comp rx=0 tx=0).stop 2023-07-07T18:15:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.661+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c0d05d0 msgr2=0x7f761c1f6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.661+0000 7f76236b4700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c0d05d0 0x7f761c1f6140 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f760c0011e0 tx=0x7f760c00ca30 comp rx=0 tx=0).stop 2023-07-07T18:15:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.661+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 shutdown_connections 2023-07-07T18:15:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.661+0000 7f76236b4700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f760006ace0 0x7f760006d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.662+0000 7f76236b4700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f761c15a640 0x7f761c158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.662+0000 7f76236b4700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f761c0cec80 0x7f761c14a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.662+0000 7f76236b4700 1 --2- 172.21.15.12:0/2984087128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f761c0d05d0 0x7f761c1f6140 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.662+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 >> 172.21.15.12:0/2984087128 conn(0x7f761c089fe0 msgr2=0x7f761c0ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.662+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 shutdown_connections 2023-07-07T18:15:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.662+0000 7f76236b4700 1 -- 172.21.15.12:0/2984087128 wait complete. 2023-07-07T18:15:11.675 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":4080099133},{"type":"v1","addr":"172.21.15.160:6833","nonce":4080099133}]},"active_addr":"172.21.15.160:6833/4080099133","active_change":"2023-07-07T18:14:26.577151+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":4015902358}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":1464851166}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":2330791324}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":2462594336}]}]} 2023-07-07T18:15:11.680 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-07T18:15:11.680 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-07T18:15:11.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:11.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.803+0000 7f20779ac700 1 Processor -- start 2023-07-07T18:15:11.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.804+0000 7f20779ac700 1 -- start start 2023-07-07T18:15:11.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.804+0000 7f20779ac700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2070156880 0x7f2070069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.804+0000 7f20779ac700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20700cc1d0 0x7f20700cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.804+0000 7f20779ac700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20700cee80 con 0x7f20700aed30 2023-07-07T18:15:11.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.804+0000 7f20779ac700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20700ccb90 con 0x7f20700cc1d0 2023-07-07T18:15:11.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.804+0000 7f20779ac700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700cf100 con 0x7f2070156880 2023-07-07T18:15:11.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075f49700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20700cc1d0 0x7f20700cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075748700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2070156880 0x7f2070069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075f49700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20700cc1d0 0x7f20700cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:52874/0 (socket says 172.21.15.12:52874) 2023-07-07T18:15:11.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075748700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2070156880 0x7f2070069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46354/0 (socket says 172.21.15.12:46354) 2023-07-07T18:15:11.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075f49700 1 -- 172.21.15.12:0/2255418740 learned_addr learned my addr 172.21.15.12:0/2255418740 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:11.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2074f47700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f20700aed30 0x7f2070160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:47702/0 (socket says 172.21.15.12:47702) 2023-07-07T18:15:11.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2067fff700 1 -- 172.21.15.12:0/2255418740 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444290638 0 0) 0x7f20700cee80 con 0x7f20700aed30 2023-07-07T18:15:11.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2067fff700 1 -- 172.21.15.12:0/2255418740 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f205c0035b0 con 0x7f20700aed30 2023-07-07T18:15:11.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075f49700 1 -- 172.21.15.12:0/2255418740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2070156880 msgr2=0x7f2070069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:11.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075f49700 1 --2- 172.21.15.12:0/2255418740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2070156880 0x7f2070069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075f49700 1 -- 172.21.15.12:0/2255418740 >> v1:172.21.15.160:6789/0 conn(0x7f20700aed30 legacy=0x7f2070160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075f49700 1 -- 172.21.15.12:0/2255418740 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20700cf3e0 con 0x7f20700cc1d0 2023-07-07T18:15:11.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.805+0000 7f2075748700 1 --2- 172.21.15.12:0/2255418740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2070156880 0x7f2070069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:11.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f2075f49700 1 --2- 172.21.15.12:0/2255418740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20700cc1d0 0x7f20700cc650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2068009e50 tx=0x7f206800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95999fba5b270068 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:11.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f2067fff700 1 -- 172.21.15.12:0/2255418740 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206800e070 con 0x7f20700cc1d0 2023-07-07T18:15:11.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f2067fff700 1 -- 172.21.15.12:0/2255418740 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206800b910 con 0x7f20700cc1d0 2023-07-07T18:15:11.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f2067fff700 1 -- 172.21.15.12:0/2255418740 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206800bcc0 con 0x7f20700cc1d0 2023-07-07T18:15:11.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f20779ac700 1 -- 172.21.15.12:0/2255418740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20700cc1d0 msgr2=0x7f20700cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f20779ac700 1 --2- 172.21.15.12:0/2255418740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20700cc1d0 0x7f20700cc650 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2068009e50 tx=0x7f206800b330 comp rx=0 tx=0).stop 2023-07-07T18:15:11.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f20779ac700 1 -- 172.21.15.12:0/2255418740 shutdown_connections 2023-07-07T18:15:11.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f20779ac700 1 --2- 172.21.15.12:0/2255418740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20700cc1d0 0x7f20700cc650 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f20779ac700 1 --2- 172.21.15.12:0/2255418740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2070156880 0x7f2070069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f20779ac700 1 -- 172.21.15.12:0/2255418740 >> 172.21.15.12:0/2255418740 conn(0x7f207006d4a0 msgr2=0x7f207006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:11.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f20779ac700 1 -- 172.21.15.12:0/2255418740 shutdown_connections 2023-07-07T18:15:11.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.806+0000 7f20779ac700 1 -- 172.21.15.12:0/2255418740 wait complete. 2023-07-07T18:15:11.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.808+0000 7f20779ac700 1 Processor -- start 2023-07-07T18:15:11.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.808+0000 7f20779ac700 1 -- start start 2023-07-07T18:15:11.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.808+0000 7f20779ac700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20700aed30 0x7f207014d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.808+0000 7f20779ac700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20700cc1d0 0x7f207014b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.808+0000 7f20779ac700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2070156880 0x7f20700ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.808+0000 7f20779ac700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20700b37f0 con 0x7f2070156880 2023-07-07T18:15:11.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.808+0000 7f20779ac700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20700b3ad0 con 0x7f20700aed30 2023-07-07T18:15:11.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.808+0000 7f20779ac700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700b3db0 con 0x7f20700cc1d0 2023-07-07T18:15:11.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075f49700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2070156880 0x7f20700ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075f49700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2070156880 0x7f20700ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57274/0 (socket says 172.21.15.12:57274) 2023-07-07T18:15:11.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075f49700 1 -- 172.21.15.12:0/2001821209 learned_addr learned my addr 172.21.15.12:0/2001821209 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:11.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2074f47700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20700cc1d0 0x7f207014b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075748700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20700aed30 0x7f207014d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075f49700 1 -- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20700cc1d0 msgr2=0x7f207014b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075f49700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20700cc1d0 0x7f207014b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075f49700 1 -- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20700aed30 msgr2=0x7f207014d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:11.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075f49700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20700aed30 0x7f207014d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:11.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075f49700 1 -- 172.21.15.12:0/2001821209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600094a0 con 0x7f2070156880 2023-07-07T18:15:11.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2075f49700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2070156880 0x7f20700ac710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f20700ccf50 tx=0x7f2068004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:11.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2065ffb700 1 -- 172.21.15.12:0/2001821209 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2068004960 con 0x7f2070156880 2023-07-07T18:15:11.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2065ffb700 1 -- 172.21.15.12:0/2001821209 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20680099b0 con 0x7f2070156880 2023-07-07T18:15:11.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f2065ffb700 1 -- 172.21.15.12:0/2001821209 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206801c680 con 0x7f2070156880 2023-07-07T18:15:11.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2068009b30 con 0x7f2070156880 2023-07-07T18:15:11.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.809+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20700b4370 con 0x7f2070156880 2023-07-07T18:15:11.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.810+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2070073910 con 0x7f2070156880 2023-07-07T18:15:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.811+0000 7f2065ffb700 1 -- 172.21.15.12:0/2001821209 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f206801c7e0 con 0x7f2070156880 2023-07-07T18:15:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.811+0000 7f2065ffb700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205406ace0 0x7f205406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.812+0000 7f2065ffb700 1 -- 172.21.15.12:0/2001821209 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f206808b430 con 0x7f2070156880 2023-07-07T18:15:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.812+0000 7f2075748700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205406ace0 0x7f205406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.812+0000 7f2075748700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205406ace0 0x7f205406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2060009d00 tx=0x7f2060008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:11.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:11.816+0000 7f2065ffb700 1 -- 172.21.15.12:0/2001821209 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f20680561e0 con 0x7f2070156880 2023-07-07T18:15:12.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.014+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2070071cf0 con 0x7f2070156880 2023-07-07T18:15:12.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.015+0000 7f2065ffb700 1 -- 172.21.15.12:0/2001821209 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f2068059800 con 0x7f2070156880 2023-07-07T18:15:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:12.018 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:12.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205406ace0 msgr2=0x7f205406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205406ace0 0x7f205406d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2060009d00 tx=0x7f2060008040 comp rx=0 tx=0).stop 2023-07-07T18:15:12.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2070156880 msgr2=0x7f20700ac710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2070156880 0x7f20700ac710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f20700ccf50 tx=0x7f2068004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 shutdown_connections 2023-07-07T18:15:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f205406ace0 0x7f205406d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2070156880 0x7f20700ac710 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20700aed30 0x7f207014d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 --2- 172.21.15.12:0/2001821209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20700cc1d0 0x7f207014b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 >> 172.21.15.12:0/2001821209 conn(0x7f207006d4a0 msgr2=0x7f207014ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 shutdown_connections 2023-07-07T18:15:12.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.017+0000 7f20779ac700 1 -- 172.21.15.12:0/2001821209 wait complete. 2023-07-07T18:15:12.031 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-07T18:15:12.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:12.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.154+0000 7f896c2bb700 1 Processor -- start 2023-07-07T18:15:12.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.154+0000 7f896c2bb700 1 -- start start 2023-07-07T18:15:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.155+0000 7f896c2bb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f896415cb60 0x7f896415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.155+0000 7f896c2bb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89640caea0 0x7f89640cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.155+0000 7f896c2bb700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896406f220 con 0x7f896415d700 2023-07-07T18:15:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.155+0000 7f896c2bb700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896406f000 con 0x7f896415cb60 2023-07-07T18:15:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.155+0000 7f896c2bb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c9e60 con 0x7f89640caea0 2023-07-07T18:15:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f896a057700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f896415cb60 0x7f896415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f896a057700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f896415cb60 0x7f896415cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57278/0 (socket says 172.21.15.12:57278) 2023-07-07T18:15:12.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f896a057700 1 -- 172.21.15.12:0/4033761015 learned_addr learned my addr 172.21.15.12:0/4033761015 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f8969856700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f896415d700 0x7f896406e8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54476/0 (socket says 172.21.15.12:54476) 2023-07-07T18:15:12.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f896a858700 1 --2- 172.21.15.12:0/4033761015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89640caea0 0x7f89640cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f896a057700 1 -- 172.21.15.12:0/4033761015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89640caea0 msgr2=0x7f89640cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f896a057700 1 --2- 172.21.15.12:0/4033761015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89640caea0 0x7f89640cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f896a057700 1 -- 172.21.15.12:0/4033761015 >> v1:172.21.15.12:6789/0 conn(0x7f896415d700 legacy=0x7f896406e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f896a057700 1 -- 172.21.15.12:0/4033761015 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896415d470 con 0x7f896415cb60 2023-07-07T18:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f8969055700 1 -- 172.21.15.12:0/4033761015 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478781931 0 0) 0x7f8958001110 con 0x7f896415d700 2023-07-07T18:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f896a057700 1 --2- 172.21.15.12:0/4033761015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415cb60 0x7f896415cf30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8960009920 tx=0x7f8960009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb467660b0f4a854 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f8969055700 1 -- 172.21.15.12:0/4033761015 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960011830 con 0x7f896415cb60 2023-07-07T18:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f8969055700 1 -- 172.21.15.12:0/4033761015 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8960011990 con 0x7f896415cb60 2023-07-07T18:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.156+0000 7f8969055700 1 -- 172.21.15.12:0/4033761015 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8960011d20 con 0x7f896415cb60 2023-07-07T18:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.157+0000 7f896c2bb700 1 -- 172.21.15.12:0/4033761015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415cb60 msgr2=0x7f896415cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.157+0000 7f896c2bb700 1 --2- 172.21.15.12:0/4033761015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415cb60 0x7f896415cf30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8960009920 tx=0x7f8960009c30 comp rx=0 tx=0).stop 2023-07-07T18:15:12.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.157+0000 7f896c2bb700 1 -- 172.21.15.12:0/4033761015 shutdown_connections 2023-07-07T18:15:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.157+0000 7f896c2bb700 1 --2- 172.21.15.12:0/4033761015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89640caea0 0x7f89640cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.157+0000 7f896c2bb700 1 --2- 172.21.15.12:0/4033761015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415cb60 0x7f896415cf30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.157+0000 7f896c2bb700 1 -- 172.21.15.12:0/4033761015 >> 172.21.15.12:0/4033761015 conn(0x7f89640b1740 msgr2=0x7f896406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.157+0000 7f896c2bb700 1 -- 172.21.15.12:0/4033761015 shutdown_connections 2023-07-07T18:15:12.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.157+0000 7f896c2bb700 1 -- 172.21.15.12:0/4033761015 wait complete. 2023-07-07T18:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.158+0000 7f896c2bb700 1 Processor -- start 2023-07-07T18:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.158+0000 7f896c2bb700 1 -- start start 2023-07-07T18:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896c2bb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89640caea0 0x7f89640c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896c2bb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f896415cb60 0x7f89641f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896c2bb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415d700 0x7f8964070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896c2bb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c5310 con 0x7f896415d700 2023-07-07T18:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896c2bb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c5030 con 0x7f89640caea0 2023-07-07T18:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896c2bb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640aba70 con 0x7f896415cb60 2023-07-07T18:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896a858700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415d700 0x7f8964070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896a858700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415d700 0x7f8964070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57288/0 (socket says 172.21.15.12:57288) 2023-07-07T18:15:12.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896a858700 1 -- 172.21.15.12:0/279222903 learned_addr learned my addr 172.21.15.12:0/279222903 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f8969856700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f896415cb60 0x7f89641f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896a057700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89640caea0 0x7f89640c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896a858700 1 -- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f896415cb60 msgr2=0x7f89641f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896a858700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f896415cb60 0x7f89641f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896a858700 1 -- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89640caea0 msgr2=0x7f89640c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896a858700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89640caea0 0x7f89640c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.159+0000 7f896a858700 1 -- 172.21.15.12:0/279222903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960009550 con 0x7f896415d700 2023-07-07T18:15:12.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.160+0000 7f896a858700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415d700 0x7f8964070bc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f895c00efc0 tx=0x7f895c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.160+0000 7f8956ffd700 1 -- 172.21.15.12:0/279222903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c009ba0 con 0x7f896415d700 2023-07-07T18:15:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.160+0000 7f8956ffd700 1 -- 172.21.15.12:0/279222903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00f040 con 0x7f896415d700 2023-07-07T18:15:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.160+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89640abd50 con 0x7f896415d700 2023-07-07T18:15:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.160+0000 7f8956ffd700 1 -- 172.21.15.12:0/279222903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c014480 con 0x7f896415d700 2023-07-07T18:15:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.160+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89640c4c40 con 0x7f896415d700 2023-07-07T18:15:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.161+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89640ab8d0 con 0x7f896415d700 2023-07-07T18:15:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.161+0000 7f8956ffd700 1 -- 172.21.15.12:0/279222903 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f895c0145e0 con 0x7f896415d700 2023-07-07T18:15:12.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.162+0000 7f8956ffd700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f894806ad10 0x7f894806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.162+0000 7f8956ffd700 1 -- 172.21.15.12:0/279222903 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f895c089f50 con 0x7f896415d700 2023-07-07T18:15:12.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.162+0000 7f896a057700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f894806ad10 0x7f894806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.162+0000 7f896a057700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f894806ad10 0x7f894806d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8960009840 tx=0x7f8960008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.166+0000 7f8956ffd700 1 -- 172.21.15.12:0/279222903 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89640ab8d0 con 0x7f896415d700 2023-07-07T18:15:12.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.362+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89640ab8d0 con 0x7f896415d700 2023-07-07T18:15:12.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.363+0000 7f8956ffd700 1 -- 172.21.15.12:0/279222903 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f89640ab8d0 con 0x7f896415d700 2023-07-07T18:15:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:12.366 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:12.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f894806ad10 msgr2=0x7f894806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f894806ad10 0x7f894806d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8960009840 tx=0x7f8960008030 comp rx=0 tx=0).stop 2023-07-07T18:15:12.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415d700 msgr2=0x7f8964070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415d700 0x7f8964070bc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f895c00efc0 tx=0x7f895c00c3a0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 shutdown_connections 2023-07-07T18:15:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f894806ad10 0x7f894806d1c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896415d700 0x7f8964070bc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89640caea0 0x7f89640c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 --2- 172.21.15.12:0/279222903 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f896415cb60 0x7f89641f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 >> 172.21.15.12:0/279222903 conn(0x7f89640b1740 msgr2=0x7f89640af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 shutdown_connections 2023-07-07T18:15:12.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.365+0000 7f896c2bb700 1 -- 172.21.15.12:0/279222903 wait complete. 2023-07-07T18:15:12.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-07T18:15:12.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-07T18:15:12.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-07T18:15:12.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-07T18:15:12.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-07T18:15:12.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-07T18:15:12.383 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-07T18:15:12.383 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-07T18:15:12.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.592+0000 7f3d830af700 1 Processor -- start 2023-07-07T18:15:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.592+0000 7f3d830af700 1 -- start start 2023-07-07T18:15:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.593+0000 7f3d830af700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3d7c0b0d40 0x7f3d7c159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.593+0000 7f3d830af700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.593+0000 7f3d830af700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7c15bd30 con 0x7f3d7c0cc260 2023-07-07T18:15:12.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.593+0000 7f3d830af700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c1586a0 con 0x7f3d7c0b0d40 2023-07-07T18:15:12.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.593+0000 7f3d830af700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0cbe90 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46386/0 (socket says 172.21.15.12:46386) 2023-07-07T18:15:12.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d7bfff700 1 -- 172.21.15.12:0/581539640 learned_addr learned my addr 172.21.15.12:0/581539640 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d80e4b700 1 --2- 172.21.15.12:0/581539640 >> v2:172.21.15.160:3300/0 conn(0x7f3d7c0b0d40 0x7f3d7c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d8164c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3d7c0cc260 0x7f3d7c0cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54492/0 (socket says 172.21.15.12:54492) 2023-07-07T18:15:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d7bfff700 1 -- 172.21.15.12:0/581539640 >> v2:172.21.15.160:3300/0 conn(0x7f3d7c0b0d40 msgr2=0x7f3d7c159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d7bfff700 1 --2- 172.21.15.12:0/581539640 >> v2:172.21.15.160:3300/0 conn(0x7f3d7c0b0d40 0x7f3d7c159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d7bfff700 1 -- 172.21.15.12:0/581539640 >> v1:172.21.15.12:6789/0 conn(0x7f3d7c0cc260 legacy=0x7f3d7c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d7bfff700 1 -- 172.21.15.12:0/581539640 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c15bfd0 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.594+0000 7f3d7bfff700 1 --2- 172.21.15.12:0/581539640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0cb950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009e50 tx=0x7f3d7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=295c8ba65037811 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.595+0000 7f3d7b7fe700 1 -- 172.21.15.12:0/581539640 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400e070 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.595+0000 7f3d7b7fe700 1 -- 172.21.15.12:0/581539640 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7400b910 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.595+0000 7f3d7b7fe700 1 -- 172.21.15.12:0/581539640 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400bca0 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.599+0000 7f3d830af700 1 -- 172.21.15.12:0/581539640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 msgr2=0x7f3d7c0cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.599+0000 7f3d830af700 1 --2- 172.21.15.12:0/581539640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0cb950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009e50 tx=0x7f3d7400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.600+0000 7f3d830af700 1 -- 172.21.15.12:0/581539640 shutdown_connections 2023-07-07T18:15:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.600+0000 7f3d830af700 1 --2- 172.21.15.12:0/581539640 >> v2:172.21.15.160:3300/0 conn(0x7f3d7c0b0d40 0x7f3d7c159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.600+0000 7f3d830af700 1 --2- 172.21.15.12:0/581539640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0cb950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.600+0000 7f3d830af700 1 -- 172.21.15.12:0/581539640 >> 172.21.15.12:0/581539640 conn(0x7f3d7c0b0260 msgr2=0x7f3d7c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.600+0000 7f3d830af700 1 -- 172.21.15.12:0/581539640 shutdown_connections 2023-07-07T18:15:12.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.600+0000 7f3d830af700 1 -- 172.21.15.12:0/581539640 wait complete. 2023-07-07T18:15:12.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.602+0000 7f3d830af700 1 Processor -- start 2023-07-07T18:15:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.602+0000 7f3d830af700 1 -- start start 2023-07-07T18:15:12.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.603+0000 7f3d830af700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d7c0b0d40 0x7f3d7c201d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.603+0000 7f3d830af700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.603+0000 7f3d830af700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d7c0cc260 0x7f3d7c15a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.603+0000 7f3d830af700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c2022c0 con 0x7f3d7c0cc260 2023-07-07T18:15:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d830af700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0ae8c0 con 0x7f3d7c0b0d40 2023-07-07T18:15:12.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d830af700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0c38c0 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46390/0 (socket says 172.21.15.12:46390) 2023-07-07T18:15:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d7bfff700 1 -- 172.21.15.12:0/1160012662 learned_addr learned my addr 172.21.15.12:0/1160012662 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d7bfff700 1 -- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d7c0b0d40 msgr2=0x7f3d7c201d80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-07T18:15:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d7bfff700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d7c0b0d40 0x7f3d7c201d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d7bfff700 1 -- 172.21.15.12:0/1160012662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d7c0cc260 msgr2=0x7f3d7c15a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d7bfff700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d7c0cc260 0x7f3d7c15a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.604+0000 7f3d7bfff700 1 -- 172.21.15.12:0/1160012662 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d74009b30 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.605+0000 7f3d7bfff700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0ae380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d74000f80 tx=0x7f3d74004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.605+0000 7f3d797fa700 1 -- 172.21.15.12:0/1160012662 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74004450 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.605+0000 7f3d797fa700 1 -- 172.21.15.12:0/1160012662 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d740045b0 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.605+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7c0c3ba0 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.605+0000 7f3d797fa700 1 -- 172.21.15.12:0/1160012662 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74004940 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.605+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7c0c4160 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.606+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3d7c15c590 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.605+0000 7ff6fdeae700 1 Processor -- start 2023-07-07T18:15:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.605+0000 7ff6fdeae700 1 -- start start 2023-07-07T18:15:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.606+0000 7ff6fdeae700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff6f8159270 0x7ff6f80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.606+0000 7ff6fdeae700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff6f80cc970 0x7ff6f806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.606+0000 7ff6fdeae700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f815bd30 con 0x7ff6f80cba20 2023-07-07T18:15:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.606+0000 7ff6fdeae700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f81586a0 con 0x7ff6f8159270 2023-07-07T18:15:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.606+0000 7ff6fdeae700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f80cbec0 con 0x7ff6f80cc970 2023-07-07T18:15:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.607+0000 7ff6f6ffd700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7ff6f80cba20 0x7ff6f80cc260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:47744/0 (socket says 172.21.15.12:47744) 2023-07-07T18:15:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.607+0000 7ff6f6ffd700 1 -- 172.21.15.12:0/3457684164 learned_addr learned my addr 172.21.15.12:0/3457684164 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.607+0000 7ff6f7fff700 1 --2- 172.21.15.12:0/3457684164 >> v2:172.21.15.160:3300/0 conn(0x7ff6f80cc970 0x7ff6f806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.607+0000 7ff6f77fe700 1 --2- 172.21.15.12:0/3457684164 >> v2:172.21.15.12:3300/0 conn(0x7ff6f8159270 0x7ff6f80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.607+0000 7ff6f7fff700 1 -- 172.21.15.12:0/3457684164 >> v2:172.21.15.12:3300/0 conn(0x7ff6f8159270 msgr2=0x7ff6f80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.607+0000 7ff6f7fff700 1 --2- 172.21.15.12:0/3457684164 >> v2:172.21.15.12:3300/0 conn(0x7ff6f8159270 0x7ff6f80cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.607+0000 7ff6f7fff700 1 -- 172.21.15.12:0/3457684164 >> v1:172.21.15.160:6789/0 conn(0x7ff6f80cba20 legacy=0x7ff6f80cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.607+0000 7ff6f7fff700 1 -- 172.21.15.12:0/3457684164 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8159640 con 0x7ff6f80cc970 2023-07-07T18:15:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.607+0000 7ff6f7fff700 1 --2- 172.21.15.12:0/3457684164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f80cc970 0x7ff6f806c270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80cb0c0 tx=0x7ff6f000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8cee7f42c84a978 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.608+0000 7ff6f67fc700 1 -- 172.21.15.12:0/3457684164 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f000f070 con 0x7ff6f80cc970 2023-07-07T18:15:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.608+0000 7ff6f67fc700 1 -- 172.21.15.12:0/3457684164 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000a2e0 con 0x7ff6f80cc970 2023-07-07T18:15:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.608+0000 7ff6f67fc700 1 -- 172.21.15.12:0/3457684164 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0003c60 con 0x7ff6f80cc970 2023-07-07T18:15:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.608+0000 7ff6fdeae700 1 -- 172.21.15.12:0/3457684164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f80cc970 msgr2=0x7ff6f806c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.608+0000 7ff6fdeae700 1 --2- 172.21.15.12:0/3457684164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f80cc970 0x7ff6f806c270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80cb0c0 tx=0x7ff6f000c330 comp rx=0 tx=0).stop 2023-07-07T18:15:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.609+0000 7ff6fdeae700 1 -- 172.21.15.12:0/3457684164 shutdown_connections 2023-07-07T18:15:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.609+0000 7ff6fdeae700 1 --2- 172.21.15.12:0/3457684164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f80cc970 0x7ff6f806c270 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.609+0000 7ff6fdeae700 1 --2- 172.21.15.12:0/3457684164 >> v2:172.21.15.12:3300/0 conn(0x7ff6f8159270 0x7ff6f80cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.609+0000 7ff6fdeae700 1 -- 172.21.15.12:0/3457684164 >> 172.21.15.12:0/3457684164 conn(0x7ff6f80b0260 msgr2=0x7ff6f80b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.609+0000 7f3115837700 1 Processor -- start 2023-07-07T18:15:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.609+0000 7f3115837700 1 -- start start 2023-07-07T18:15:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.609+0000 7f95d5ffd700 1 Processor -- start 2023-07-07T18:15:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7f95d5ffd700 1 -- start start 2023-07-07T18:15:12.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.609+0000 7faf2e7ef700 1 Processor -- start 2023-07-07T18:15:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.609+0000 7faf2e7ef700 1 -- start start 2023-07-07T18:15:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7ff6fdeae700 1 -- 172.21.15.12:0/3457684164 shutdown_connections 2023-07-07T18:15:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7ff6fdeae700 1 -- 172.21.15.12:0/3457684164 wait complete. 2023-07-07T18:15:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7fd358606700 1 Processor -- start 2023-07-07T18:15:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7f3d797fa700 1 -- 172.21.15.12:0/1160012662 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d7401c410 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7f3d797fa700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d6406af10 0x7f3d6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f3d797fa700 1 -- 172.21.15.12:0/1160012662 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3d7408bc10 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f3d797fa700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.12:6808/1157853369,v1:172.21.15.12:6809/1157853369] conn(0x7f3d64074be0 0x7f3d64077010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f3d797fa700 1 -- 172.21.15.12:0/1160012662 --> [v2:172.21.15.12:6808/1157853369,v1:172.21.15.12:6809/1157853369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d640776e0 con 0x7f3d64074be0 2023-07-07T18:15:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f3d797fa700 1 -- 172.21.15.12:0/1160012662 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d7408bfc0 con 0x7f3d7c0cb4e0 2023-07-07T18:15:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7f3115837700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31100cb390 0x7f31100cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7f3115837700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f31100cc260 0x7f31100cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7f3115837700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f311006c060 0x7f311006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7f3115837700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3110069ef0 con 0x7f311006c060 2023-07-07T18:15:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7f3115837700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311015c6e0 con 0x7f31100cc260 2023-07-07T18:15:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7f3115837700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31100cbca0 con 0x7f31100cb390 2023-07-07T18:15:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f310e7fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f31100cc260 0x7f31100cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f310e7fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f31100cc260 0x7f31100cb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:52916/0 (socket says 172.21.15.12:52916) 2023-07-07T18:15:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f310e7fc700 1 -- 172.21.15.12:0/4064615809 learned_addr learned my addr 172.21.15.12:0/4064615809 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f310f7fe700 1 --2- 172.21.15.12:0/4064615809 >> v2:172.21.15.12:3300/0 conn(0x7f311006c060 0x7f311006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f310effd700 1 --2- 172.21.15.12:0/4064615809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31100cb390 0x7f31100cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f95d5ffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f95d006d760 0x7f95d0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f95d5ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95d015d200 0x7f95d006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f95d5ffd700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d00ccb60 con 0x7f95d0070ae0 2023-07-07T18:15:12.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f95d5ffd700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d00ce990 con 0x7f95d015d200 2023-07-07T18:15:12.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f95d5ffd700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d00cec70 con 0x7f95d006d760 2023-07-07T18:15:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f3d80e4b700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d6406af10 0x7f3d6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7f3d8164c700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.12:6808/1157853369,v1:172.21.15.12:6809/1157853369] conn(0x7f3d64074be0 0x7f3d64077010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7faf2e7ef700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf280893f0 0x7faf28174d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7faf2e7ef700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf280cc260 con 0x7faf2806a160 2023-07-07T18:15:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7faf2e7ef700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf280cdf80 con 0x7faf2806a530 2023-07-07T18:15:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7faf2e7ef700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf28169370 con 0x7faf280893f0 2023-07-07T18:15:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7faf2cd8c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf280893f0 0x7faf28174d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7faf2cd8c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf280893f0 0x7faf28174d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46406/0 (socket says 172.21.15.12:46406) 2023-07-07T18:15:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7faf2cd8c700 1 -- 172.21.15.12:0/3075814696 learned_addr learned my addr 172.21.15.12:0/3075814696 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7faf2cd8c700 1 -- 172.21.15.12:0/3075814696 >> v1:172.21.15.160:6789/0 conn(0x7faf2806a530 legacy=0x7faf2816d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.611+0000 7faf2cd8c700 1 -- 172.21.15.12:0/3075814696 >> v1:172.21.15.12:6789/0 conn(0x7faf2806a160 legacy=0x7faf2816c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f95cf7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f95d0070ae0 0x7f95d0070eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54528/0 (socket says 172.21.15.12:54528) 2023-07-07T18:15:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f95cf7fe700 1 -- 172.21.15.12:0/4254502136 learned_addr learned my addr 172.21.15.12:0/4254502136 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.610+0000 7fd358606700 1 -- start start 2023-07-07T18:15:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7fd358606700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500711f0 0x7fd3500ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7fd358606700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd3500caf60 0x7fd350164be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7fd358606700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3500ced90 con 0x7fd3500cab90 2023-07-07T18:15:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7fd358606700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd350165120 con 0x7fd3500caf60 2023-07-07T18:15:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7fd358606700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35006b2b0 con 0x7fd3500711f0 2023-07-07T18:15:12.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7faf2cd8c700 1 -- 172.21.15.12:0/3075814696 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2816d7f0 con 0x7faf280893f0 2023-07-07T18:15:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f310e7fc700 1 -- 172.21.15.12:0/4064615809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31100cb390 msgr2=0x7f31100cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f310e7fc700 1 --2- 172.21.15.12:0/4064615809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31100cb390 0x7f31100cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f310e7fc700 1 -- 172.21.15.12:0/4064615809 >> v2:172.21.15.12:3300/0 conn(0x7f311006c060 msgr2=0x7f311006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f310e7fc700 1 --2- 172.21.15.12:0/4064615809 >> v2:172.21.15.12:3300/0 conn(0x7f311006c060 0x7f311006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f310e7fc700 1 -- 172.21.15.12:0/4064615809 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100ce330 con 0x7f31100cc260 2023-07-07T18:15:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f95cffff700 1 --2- 172.21.15.12:0/4254502136 >> v2:172.21.15.12:3300/0 conn(0x7f95d015d200 0x7f95d006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7ff6fdeae700 1 Processor -- start 2023-07-07T18:15:12.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f310e7fc700 1 --2- 172.21.15.12:0/4064615809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31100cc260 0x7f31100cb760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31100b1320 tx=0x7f310800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=160799a2c1d12a5e server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7fd356ba3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd3500caf60 0x7fd350164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f95ceffd700 1 --2- 172.21.15.12:0/4254502136 >> v2:172.21.15.160:3300/0 conn(0x7f95d006d760 0x7f95d0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743133943 0 0) 0x7f95d00ccb60 con 0x7f95d0070ae0 2023-07-07T18:15:12.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b80035b0 con 0x7f95d0070ae0 2023-07-07T18:15:12.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7fd3563a2700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd3500cab90 0x7fd350070ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54534/0 (socket says 172.21.15.12:54534) 2023-07-07T18:15:12.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7fd3563a2700 1 -- 172.21.15.12:0/4101085146 learned_addr learned my addr 172.21.15.12:0/4101085146 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:12.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7faf2cd8c700 1 --2- 172.21.15.12:0/3075814696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf280893f0 0x7faf28174d10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faf20009e80 tx=0x7faf2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=784f0a5eb929601d server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f3d8164c700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.12:6808/1157853369,v1:172.21.15.12:6809/1157853369] conn(0x7f3d64074be0 0x7f3d64077010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7faf26ffd700 1 -- 172.21.15.12:0/3075814696 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20003a20 con 0x7faf280893f0 2023-07-07T18:15:12.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7faf26ffd700 1 -- 172.21.15.12:0/3075814696 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf20003b80 con 0x7faf280893f0 2023-07-07T18:15:12.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7faf26ffd700 1 -- 172.21.15.12:0/3075814696 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000b980 con 0x7faf280893f0 2023-07-07T18:15:12.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f3d80e4b700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d6406af10 0x7f3d6406d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009a70 tx=0x7f3d6c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7fd3553a0700 1 -- 172.21.15.12:0/4101085146 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271470971 0 0) 0x7fd3500ced90 con 0x7fd3500cab90 2023-07-07T18:15:12.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7fd3553a0700 1 -- 172.21.15.12:0/4101085146 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd33c0035b0 con 0x7fd3500cab90 2023-07-07T18:15:12.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 814575247 0 0) 0x7f95b80035b0 con 0x7f95d0070ae0 2023-07-07T18:15:12.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 >> v2:172.21.15.160:3300/0 conn(0x7f95d006d760 msgr2=0x7f95d0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 --2- 172.21.15.12:0/4254502136 >> v2:172.21.15.160:3300/0 conn(0x7f95d006d760 0x7f95d0069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 >> v2:172.21.15.12:3300/0 conn(0x7f95d015d200 msgr2=0x7f95d006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 --2- 172.21.15.12:0/4254502136 >> v2:172.21.15.12:3300/0 conn(0x7f95d015d200 0x7f95d006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d00cce00 con 0x7f95d0070ae0 2023-07-07T18:15:12.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f95c4001670 con 0x7f95d0070ae0 2023-07-07T18:15:12.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 >> v1:172.21.15.12:6789/0 conn(0x7f95d0070ae0 legacy=0x7f95d0070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b8003a00 0x7f95b8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b8004850 0x7f95b8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8005200 0x7f95b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00ce990 con 0x7f95b8005200 2023-07-07T18:15:12.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00cec70 con 0x7f95b8003a00 2023-07-07T18:15:12.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b800c0e0 con 0x7f95b8004850 2023-07-07T18:15:12.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7fd355ba1700 1 --2- 172.21.15.12:0/4101085146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500711f0 0x7fd3500ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95ceffd700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b8004850 0x7f95b8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7f95cf7fe700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b8003a00 0x7f95b8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.612+0000 7ff6fdeae700 1 -- start start 2023-07-07T18:15:12.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7fd356ba3700 1 -- 172.21.15.12:0/4101085146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500711f0 msgr2=0x7fd3500ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.613+0000 7fd356ba3700 1 --2- 172.21.15.12:0/4101085146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500711f0 0x7fd3500ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7fd356ba3700 1 -- 172.21.15.12:0/4101085146 >> v1:172.21.15.12:6789/0 conn(0x7fd3500cab90 legacy=0x7fd350070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7fd356ba3700 1 -- 172.21.15.12:0/4101085146 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3500cd250 con 0x7fd3500caf60 2023-07-07T18:15:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7fd356ba3700 1 --2- 172.21.15.12:0/4101085146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3500caf60 0x7fd350164be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd348009d90 tx=0x7fd34800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58097e5a4ea1663 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6fdeae700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f80cba20 0x7ff6f8150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6fdeae700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6f80cc970 0x7ff6f81ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6fdeae700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f8159270 0x7ff6f80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6fdeae700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f81eda90 con 0x7ff6f80cba20 2023-07-07T18:15:12.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6fdeae700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f81ee010 con 0x7ff6f8159270 2023-07-07T18:15:12.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6fdeae700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f8151020 con 0x7ff6f80cc970 2023-07-07T18:15:12.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7f95ceffd700 1 -- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b8003a00 msgr2=0x7f95b8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7f95ceffd700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95b8003a00 0x7f95b8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7f95ceffd700 1 -- 172.21.15.12:0/4254502136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8005200 msgr2=0x7f95b800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7f95ceffd700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8005200 0x7f95b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7f95ceffd700 1 -- 172.21.15.12:0/4254502136 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d00cce00 con 0x7f95b8004850 2023-07-07T18:15:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7fd3553a0700 1 -- 172.21.15.12:0/4101085146 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34800e070 con 0x7fd3500caf60 2023-07-07T18:15:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7fd3553a0700 1 -- 172.21.15.12:0/4101085146 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34800bb20 con 0x7fd3500caf60 2023-07-07T18:15:12.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f80cba20 0x7ff6f8150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7f95cffff700 1 -- 172.21.15.12:0/4254502136 reap_dead start 2023-07-07T18:15:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6f77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f80cba20 0x7ff6f8150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57344/0 (socket says 172.21.15.12:57344) 2023-07-07T18:15:12.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7f3d797fa700 1 -- 172.21.15.12:0/1160012662 <== osd.0 v2:172.21.15.12:6808/1157853369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3d640776e0 con 0x7f3d64074be0 2023-07-07T18:15:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6f77fe700 1 -- 172.21.15.12:0/1787890481 learned_addr learned my addr 172.21.15.12:0/1787890481 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7fd3553a0700 1 -- 172.21.15.12:0/4101085146 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34800be90 con 0x7fd3500caf60 2023-07-07T18:15:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6f77fe700 1 -- 172.21.15.12:0/1787890481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6f80cc970 msgr2=0x7ff6f81ee4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6f77fe700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6f80cc970 0x7ff6f81ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6f77fe700 1 -- 172.21.15.12:0/1787890481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f8159270 msgr2=0x7ff6f80c7660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-07T18:15:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.614+0000 7ff6f77fe700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6f8159270 0x7ff6f80c7660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7ff6f77fe700 1 -- 172.21.15.12:0/1787890481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f000ab80 con 0x7ff6f80cba20 2023-07-07T18:15:12.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7ff6f77fe700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f80cba20 0x7ff6f8150ae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800e870 tx=0x7ff6e800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7fd358606700 1 -- 172.21.15.12:0/4101085146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3500caf60 msgr2=0x7fd350164be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7fd358606700 1 --2- 172.21.15.12:0/4101085146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3500caf60 0x7fd350164be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd348009d90 tx=0x7fd34800b330 comp rx=0 tx=0).stop 2023-07-07T18:15:12.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7ff6dffff700 1 -- 172.21.15.12:0/1787890481 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e800ee70 con 0x7ff6f80cba20 2023-07-07T18:15:12.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7ff6dffff700 1 -- 172.21.15.12:0/1787890481 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e800c850 con 0x7ff6f80cba20 2023-07-07T18:15:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7ff6dffff700 1 -- 172.21.15.12:0/1787890481 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e800cbc0 con 0x7ff6f80cba20 2023-07-07T18:15:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7f95ceffd700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b8004850 0x7f95b8004cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009860 tx=0x7f95b8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3d4448c5a731fe3 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f81edcc0 con 0x7ff6f80cba20 2023-07-07T18:15:12.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f80c8390 con 0x7ff6f80cba20 2023-07-07T18:15:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7f310dffb700 1 -- 172.21.15.12:0/4064615809 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310800e070 con 0x7f31100cc260 2023-07-07T18:15:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7f310dffb700 1 -- 172.21.15.12:0/4064615809 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310800b910 con 0x7f31100cc260 2023-07-07T18:15:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7f310dffb700 1 -- 172.21.15.12:0/4064615809 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310800bcc0 con 0x7f31100cc260 2023-07-07T18:15:12.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7fd358606700 1 -- 172.21.15.12:0/4101085146 shutdown_connections 2023-07-07T18:15:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7fd358606700 1 --2- 172.21.15.12:0/4101085146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3500caf60 0x7fd350164be0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7fd358606700 1 --2- 172.21.15.12:0/4101085146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500711f0 0x7fd3500ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7fd358606700 1 -- 172.21.15.12:0/4101085146 >> 172.21.15.12:0/4101085146 conn(0x7fd3500b1740 msgr2=0x7fd35006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7fd358606700 1 -- 172.21.15.12:0/4101085146 shutdown_connections 2023-07-07T18:15:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7fd358606700 1 -- 172.21.15.12:0/4101085146 wait complete. 2023-07-07T18:15:12.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6f815c2b0 con 0x7ff6f80cba20 2023-07-07T18:15:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7faf2e7ef700 1 -- 172.21.15.12:0/3075814696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf280893f0 msgr2=0x7faf28174d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7faf2e7ef700 1 --2- 172.21.15.12:0/3075814696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf280893f0 0x7faf28174d10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faf20009e80 tx=0x7faf2000b330 comp rx=0 tx=0).stop 2023-07-07T18:15:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7faf2e7ef700 1 -- 172.21.15.12:0/3075814696 shutdown_connections 2023-07-07T18:15:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7faf2e7ef700 1 --2- 172.21.15.12:0/3075814696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf280893f0 0x7faf28174d10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7faf2e7ef700 1 -- 172.21.15.12:0/3075814696 >> 172.21.15.12:0/3075814696 conn(0x7faf280b0260 msgr2=0x7faf280b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7faf2e7ef700 1 -- 172.21.15.12:0/3075814696 shutdown_connections 2023-07-07T18:15:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c000c070 con 0x7f95b8004850 2023-07-07T18:15:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0013610 con 0x7f95b8004850 2023-07-07T18:15:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.615+0000 7f95ce7fc700 1 -- 172.21.15.12:0/4254502136 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00139a0 con 0x7f95b8004850 2023-07-07T18:15:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7f95d5ffd700 1 -- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b8004850 msgr2=0x7f95b8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7f95d5ffd700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b8004850 0x7f95b8004cc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009860 tx=0x7f95b8005880 comp rx=0 tx=0).stop 2023-07-07T18:15:12.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7f95d5ffd700 1 -- 172.21.15.12:0/4254502136 shutdown_connections 2023-07-07T18:15:12.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7f95d5ffd700 1 --2- 172.21.15.12:0/4254502136 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95b8004850 0x7f95b8004cc0 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009860 tx=0x7f95b8005880 comp rx=0 tx=0).stop 2023-07-07T18:15:12.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.616+0000 7f95d5ffd700 1 -- 172.21.15.12:0/4254502136 >> 172.21.15.12:0/4254502136 conn(0x7f95d00b1740 msgr2=0x7f95d006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.617+0000 7faf2e7ef700 1 -- 172.21.15.12:0/3075814696 wait complete. 2023-07-07T18:15:12.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.617+0000 7f3115837700 1 -- 172.21.15.12:0/4064615809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31100cc260 msgr2=0x7f31100cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.617+0000 7f3115837700 1 --2- 172.21.15.12:0/4064615809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31100cc260 0x7f31100cb760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31100b1320 tx=0x7f310800b330 comp rx=0 tx=0).stop 2023-07-07T18:15:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.617+0000 7f3115837700 1 -- 172.21.15.12:0/4064615809 shutdown_connections 2023-07-07T18:15:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.617+0000 7f3115837700 1 --2- 172.21.15.12:0/4064615809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31100cb390 0x7f31100cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.617+0000 7f3115837700 1 --2- 172.21.15.12:0/4064615809 >> v2:172.21.15.12:3300/0 conn(0x7f311006c060 0x7f311006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.617+0000 7f3115837700 1 --2- 172.21.15.12:0/4064615809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31100cc260 0x7f31100cb760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.617+0000 7f3115837700 1 -- 172.21.15.12:0/4064615809 >> 172.21.15.12:0/4064615809 conn(0x7f31100b0260 msgr2=0x7f31100b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.617+0000 7ff6dffff700 1 -- 172.21.15.12:0/1787890481 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6e800cd20 con 0x7ff6f80cba20 2023-07-07T18:15:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.618+0000 7f3115837700 1 -- 172.21.15.12:0/4064615809 shutdown_connections 2023-07-07T18:15:12.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.618+0000 7ff6dffff700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff6e406ace0 0x7ff6e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.618+0000 7fd358606700 1 Processor -- start 2023-07-07T18:15:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7faf2e7ef700 1 Processor -- start 2023-07-07T18:15:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.618+0000 7f3115837700 1 -- 172.21.15.12:0/4064615809 wait complete. 2023-07-07T18:15:12.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7f3115837700 1 Processor -- start 2023-07-07T18:15:12.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7f95d5ffd700 1 -- 172.21.15.12:0/4254502136 shutdown_connections 2023-07-07T18:15:12.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.618+0000 7ff6dffff700 1 -- 172.21.15.12:0/1787890481 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff6e8089770 con 0x7ff6f80cba20 2023-07-07T18:15:12.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.618+0000 7ff6dffff700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.12:6816/2583051658,v1:172.21.15.12:6817/2583051658] conn(0x7ff6e4074930 0x7ff6e4076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.618+0000 7ff6dffff700 1 -- 172.21.15.12:0/1787890481 --> [v2:172.21.15.12:6816/2583051658,v1:172.21.15.12:6817/2583051658] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6e4077430 con 0x7ff6e4074930 2023-07-07T18:15:12.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.618+0000 7ff6dffff700 1 -- 172.21.15.12:0/1787890481 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6e808be30 con 0x7ff6f80cba20 2023-07-07T18:15:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7ff6f6ffd700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff6e406ace0 0x7ff6e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7ff6f6ffd700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff6e406ace0 0x7ff6e406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80aea40 tx=0x7ff6ec009230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7faf2e7ef700 1 -- start start 2023-07-07T18:15:12.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf2e7ef700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2806a160 0x7faf280b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf2e7ef700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806a530 0x7faf28207f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf2e7ef700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf280893f0 0x7faf281fdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf2e7ef700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf280b3710 con 0x7faf280893f0 2023-07-07T18:15:12.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf2e7ef700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf282084b0 con 0x7faf2806a160 2023-07-07T18:15:12.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf2e7ef700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf280b2b90 con 0x7faf2806a530 2023-07-07T18:15:12.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf27fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2806a160 0x7faf280b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf27fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2806a160 0x7faf280b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:52966/0 (socket says 172.21.15.12:52966) 2023-07-07T18:15:12.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf27fff700 1 -- 172.21.15.12:0/726827873 learned_addr learned my addr 172.21.15.12:0/726827873 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7faf277fe700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806a530 0x7faf28207f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7faf277fe700 1 -- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2806a160 msgr2=0x7faf280b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7faf277fe700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf2806a160 0x7faf280b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7faf277fe700 1 -- 172.21.15.12:0/726827873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf280893f0 msgr2=0x7faf281fdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7faf277fe700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf280893f0 0x7faf281fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7faf277fe700 1 -- 172.21.15.12:0/726827873 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf20009b30 con 0x7faf2806a530 2023-07-07T18:15:12.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7faf277fe700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806a530 0x7faf28207f70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c3e0 tx=0x7faf1c00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7f95d5ffd700 1 -- 172.21.15.12:0/4254502136 wait complete. 2023-07-07T18:15:12.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7f95d5ffd700 1 Processor -- start 2023-07-07T18:15:12.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.618+0000 7fd358606700 1 -- start start 2023-07-07T18:15:12.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7fd358606700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3500711f0 0x7fd3500c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7fd358606700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3500cab90 0x7fd3500b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7fd358606700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500caf60 0x7fd3500b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7fd358606700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500c8ba0 con 0x7fd3500cab90 2023-07-07T18:15:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7fd358606700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500c81d0 con 0x7fd3500711f0 2023-07-07T18:15:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.619+0000 7fd358606700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500c75c0 con 0x7fd3500caf60 2023-07-07T18:15:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7fd355ba1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3500cab90 0x7fd3500b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7fd356ba3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500caf60 0x7fd3500b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7fd355ba1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3500cab90 0x7fd3500b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57356/0 (socket says 172.21.15.12:57356) 2023-07-07T18:15:12.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7fd355ba1700 1 -- 172.21.15.12:0/150696651 learned_addr learned my addr 172.21.15.12:0/150696651 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7fd3563a2700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3500711f0 0x7fd3500c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7ff6f7fff700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.12:6816/2583051658,v1:172.21.15.12:6817/2583051658] conn(0x7ff6e4074930 0x7ff6e4076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7fd355ba1700 1 -- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500caf60 msgr2=0x7fd3500b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7fd355ba1700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500caf60 0x7fd3500b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7fd355ba1700 1 -- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3500711f0 msgr2=0x7fd3500c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7fd355ba1700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3500711f0 0x7fd3500c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7fd355ba1700 1 -- 172.21.15.12:0/150696651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348009a70 con 0x7fd3500cab90 2023-07-07T18:15:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f3650f26700 1 Processor -- start 2023-07-07T18:15:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7fd3563a2700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3500711f0 0x7fd3500c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7fd356ba3700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3500caf60 0x7fd3500b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7fd355ba1700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3500cab90 0x7fd3500b3200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00e840 tx=0x7fd34c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7ff6f7fff700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.12:6816/2583051658,v1:172.21.15.12:6817/2583051658] conn(0x7ff6e4074930 0x7ff6e4076d60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7faf24ff9700 1 -- 172.21.15.12:0/726827873 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0054e0 con 0x7faf2806a530 2023-07-07T18:15:12.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7faf24ff9700 1 -- 172.21.15.12:0/726827873 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c003680 con 0x7faf2806a530 2023-07-07T18:15:12.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7faf24ff9700 1 -- 172.21.15.12:0/726827873 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c003a30 con 0x7faf2806a530 2023-07-07T18:15:12.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.620+0000 7f3115837700 1 -- start start 2023-07-07T18:15:12.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7f3115837700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311006c060 0x7f311016b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f3115837700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31100cb390 0x7f31100b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f3115837700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31100cc260 0x7f31100c1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f3115837700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31100afba0 con 0x7f31100cb390 2023-07-07T18:15:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f3115837700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31100c5090 con 0x7f31100cc260 2023-07-07T18:15:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f3115837700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31100af620 con 0x7f311006c060 2023-07-07T18:15:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f310e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31100cb390 0x7f31100b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f310e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31100cb390 0x7f31100b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57366/0 (socket says 172.21.15.12:57366) 2023-07-07T18:15:12.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f310e7fc700 1 -- 172.21.15.12:0/1340869054 learned_addr learned my addr 172.21.15.12:0/1340869054 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f310f7fe700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31100cc260 0x7f31100c1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.622+0000 7f3650f26700 1 -- start start 2023-07-07T18:15:12.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.621+0000 7f95d5ffd700 1 -- start start 2023-07-07T18:15:12.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f310e7fc700 1 -- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311006c060 msgr2=0x7f311016b1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T18:15:12.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f310e7fc700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311006c060 0x7f311016b1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f310e7fc700 1 -- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31100cc260 msgr2=0x7f31100c1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f310e7fc700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31100cc260 0x7f31100c1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f310e7fc700 1 -- 172.21.15.12:0/1340869054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3108009b30 con 0x7f31100cb390 2023-07-07T18:15:12.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f310e7fc700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31100cb390 0x7f31100b39a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f310800b680 tx=0x7f3108004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7fd346ffd700 1 -- 172.21.15.12:0/150696651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c009590 con 0x7fd3500cab90 2023-07-07T18:15:12.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7fd346ffd700 1 -- 172.21.15.12:0/150696651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c013680 con 0x7fd3500cab90 2023-07-07T18:15:12.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7fd346ffd700 1 -- 172.21.15.12:0/150696651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c013a30 con 0x7fd3500cab90 2023-07-07T18:15:12.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3500c78a0 con 0x7fd3500cab90 2023-07-07T18:15:12.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3500c7e60 con 0x7fd3500cab90 2023-07-07T18:15:12.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f3650f26700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f364c06d280 0x7f364c0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f3650f26700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c15bfd0 con 0x7f364c0cb4e0 2023-07-07T18:15:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f3650f26700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364c15c2b0 con 0x7f364c0b0d40 2023-07-07T18:15:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f3650f26700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364c1586a0 con 0x7f364c06d280 2023-07-07T18:15:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f364a59c700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f364c0b0d40 0x7f364c159000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:47814/0 (socket says 172.21.15.12:47814) 2023-07-07T18:15:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f364a59c700 1 -- 172.21.15.12:0/2644860318 learned_addr learned my addr 172.21.15.12:0/2644860318 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:12.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f364ad9d700 1 --2- 172.21.15.12:0/2644860318 >> v2:172.21.15.160:3300/0 conn(0x7f364c06d280 0x7f364c0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95d5ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d015ec80 0x7f95d00b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95d5ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d015f050 0x7f95d0151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95d5ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95d0152380 0x7f95d0152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95d5ffd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00b4a00 con 0x7f95d0152380 2023-07-07T18:15:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95d5ffd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00c8ea0 con 0x7f95d015ec80 2023-07-07T18:15:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95d5ffd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00b2340 con 0x7f95d015f050 2023-07-07T18:15:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95cf7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d015ec80 0x7f95d00b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95ceffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d015f050 0x7f95d0151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95ceffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d015f050 0x7f95d0151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46462/0 (socket says 172.21.15.12:46462) 2023-07-07T18:15:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95ceffd700 1 -- 172.21.15.12:0/641571827 learned_addr learned my addr 172.21.15.12:0/641571827 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7f95cffff700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95d0152380 0x7f95d0152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f95ceffd700 1 -- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d015ec80 msgr2=0x7f95d00b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f95ceffd700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d015ec80 0x7f95d00b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f95ceffd700 1 -- 172.21.15.12:0/641571827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95d0152380 msgr2=0x7f95d0152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f95ceffd700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95d0152380 0x7f95d0152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f95ceffd700 1 -- 172.21.15.12:0/641571827 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d00b43f0 con 0x7f95d015f050 2023-07-07T18:15:12.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f364959a700 1 -- 172.21.15.12:0/2644860318 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868390645 0 0) 0x7f364c15c2b0 con 0x7f364c0b0d40 2023-07-07T18:15:12.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f364959a700 1 -- 172.21.15.12:0/2644860318 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36340035b0 con 0x7f364c0b0d40 2023-07-07T18:15:12.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f95ceffd700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d015f050 0x7f95d0151e40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c270 tx=0x7f95c00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf280b2e70 con 0x7faf2806a530 2023-07-07T18:15:12.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.623+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf280b3430 con 0x7faf2806a530 2023-07-07T18:15:12.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f364ad9d700 1 -- 172.21.15.12:0/2644860318 >> v1:172.21.15.160:6789/0 conn(0x7f364c0b0d40 legacy=0x7f364c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f364ad9d700 1 -- 172.21.15.12:0/2644860318 >> v1:172.21.15.12:6789/0 conn(0x7f364c0cb4e0 legacy=0x7f364c0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7f364ad9d700 1 -- 172.21.15.12:0/2644860318 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c15f0b0 con 0x7f364c06d280 2023-07-07T18:15:12.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.624+0000 7ff6dffff700 1 -- 172.21.15.12:0/1787890481 <== osd.2 v2:172.21.15.12:6816/2583051658 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff6e4077430 con 0x7ff6e4074930 2023-07-07T18:15:12.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf280cc4b0 con 0x7faf2806a530 2023-07-07T18:15:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f364ad9d700 1 --2- 172.21.15.12:0/2644860318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c06d280 0x7f364c0cb960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3644009d90 tx=0x7f364400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55621dd363a137d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f364959a700 1 -- 172.21.15.12:0/2644860318 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364400e070 con 0x7f364c06d280 2023-07-07T18:15:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f364959a700 1 -- 172.21.15.12:0/2644860318 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364400bb20 con 0x7f364c06d280 2023-07-07T18:15:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f364959a700 1 -- 172.21.15.12:0/2644860318 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644012430 con 0x7f364c06d280 2023-07-07T18:15:12.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f30f7fff700 1 -- 172.21.15.12:0/1340869054 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108004250 con 0x7f31100cb390 2023-07-07T18:15:12.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f30f7fff700 1 -- 172.21.15.12:0/1340869054 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080043b0 con 0x7f31100cb390 2023-07-07T18:15:12.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f30f7fff700 1 -- 172.21.15.12:0/1340869054 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108004740 con 0x7f31100cb390 2023-07-07T18:15:12.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f3650f26700 1 -- 172.21.15.12:0/2644860318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c06d280 msgr2=0x7f364c0cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f3650f26700 1 --2- 172.21.15.12:0/2644860318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c06d280 0x7f364c0cb960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3644009d90 tx=0x7f364400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:12.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f95b7fff700 1 -- 172.21.15.12:0/641571827 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c0004240 con 0x7f95d015f050 2023-07-07T18:15:12.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f95b7fff700 1 -- 172.21.15.12:0/641571827 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c00043a0 con 0x7f95d015f050 2023-07-07T18:15:12.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f95b7fff700 1 -- 172.21.15.12:0/641571827 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00036a0 con 0x7f95d015f050 2023-07-07T18:15:12.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d00c8bc0 con 0x7f95d015f050 2023-07-07T18:15:12.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.625+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d00c8870 con 0x7f95d015f050 2023-07-07T18:15:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31100af8c0 con 0x7f31100cb390 2023-07-07T18:15:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31100c4870 con 0x7f31100cb390 2023-07-07T18:15:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f3650f26700 1 -- 172.21.15.12:0/2644860318 shutdown_connections 2023-07-07T18:15:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f3650f26700 1 --2- 172.21.15.12:0/2644860318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c06d280 0x7f364c0cb960 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f3650f26700 1 -- 172.21.15.12:0/2644860318 >> 172.21.15.12:0/2644860318 conn(0x7f364c0b0260 msgr2=0x7f364c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f79f597d700 1 Processor -- start 2023-07-07T18:15:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f3650f26700 1 -- 172.21.15.12:0/2644860318 shutdown_connections 2023-07-07T18:15:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.627+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f311006a420 con 0x7f31100cb390 2023-07-07T18:15:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f79f597d700 1 -- start start 2023-07-07T18:15:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.626+0000 7f3650f26700 1 -- 172.21.15.12:0/2644860318 wait complete. 2023-07-07T18:15:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.627+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd338000fc0 con 0x7fd3500cab90 2023-07-07T18:15:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f79f597d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f79f006e810 0x7f79f00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f79f597d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f79f00ccc30 0x7f79f0070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f79f597d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f015c030 con 0x7f79f0158360 2023-07-07T18:15:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f79f597d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f015c280 con 0x7f79f006e810 2023-07-07T18:15:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f79f597d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f015c560 con 0x7f79f00ccc30 2023-07-07T18:15:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f79ef7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f79f00ccc30 0x7f79f0070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f79ef7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f79f00ccc30 0x7f79f0070650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:52990/0 (socket says 172.21.15.12:52990) 2023-07-07T18:15:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f79ef7fe700 1 -- 172.21.15.12:0/3575140426 learned_addr learned my addr 172.21.15.12:0/3575140426 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f3650f26700 1 Processor -- start 2023-07-07T18:15:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7faf24ff9700 1 -- 172.21.15.12:0/726827873 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faf1c003b90 con 0x7faf2806a530 2023-07-07T18:15:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.628+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95d00ce620 con 0x7f95d015f050 2023-07-07T18:15:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7fd346ffd700 1 -- 172.21.15.12:0/150696651 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd34c013b90 con 0x7fd3500cab90 2023-07-07T18:15:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7fd346ffd700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd33406adb0 0x7fd33406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7fd346ffd700 1 -- 172.21.15.12:0/150696651 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd34c089e80 con 0x7fd3500cab90 2023-07-07T18:15:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7fd3563a2700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd33406adb0 0x7fd33406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7fd346ffd700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.12:6800/4008469182,v1:172.21.15.12:6801/4008469182] conn(0x7fd334074a00 0x7fd334076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7fd346ffd700 1 -- 172.21.15.12:0/150696651 --> [v2:172.21.15.12:6800/4008469182,v1:172.21.15.12:6801/4008469182] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd334077500 con 0x7fd334074a00 2023-07-07T18:15:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7fd356ba3700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.12:6800/4008469182,v1:172.21.15.12:6801/4008469182] conn(0x7fd334074a00 0x7fd334076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7faf24ff9700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf1406ad30 0x7faf1406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7faf24ff9700 1 -- 172.21.15.12:0/726827873 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faf1c089290 con 0x7faf2806a530 2023-07-07T18:15:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7faf24ff9700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.12:6820/3873602064,v1:172.21.15.12:6822/3873602064] conn(0x7faf14074a00 0x7faf14076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7faf24ff9700 1 -- 172.21.15.12:0/726827873 --> [v2:172.21.15.12:6820/3873602064,v1:172.21.15.12:6822/3873602064] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf14077500 con 0x7faf14074a00 2023-07-07T18:15:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7faf24ff9700 1 -- 172.21.15.12:0/726827873 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf1c089730 con 0x7faf2806a530 2023-07-07T18:15:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7faf2cd8c700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.12:6820/3873602064,v1:172.21.15.12:6822/3873602064] conn(0x7faf14074a00 0x7faf14076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7faf2cd8c700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.12:6820/3873602064,v1:172.21.15.12:6822/3873602064] conn(0x7faf14074a00 0x7faf14076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7f30f7fff700 1 -- 172.21.15.12:0/1340869054 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f310801c440 con 0x7f31100cb390 2023-07-07T18:15:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f30f7fff700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f30fc06adb0 0x7f30fc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f30f7fff700 1 -- 172.21.15.12:0/1340869054 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f310808b140 con 0x7f31100cb390 2023-07-07T18:15:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f30f7fff700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6816/3085703848,v1:172.21.15.160:6817/3085703848] conn(0x7f30fc074a00 0x7f30fc076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f30f7fff700 1 -- 172.21.15.12:0/1340869054 --> [v2:172.21.15.160:6816/3085703848,v1:172.21.15.160:6817/3085703848] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30fc077500 con 0x7f30fc074a00 2023-07-07T18:15:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7f3650f26700 1 -- start start 2023-07-07T18:15:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f3650f26700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c06d280 0x7f364c0c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f3650f26700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c0b0d40 0x7f364c1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f3650f26700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f364c0cb4e0 0x7f364c0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f3650f26700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c0c2700 con 0x7f364c06d280 2023-07-07T18:15:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f3650f26700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c15dfb0 con 0x7f364c0b0d40 2023-07-07T18:15:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f3650f26700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c15e290 con 0x7f364c0cb4e0 2023-07-07T18:15:12.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7f79ef7fe700 1 -- 172.21.15.12:0/3575140426 >> v2:172.21.15.12:3300/0 conn(0x7f79f006e810 msgr2=0x7f79f00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7f79ef7fe700 1 --2- 172.21.15.12:0/3575140426 >> v2:172.21.15.12:3300/0 conn(0x7f79f006e810 0x7f79f00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7f79ef7fe700 1 -- 172.21.15.12:0/3575140426 >> v1:172.21.15.160:6789/0 conn(0x7f79f0158360 legacy=0x7f79f006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7f79ef7fe700 1 -- 172.21.15.12:0/3575140426 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f015c840 con 0x7f79f00ccc30 2023-07-07T18:15:12.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.629+0000 7f79ef7fe700 1 --2- 172.21.15.12:0/3575140426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f00ccc30 0x7f79f0070650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79f00cd470 tx=0x7f79e000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f819fbde83697a71 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f95b7fff700 1 -- 172.21.15.12:0/641571827 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95c0003800 con 0x7f95d015f050 2023-07-07T18:15:12.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f79edffb700 1 -- 172.21.15.12:0/3575140426 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0010070 con 0x7f79f00ccc30 2023-07-07T18:15:12.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f79edffb700 1 -- 172.21.15.12:0/3575140426 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000da80 con 0x7f79f00ccc30 2023-07-07T18:15:12.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f79edffb700 1 -- 172.21.15.12:0/3575140426 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000de10 con 0x7f79f00ccc30 2023-07-07T18:15:12.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f310effd700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f30fc06adb0 0x7f30fc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f310f7fe700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6816/3085703848,v1:172.21.15.160:6817/3085703848] conn(0x7f30fc074a00 0x7f30fc076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f364ad9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f364c0cb4e0 0x7f364c0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f364ad9d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f364c0cb4e0 0x7f364c0c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46486/0 (socket says 172.21.15.12:46486) 2023-07-07T18:15:12.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f364ad9d700 1 -- 172.21.15.12:0/878682042 learned_addr learned my addr 172.21.15.12:0/878682042 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f3649d9b700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c0b0d40 0x7f364c1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7fd356ba3700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.12:6800/4008469182,v1:172.21.15.12:6801/4008469182] conn(0x7fd334074a00 0x7fd334076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7fd3563a2700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd33406adb0 0x7fd33406d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3400011e0 tx=0x7fd340009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f310effd700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f30fc06adb0 0x7f30fc06d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3104009950 tx=0x7f3104009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f310f7fe700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6816/3085703848,v1:172.21.15.160:6817/3085703848] conn(0x7f30fc074a00 0x7f30fc076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f364ad9d700 1 -- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c0b0d40 msgr2=0x7f364c1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f364ad9d700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c0b0d40 0x7f364c1572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f364ad9d700 1 -- 172.21.15.12:0/878682042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c06d280 msgr2=0x7f364c0c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f364ad9d700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f364c06d280 0x7f364c0c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f364ad9d700 1 -- 172.21.15.12:0/878682042 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644009a70 con 0x7f364c0cb4e0 2023-07-07T18:15:12.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f95b7fff700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f95b807d5b0 0x7f95b807fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.630+0000 7f95b7fff700 1 -- 172.21.15.12:0/641571827 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95c008a6a0 con 0x7f95d015f050 2023-07-07T18:15:12.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f95b7fff700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6824/3768638094,v1:172.21.15.160:6825/3768638094] conn(0x7f95b8087220 0x7f95b8089650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f95b7fff700 1 -- 172.21.15.12:0/641571827 --> [v2:172.21.15.160:6824/3768638094,v1:172.21.15.160:6825/3768638094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95b8089d20 con 0x7f95b8087220 2023-07-07T18:15:12.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f95b7fff700 1 -- 172.21.15.12:0/641571827 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95c008ccc0 con 0x7f95d015f050 2023-07-07T18:15:12.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f95cf7fe700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f95b807d5b0 0x7f95b807fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f95cffff700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6824/3768638094,v1:172.21.15.160:6825/3768638094] conn(0x7f95b8087220 0x7f95b8089650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.631+0000 7f364ad9d700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f364c0cb4e0 0x7f364c0c7bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f364c0cf790 tx=0x7f3644004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7faf24ff9700 1 -- 172.21.15.12:0/726827873 <== osd.3 v2:172.21.15.12:6820/3873602064 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faf14077500 con 0x7faf14074a00 2023-07-07T18:15:12.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f79f597d700 1 -- 172.21.15.12:0/3575140426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f00ccc30 msgr2=0x7f79f0070650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f79f597d700 1 --2- 172.21.15.12:0/3575140426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f00ccc30 0x7f79f0070650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79f00cd470 tx=0x7f79e000d330 comp rx=0 tx=0).stop 2023-07-07T18:15:12.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f363affd700 1 -- 172.21.15.12:0/878682042 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644012430 con 0x7f364c0cb4e0 2023-07-07T18:15:12.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f363affd700 1 -- 172.21.15.12:0/878682042 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3644020070 con 0x7f364c0cb4e0 2023-07-07T18:15:12.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f363affd700 1 -- 172.21.15.12:0/878682042 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3644004280 con 0x7f364c0cb4e0 2023-07-07T18:15:12.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f79f597d700 1 -- 172.21.15.12:0/3575140426 shutdown_connections 2023-07-07T18:15:12.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f79f597d700 1 --2- 172.21.15.12:0/3575140426 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f00ccc30 0x7f79f0070650 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f79f597d700 1 --2- 172.21.15.12:0/3575140426 >> v2:172.21.15.12:3300/0 conn(0x7f79f006e810 0x7f79f00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f79f597d700 1 -- 172.21.15.12:0/3575140426 >> 172.21.15.12:0/3575140426 conn(0x7f79f00cf7d0 msgr2=0x7f79f00cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f95cffff700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6824/3768638094,v1:172.21.15.160:6825/3768638094] conn(0x7f95b8087220 0x7f95b8089650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364c15e570 con 0x7f364c0cb4e0 2023-07-07T18:15:12.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364c157810 con 0x7f364c0cb4e0 2023-07-07T18:15:12.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f30f7fff700 1 -- 172.21.15.12:0/1340869054 <== osd.4 v2:172.21.15.160:6816/3085703848 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f30fc077500 con 0x7f30fc074a00 2023-07-07T18:15:12.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f79f597d700 1 -- 172.21.15.12:0/3575140426 shutdown_connections 2023-07-07T18:15:12.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.632+0000 7f79f597d700 1 -- 172.21.15.12:0/3575140426 wait complete. 2023-07-07T18:15:12.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.633+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f364c15c870 con 0x7f364c0cb4e0 2023-07-07T18:15:12.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.633+0000 7f95b7fff700 1 -- 172.21.15.12:0/641571827 <== osd.7 v2:172.21.15.160:6824/3768638094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f95b8089d20 con 0x7f95b8087220 2023-07-07T18:15:12.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.633+0000 7fd346ffd700 1 -- 172.21.15.12:0/150696651 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd34c054c20 con 0x7fd3500cab90 2023-07-07T18:15:12.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.633+0000 7f95cf7fe700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f95b807d5b0 0x7f95b807fa60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95c4000fd0 tx=0x7f95c4007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.634+0000 7f363affd700 1 -- 172.21.15.12:0/878682042 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f36440043e0 con 0x7f364c0cb4e0 2023-07-07T18:15:12.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.634+0000 7f363affd700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f363406b140 0x7f363406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.634+0000 7f363affd700 1 -- 172.21.15.12:0/878682042 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3644022070 con 0x7f364c0cb4e0 2023-07-07T18:15:12.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.634+0000 7f79f597d700 1 Processor -- start 2023-07-07T18:15:12.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.635+0000 7f364a59c700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f363406b140 0x7f363406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.635+0000 7f363affd700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6808/1176835465,v1:172.21.15.160:6809/1176835465] conn(0x7f3634074e10 0x7f3634077240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.635+0000 7f363affd700 1 -- 172.21.15.12:0/878682042 --> [v2:172.21.15.160:6808/1176835465,v1:172.21.15.160:6809/1176835465] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3634077910 con 0x7f3634074e10 2023-07-07T18:15:12.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.635+0000 7f363affd700 1 -- 172.21.15.12:0/878682042 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f364408bea0 con 0x7f364c0cb4e0 2023-07-07T18:15:12.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.635+0000 7f3649d9b700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6808/1176835465,v1:172.21.15.160:6809/1176835465] conn(0x7f3634074e10 0x7f3634077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.635+0000 7f79f597d700 1 -- start start 2023-07-07T18:15:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.635+0000 7f364a59c700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f363406b140 0x7f363406d5f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36400016b0 tx=0x7f36400079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.635+0000 7f3649d9b700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6808/1176835465,v1:172.21.15.160:6809/1176835465] conn(0x7f3634074e10 0x7f3634077240 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.636+0000 7f363affd700 1 -- 172.21.15.12:0/878682042 <== osd.5 v2:172.21.15.160:6808/1176835465 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3634077910 con 0x7f3634074e10 2023-07-07T18:15:12.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.636+0000 7f79f597d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f006e810 0x7f79f00b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.636+0000 7f79f597d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79f00ccc30 0x7f79f0152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.636+0000 7f79f597d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79f0158360 0x7f79f01e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.636+0000 7f79f597d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01e3ca0 con 0x7f79f0158360 2023-07-07T18:15:12.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.636+0000 7f79f597d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0153d40 con 0x7f79f006e810 2023-07-07T18:15:12.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.636+0000 7f79f597d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01e3300 con 0x7f79f00ccc30 2023-07-07T18:15:12.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ee7fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79f00ccc30 0x7f79f0152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ee7fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79f00ccc30 0x7f79f0152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46504/0 (socket says 172.21.15.12:46504) 2023-07-07T18:15:12.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ee7fc700 1 -- 172.21.15.12:0/3850252276 learned_addr learned my addr 172.21.15.12:0/3850252276 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79eeffd700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f006e810 0x7f79f00b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ef7fe700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79f0158360 0x7f79f01e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ee7fc700 1 -- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f006e810 msgr2=0x7f79f00b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ee7fc700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79f006e810 0x7f79f00b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ee7fc700 1 -- 172.21.15.12:0/3850252276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79f0158360 msgr2=0x7f79f01e40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ee7fc700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79f0158360 0x7f79f01e40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ee7fc700 1 -- 172.21.15.12:0/3850252276 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00085d0 con 0x7f79f00ccc30 2023-07-07T18:15:12.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79ee7fc700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79f00ccc30 0x7f79f0152ca0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b4d0 tx=0x7f79e400b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79d7fff700 1 -- 172.21.15.12:0/3850252276 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4011830 con 0x7f79f00ccc30 2023-07-07T18:15:12.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79d7fff700 1 -- 172.21.15.12:0/3850252276 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4011990 con 0x7f79f00ccc30 2023-07-07T18:15:12.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.637+0000 7f79d7fff700 1 -- 172.21.15.12:0/3850252276 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4011d40 con 0x7f79f00ccc30 2023-07-07T18:15:12.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.638+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f01e35e0 con 0x7f79f00ccc30 2023-07-07T18:15:12.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.639+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f01531e0 con 0x7f79f00ccc30 2023-07-07T18:15:12.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.640+0000 7fd346ffd700 1 -- 172.21.15.12:0/150696651 <== osd.1 v2:172.21.15.12:6800/4008469182 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd334077500 con 0x7fd334074a00 2023-07-07T18:15:12.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.641+0000 7f79d7fff700 1 -- 172.21.15.12:0/3850252276 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79e401a400 con 0x7f79f00ccc30 2023-07-07T18:15:12.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.641+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f79f00cd0d0 con 0x7f79f00ccc30 2023-07-07T18:15:12.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.641+0000 7f79d7fff700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f79dc06ace0 0x7f79dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.641+0000 7f79d7fff700 1 -- 172.21.15.12:0/3850252276 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f79e4088860 con 0x7f79f00ccc30 2023-07-07T18:15:12.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.642+0000 7f79eeffd700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f79dc06ace0 0x7f79dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.642+0000 7f79d7fff700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6800/458823933,v1:172.21.15.160:6801/458823933] conn(0x7f79dc074930 0x7f79dc076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.642+0000 7f79d7fff700 1 -- 172.21.15.12:0/3850252276 --> [v2:172.21.15.160:6800/458823933,v1:172.21.15.160:6801/458823933] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79dc077430 con 0x7f79dc074930 2023-07-07T18:15:12.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.642+0000 7f79d7fff700 1 -- 172.21.15.12:0/3850252276 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79e4088be0 con 0x7f79f00ccc30 2023-07-07T18:15:12.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.642+0000 7f79ef7fe700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6800/458823933,v1:172.21.15.160:6801/458823933] conn(0x7f79dc074930 0x7f79dc076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.642+0000 7f79eeffd700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f79dc06ace0 0x7f79dc06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f79e80012e0 tx=0x7f79e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.642+0000 7f79ef7fe700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6800/458823933,v1:172.21.15.160:6801/458823933] conn(0x7f79dc074930 0x7f79dc076d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.642+0000 7f30f7fff700 1 -- 172.21.15.12:0/1340869054 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3108056090 con 0x7f31100cb390 2023-07-07T18:15:12.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.643+0000 7f79d7fff700 1 -- 172.21.15.12:0/3850252276 <== osd.6 v2:172.21.15.160:6800/458823933 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f79dc077430 con 0x7f79dc074930 2023-07-07T18:15:12.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.648+0000 7faf27fff700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf1406ad30 0x7faf1406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.648+0000 7faf27fff700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf1406ad30 0x7faf1406d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf180017e0 tx=0x7faf18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.649+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 --> [v2:172.21.15.12:6808/1157853369,v1:172.21.15.12:6809/1157853369] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3d7c15c2b0 con 0x7f3d64074be0 2023-07-07T18:15:12.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.649+0000 7f3d797fa700 1 -- 172.21.15.12:0/1160012662 <== osd.0 v2:172.21.15.12:6808/1157853369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3d70007ea0 con 0x7f3d64074be0 2023-07-07T18:15:12.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 >> [v2:172.21.15.12:6808/1157853369,v1:172.21.15.12:6809/1157853369] conn(0x7f3d64074be0 msgr2=0x7f3d64077010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.12:6808/1157853369,v1:172.21.15.12:6809/1157853369] conn(0x7f3d64074be0 0x7f3d64077010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d6406af10 msgr2=0x7f3d6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d6406af10 0x7f3d6406d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009a70 tx=0x7f3d6c009210 comp rx=0 tx=0).stop 2023-07-07T18:15:12.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 msgr2=0x7f3d7c0ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 --2- 172.21.15.12:0/1160012662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d7c0cb4e0 0x7f3d7c0ae380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d74000f80 tx=0x7f3d74004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d8164c700 1 -- 172.21.15.12:0/1160012662 reap_dead start 2023-07-07T18:15:12.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 shutdown_connections 2023-07-07T18:15:12.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 >> 172.21.15.12:0/1160012662 conn(0x7f3d7c0b0260 msgr2=0x7f3d7c14e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 shutdown_connections 2023-07-07T18:15:12.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.650+0000 7f3d830af700 1 -- 172.21.15.12:0/1160012662 wait complete. 2023-07-07T18:15:12.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.655+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 --> [v2:172.21.15.12:6816/2583051658,v1:172.21.15.12:6817/2583051658] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff6f815bfd0 con 0x7ff6e4074930 2023-07-07T18:15:12.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.655+0000 7ff6dffff700 1 -- 172.21.15.12:0/1787890481 <== osd.2 v2:172.21.15.12:6816/2583051658 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff6f000a520 con 0x7ff6e4074930 2023-07-07T18:15:12.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.659+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 --> [v2:172.21.15.12:6820/3873602064,v1:172.21.15.12:6822/3873602064] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf280ade80 con 0x7faf14074a00 2023-07-07T18:15:12.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.659+0000 7faf24ff9700 1 -- 172.21.15.12:0/726827873 <== osd.3 v2:172.21.15.12:6820/3873602064 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faf200094f0 con 0x7faf14074a00 2023-07-07T18:15:12.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.660+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 >> [v2:172.21.15.12:6816/2583051658,v1:172.21.15.12:6817/2583051658] conn(0x7ff6e4074930 msgr2=0x7ff6e4076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.660+0000 7ff6fdeae700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.12:6816/2583051658,v1:172.21.15.12:6817/2583051658] conn(0x7ff6e4074930 0x7ff6e4076d60 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.660+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff6e406ace0 msgr2=0x7ff6e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.660+0000 7ff6fdeae700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff6e406ace0 0x7ff6e406d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80aea40 tx=0x7ff6ec009230 comp rx=0 tx=0).stop 2023-07-07T18:15:12.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.660+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f80cba20 msgr2=0x7ff6f8150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.660+0000 7ff6fdeae700 1 --2- 172.21.15.12:0/1787890481 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6f80cba20 0x7ff6f8150ae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800e870 tx=0x7ff6e800ec30 comp rx=0 tx=0).stop 2023-07-07T18:15:12.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.660+0000 7ff6f7fff700 1 -- 172.21.15.12:0/1787890481 reap_dead start 2023-07-07T18:15:12.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.660+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 shutdown_connections 2023-07-07T18:15:12.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.660+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 >> 172.21.15.12:0/1787890481 conn(0x7ff6f80b0260 msgr2=0x7ff6f80cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.661+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 >> [v2:172.21.15.12:6820/3873602064,v1:172.21.15.12:6822/3873602064] conn(0x7faf14074a00 msgr2=0x7faf14076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.661+0000 7faf2e7ef700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.12:6820/3873602064,v1:172.21.15.12:6822/3873602064] conn(0x7faf14074a00 0x7faf14076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.661+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 --> [v2:172.21.15.160:6808/1176835465,v1:172.21.15.160:6809/1176835465] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3630000f80 con 0x7f3634074e10 2023-07-07T18:15:12.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.661+0000 7f363affd700 1 -- 172.21.15.12:0/878682042 <== osd.5 v2:172.21.15.160:6808/1176835465 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3630000f80 con 0x7f3634074e10 2023-07-07T18:15:12.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.662+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6808/1176835465,v1:172.21.15.160:6809/1176835465] conn(0x7f3634074e10 msgr2=0x7f3634077240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.662+0000 7f3650f26700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6808/1176835465,v1:172.21.15.160:6809/1176835465] conn(0x7f3634074e10 0x7f3634077240 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.662+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f363406b140 msgr2=0x7f363406d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.662+0000 7f3650f26700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f363406b140 0x7f363406d5f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36400016b0 tx=0x7f36400079c0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.662+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f364c0cb4e0 msgr2=0x7f364c0c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.662+0000 7f3650f26700 1 --2- 172.21.15.12:0/878682042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f364c0cb4e0 0x7f364c0c7bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f364c0cf790 tx=0x7f3644004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.662+0000 7f364ad9d700 1 -- 172.21.15.12:0/878682042 reap_dead start 2023-07-07T18:15:12.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.663+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 shutdown_connections 2023-07-07T18:15:12.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.663+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 shutdown_connections 2023-07-07T18:15:12.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.663+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 >> 172.21.15.12:0/878682042 conn(0x7f364c0b0260 msgr2=0x7f364c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.663+0000 7ff6fdeae700 1 -- 172.21.15.12:0/1787890481 wait complete. 2023-07-07T18:15:12.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.664+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 shutdown_connections 2023-07-07T18:15:12.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.664+0000 7f3650f26700 1 -- 172.21.15.12:0/878682042 wait complete. 2023-07-07T18:15:12.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.665+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 --> [v2:172.21.15.160:6824/3768638094,v1:172.21.15.160:6825/3768638094] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95d00cd0e0 con 0x7f95b8087220 2023-07-07T18:15:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.665+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf1406ad30 msgr2=0x7faf1406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.665+0000 7faf2e7ef700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf1406ad30 0x7faf1406d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faf180017e0 tx=0x7faf18009040 comp rx=0 tx=0).stop 2023-07-07T18:15:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.665+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806a530 msgr2=0x7faf28207f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.665+0000 7faf2e7ef700 1 --2- 172.21.15.12:0/726827873 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faf2806a530 0x7faf28207f70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c3e0 tx=0x7faf1c00c7a0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.665+0000 7faf2cd8c700 1 -- 172.21.15.12:0/726827873 reap_dead start 2023-07-07T18:15:12.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.666+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 shutdown_connections 2023-07-07T18:15:12.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.666+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 >> 172.21.15.12:0/726827873 conn(0x7faf280b0260 msgr2=0x7faf28167980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.666+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 shutdown_connections 2023-07-07T18:15:12.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.666+0000 7faf2e7ef700 1 -- 172.21.15.12:0/726827873 wait complete. 2023-07-07T18:15:12.719 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:12.719 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-07T18:15:12.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.667+0000 7f95b7fff700 1 -- 172.21.15.12:0/641571827 <== osd.7 v2:172.21.15.160:6824/3768638094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95c8003ce0 con 0x7f95b8087220 2023-07-07T18:15:12.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.667+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6824/3768638094,v1:172.21.15.160:6825/3768638094] conn(0x7f95b8087220 msgr2=0x7f95b8089650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.667+0000 7f95d5ffd700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6824/3768638094,v1:172.21.15.160:6825/3768638094] conn(0x7f95b8087220 0x7f95b8089650 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.667+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f95b807d5b0 msgr2=0x7f95b807fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.667+0000 7f95d5ffd700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f95b807d5b0 0x7f95b807fa60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95c4000fd0 tx=0x7f95c4007ca0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.667+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d015f050 msgr2=0x7f95d0151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.667+0000 7f95d5ffd700 1 --2- 172.21.15.12:0/641571827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d015f050 0x7f95d0151e40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c270 tx=0x7f95c00047c0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.667+0000 7f95cffff700 1 -- 172.21.15.12:0/641571827 reap_dead start 2023-07-07T18:15:12.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.668+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 shutdown_connections 2023-07-07T18:15:12.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.668+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 >> 172.21.15.12:0/641571827 conn(0x7f95d00b1740 msgr2=0x7f95d014f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.670+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 --> [v2:172.21.15.160:6816/3085703848,v1:172.21.15.160:6817/3085703848] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f311006a140 con 0x7f30fc074a00 2023-07-07T18:15:12.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.670+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 shutdown_connections 2023-07-07T18:15:12.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.670+0000 7f95d5ffd700 1 -- 172.21.15.12:0/641571827 wait complete. 2023-07-07T18:15:12.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.671+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 --> [v2:172.21.15.12:6800/4008469182,v1:172.21.15.12:6801/4008469182] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd338002d40 con 0x7fd334074a00 2023-07-07T18:15:12.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.671+0000 7fd346ffd700 1 -- 172.21.15.12:0/150696651 <== osd.1 v2:172.21.15.12:6800/4008469182 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd338002d40 con 0x7fd334074a00 2023-07-07T18:15:12.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 >> [v2:172.21.15.12:6800/4008469182,v1:172.21.15.12:6801/4008469182] conn(0x7fd334074a00 msgr2=0x7fd334076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.12:6800/4008469182,v1:172.21.15.12:6801/4008469182] conn(0x7fd334074a00 0x7fd334076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd33406adb0 msgr2=0x7fd33406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd33406adb0 0x7fd33406d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3400011e0 tx=0x7fd340009040 comp rx=0 tx=0).stop 2023-07-07T18:15:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3500cab90 msgr2=0x7fd3500b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 --2- 172.21.15.12:0/150696651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3500cab90 0x7fd3500b3200 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd34c00e840 tx=0x7fd34c00eb50 comp rx=0 tx=0).stop 2023-07-07T18:15:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd356ba3700 1 -- 172.21.15.12:0/150696651 reap_dead start 2023-07-07T18:15:12.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 shutdown_connections 2023-07-07T18:15:12.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 >> 172.21.15.12:0/150696651 conn(0x7fd3500b1740 msgr2=0x7fd350155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 shutdown_connections 2023-07-07T18:15:12.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.672+0000 7fd358606700 1 -- 172.21.15.12:0/150696651 wait complete. 2023-07-07T18:15:12.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.674+0000 7f30f7fff700 1 -- 172.21.15.12:0/1340869054 <== osd.4 v2:172.21.15.160:6816/3085703848 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3100009720 con 0x7f30fc074a00 2023-07-07T18:15:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.678+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6816/3085703848,v1:172.21.15.160:6817/3085703848] conn(0x7f30fc074a00 msgr2=0x7f30fc076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.678+0000 7f3115837700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6816/3085703848,v1:172.21.15.160:6817/3085703848] conn(0x7f30fc074a00 0x7f30fc076e30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.678+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f30fc06adb0 msgr2=0x7f30fc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.678+0000 7f3115837700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f30fc06adb0 0x7f30fc06d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3104009950 tx=0x7f3104009210 comp rx=0 tx=0).stop 2023-07-07T18:15:12.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.678+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31100cb390 msgr2=0x7f31100b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.678+0000 7f3115837700 1 --2- 172.21.15.12:0/1340869054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31100cb390 0x7f31100b39a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f310800b680 tx=0x7f3108004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.678+0000 7f310f7fe700 1 -- 172.21.15.12:0/1340869054 reap_dead start 2023-07-07T18:15:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.678+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 shutdown_connections 2023-07-07T18:15:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.678+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 >> 172.21.15.12:0/1340869054 conn(0x7f31100b0260 msgr2=0x7f31100b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.680+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 --> [v2:172.21.15.160:6800/458823933,v1:172.21.15.160:6801/458823933] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f79f015cb20 con 0x7f79dc074930 2023-07-07T18:15:12.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.680+0000 7f79d7fff700 1 -- 172.21.15.12:0/3850252276 <== osd.6 v2:172.21.15.160:6800/458823933 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f79e0006d00 con 0x7f79dc074930 2023-07-07T18:15:12.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6800/458823933,v1:172.21.15.160:6801/458823933] conn(0x7f79dc074930 msgr2=0x7f79dc076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f79f597d700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6800/458823933,v1:172.21.15.160:6801/458823933] conn(0x7f79dc074930 0x7f79dc076d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 shutdown_connections 2023-07-07T18:15:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f79dc06ace0 msgr2=0x7f79dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f79f597d700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f79dc06ace0 0x7f79dc06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f79e80012e0 tx=0x7f79e8009040 comp rx=0 tx=0).stop 2023-07-07T18:15:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79f00ccc30 msgr2=0x7f79f0152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f79f597d700 1 --2- 172.21.15.12:0/3850252276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79f00ccc30 0x7f79f0152ca0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f79e400b4d0 tx=0x7f79e400b7e0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f79ef7fe700 1 -- 172.21.15.12:0/3850252276 reap_dead start 2023-07-07T18:15:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f3115837700 1 -- 172.21.15.12:0/1340869054 wait complete. 2023-07-07T18:15:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 shutdown_connections 2023-07-07T18:15:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.684+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 >> 172.21.15.12:0/3850252276 conn(0x7f79f00cf7d0 msgr2=0x7f79f00714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:12.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.685+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 shutdown_connections 2023-07-07T18:15:12.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.685+0000 7f79f597d700 1 -- 172.21.15.12:0/3850252276 wait complete. 2023-07-07T18:15:12.731 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:12.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-07T18:15:12.733 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:12.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-07T18:15:12.734 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:12.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-07T18:15:12.735 INFO:teuthology.orchestra.run.smithi012.stdout:64424509452 2023-07-07T18:15:12.735 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-07T18:15:12.736 INFO:teuthology.orchestra.run.smithi012.stdout:60129542154 2023-07-07T18:15:12.736 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-07T18:15:12.737 INFO:teuthology.orchestra.run.smithi012.stdout:60129542156 2023-07-07T18:15:12.737 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-07T18:15:12.738 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:12.738 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-07T18:15:12.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.980+0000 7fbcfc526700 1 Processor -- start 2023-07-07T18:15:12.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.980+0000 7fbcfc526700 1 -- start start 2023-07-07T18:15:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.982+0000 7fbcfc526700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcf40b0d40 0x7fbcf4159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.982+0000 7fbcfc526700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbcf40cb4e0 0x7fbcf40cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.982+0000 7fbcfc526700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf415bd30 con 0x7fbcf40cc260 2023-07-07T18:15:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.982+0000 7fbcfc526700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf41586a0 con 0x7fbcf40b0d40 2023-07-07T18:15:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.982+0000 7fbcfc526700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf40cbec0 con 0x7fbcf40cb4e0 2023-07-07T18:15:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.982+0000 7fbcf9ac1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbcf40cb4e0 0x7fbcf40cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.982+0000 7fbcf9ac1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbcf40cb4e0 0x7fbcf40cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53034/0 (socket says 172.21.15.12:53034) 2023-07-07T18:15:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.982+0000 7fbcf9ac1700 1 -- 172.21.15.12:0/3790457116 learned_addr learned my addr 172.21.15.12:0/3790457116 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.982+0000 7fbcfaac3700 1 --1- 172.21.15.12:0/3790457116 >> v1:172.21.15.160:6789/0 conn(0x7fbcf40cc260 0x7fbcf40cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:47864/0 (socket says 172.21.15.12:47864) 2023-07-07T18:15:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.983+0000 7fbcf9ac1700 1 -- 172.21.15.12:0/3790457116 >> v2:172.21.15.12:3300/0 conn(0x7fbcf40b0d40 msgr2=0x7fbcf4159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.983+0000 7fbcf9ac1700 1 --2- 172.21.15.12:0/3790457116 >> v2:172.21.15.12:3300/0 conn(0x7fbcf40b0d40 0x7fbcf4159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.983+0000 7fbcf9ac1700 1 -- 172.21.15.12:0/3790457116 >> v1:172.21.15.160:6789/0 conn(0x7fbcf40cc260 legacy=0x7fbcf40cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.983+0000 7fbcf9ac1700 1 -- 172.21.15.12:0/3790457116 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf415bfd0 con 0x7fbcf40cb4e0 2023-07-07T18:15:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.983+0000 7fbcf9ac1700 1 --2- 172.21.15.12:0/3790457116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbcf40cb4e0 0x7fbcf40cb980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40ad720 tx=0x7fbcf0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=719793c766718aee server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.985+0000 7fbcf92c0700 1 -- 172.21.15.12:0/3790457116 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0004230 con 0x7fbcf40cb4e0 2023-07-07T18:15:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.985+0000 7fbcf92c0700 1 -- 172.21.15.12:0/3790457116 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf0004390 con 0x7fbcf40cb4e0 2023-07-07T18:15:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.985+0000 7fbcf92c0700 1 -- 172.21.15.12:0/3790457116 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf00036a0 con 0x7fbcf40cb4e0 2023-07-07T18:15:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.986+0000 7fbcfc526700 1 -- 172.21.15.12:0/3790457116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbcf40cb4e0 msgr2=0x7fbcf40cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.986+0000 7fbcfc526700 1 --2- 172.21.15.12:0/3790457116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbcf40cb4e0 0x7fbcf40cb980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40ad720 tx=0x7fbcf0009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.989+0000 7f90cc5f6700 1 Processor -- start 2023-07-07T18:15:12.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f8c08a71700 1 Processor -- start 2023-07-07T18:15:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.990+0000 7f90cc5f6700 1 -- start start 2023-07-07T18:15:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f90cc5f6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f90cc5f6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f90c40ae6c0 0x7f90c40aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f8c08a71700 1 -- start start 2023-07-07T18:15:12.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f90cc5f6700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c415d6a0 con 0x7f90c40ce1a0 2023-07-07T18:15:12.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f90cc5f6700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c40cdc80 con 0x7f90c40ae6c0 2023-07-07T18:15:12.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f90cc5f6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4159700 con 0x7f90c40cddd0 2023-07-07T18:15:12.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f90ca392700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f90ca392700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46520/0 (socket says 172.21.15.12:46520) 2023-07-07T18:15:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.991+0000 7f90ca392700 1 -- 172.21.15.12:0/1908865781 learned_addr learned my addr 172.21.15.12:0/1908865781 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f90ca392700 1 -- 172.21.15.12:0/1908865781 >> v2:172.21.15.12:3300/0 conn(0x7f90c40ae6c0 msgr2=0x7f90c40aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f90ca392700 1 --2- 172.21.15.12:0/1908865781 >> v2:172.21.15.12:3300/0 conn(0x7f90c40ae6c0 0x7f90c40aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f90ca392700 1 -- 172.21.15.12:0/1908865781 >> v1:172.21.15.12:6789/0 conn(0x7f90c40ce1a0 legacy=0x7f90c40714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f90ca392700 1 -- 172.21.15.12:0/1908865781 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c41599e0 con 0x7f90c40cddd0 2023-07-07T18:15:12.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f90ca392700 1 --2- 172.21.15.12:0/1908865781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c415a1e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f90b800bb90 tx=0x7f90b800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961be304a93d93f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f90c9390700 1 -- 172.21.15.12:0/1908865781 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800dd10 con 0x7f90c40cddd0 2023-07-07T18:15:12.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f90c9390700 1 -- 172.21.15.12:0/1908865781 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b800de70 con 0x7f90c40cddd0 2023-07-07T18:15:12.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f90c9390700 1 -- 172.21.15.12:0/1908865781 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8004230 con 0x7f90c40cddd0 2023-07-07T18:15:12.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f90cc5f6700 1 -- 172.21.15.12:0/1908865781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 msgr2=0x7f90c415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:12.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f90cc5f6700 1 --2- 172.21.15.12:0/1908865781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c415a1e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f90b800bb90 tx=0x7f90b800bea0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f8c08a71700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c040cdd50 0x7f8c040cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f8c08a71700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8c0415fdd0 0x7f8c04160210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:12.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f8c08a71700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c04069ef0 con 0x7f8c040cb390 2023-07-07T18:15:12.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f8c08a71700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0415c6e0 con 0x7f8c040cdd50 2023-07-07T18:15:12.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.992+0000 7f8c08a71700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c040cbca0 con 0x7f8c0415fdd0 2023-07-07T18:15:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f8c0259c700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f8c040cb390 0x7f8c040cc260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:47874/0 (socket says 172.21.15.12:47874) 2023-07-07T18:15:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f8c0259c700 1 -- 172.21.15.12:0/3061758984 learned_addr learned my addr 172.21.15.12:0/3061758984 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f8c01d9b700 1 --2- 172.21.15.12:0/3061758984 >> v2:172.21.15.12:3300/0 conn(0x7f8c040cdd50 0x7f8c040cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f8c01d9b700 1 -- 172.21.15.12:0/3061758984 >> v2:172.21.15.160:3300/0 conn(0x7f8c0415fdd0 msgr2=0x7f8c04160210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T18:15:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f8c01d9b700 1 --2- 172.21.15.12:0/3061758984 >> v2:172.21.15.160:3300/0 conn(0x7f8c0415fdd0 0x7f8c04160210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f8c01d9b700 1 -- 172.21.15.12:0/3061758984 >> v1:172.21.15.160:6789/0 conn(0x7f8c040cb390 legacy=0x7f8c040cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:12.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f8c01d9b700 1 -- 172.21.15.12:0/3061758984 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040ce330 con 0x7f8c040cdd50 2023-07-07T18:15:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.993+0000 7f8c01d9b700 1 --2- 172.21.15.12:0/3061758984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cdd50 0x7f8c040cb760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c04071620 tx=0x7f8bfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8a60ed799c4c5a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f440b7ab700 1 Processor -- start 2023-07-07T18:15:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f90cc5f6700 1 -- 172.21.15.12:0/1908865781 shutdown_connections 2023-07-07T18:15:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f90cc5f6700 1 --2- 172.21.15.12:0/1908865781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c415a1e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f90cc5f6700 1 --2- 172.21.15.12:0/1908865781 >> v2:172.21.15.12:3300/0 conn(0x7f90c40ae6c0 0x7f90c40aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f90cc5f6700 1 -- 172.21.15.12:0/1908865781 >> 172.21.15.12:0/1908865781 conn(0x7f90c406d4a0 msgr2=0x7f90c406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7fbcfc526700 1 -- 172.21.15.12:0/3790457116 shutdown_connections 2023-07-07T18:15:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7fbcfc526700 1 --2- 172.21.15.12:0/3790457116 >> v2:172.21.15.12:3300/0 conn(0x7fbcf40b0d40 0x7fbcf4159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7fbcfc526700 1 --2- 172.21.15.12:0/3790457116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbcf40cb4e0 0x7fbcf40cb980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7fbcfc526700 1 -- 172.21.15.12:0/3790457116 >> 172.21.15.12:0/3790457116 conn(0x7fbcf40b0260 msgr2=0x7fbcf40b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f90cc5f6700 1 -- 172.21.15.12:0/1908865781 shutdown_connections 2023-07-07T18:15:13.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f440b7ab700 1 -- start start 2023-07-07T18:15:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f5811428700 1 Processor -- start 2023-07-07T18:15:13.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f5811428700 1 -- start start 2023-07-07T18:15:13.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.995+0000 7fbcfc526700 1 -- 172.21.15.12:0/3790457116 shutdown_connections 2023-07-07T18:15:13.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f8c0159a700 1 -- 172.21.15.12:0/3061758984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00e070 con 0x7f8c040cdd50 2023-07-07T18:15:13.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f8c0159a700 1 -- 172.21.15.12:0/3061758984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc00bb90 con 0x7f8c040cdd50 2023-07-07T18:15:13.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f8c0159a700 1 -- 172.21.15.12:0/3061758984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc003a20 con 0x7f8c040cdd50 2023-07-07T18:15:13.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.995+0000 7f8c08a71700 1 -- 172.21.15.12:0/3061758984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cdd50 msgr2=0x7f8c040cb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.995+0000 7f8c08a71700 1 --2- 172.21.15.12:0/3061758984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cdd50 0x7f8c040cb760 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c04071620 tx=0x7f8bfc00b330 comp rx=0 tx=0).stop 2023-07-07T18:15:13.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f8c08a71700 1 -- 172.21.15.12:0/3061758984 shutdown_connections 2023-07-07T18:15:13.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f8c08a71700 1 --2- 172.21.15.12:0/3061758984 >> v2:172.21.15.160:3300/0 conn(0x7f8c0415fdd0 0x7f8c04160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f8c08a71700 1 --2- 172.21.15.12:0/3061758984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cdd50 0x7f8c040cb760 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f8c08a71700 1 -- 172.21.15.12:0/3061758984 >> 172.21.15.12:0/3061758984 conn(0x7f8c040b0260 msgr2=0x7f8c040b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.995+0000 7f440b7ab700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f44041605d0 0x7f440406c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.995+0000 7f440b7ab700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440406ad10 con 0x7f44040c1770 2023-07-07T18:15:13.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.995+0000 7f440b7ab700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44040c8ce0 con 0x7f4404071370 2023-07-07T18:15:13.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.995+0000 7f440b7ab700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44040cc8c0 con 0x7f44041605d0 2023-07-07T18:15:13.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.994+0000 7f90cc5f6700 1 -- 172.21.15.12:0/1908865781 wait complete. 2023-07-07T18:15:13.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f90cc5f6700 1 Processor -- start 2023-07-07T18:15:13.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.995+0000 7fbcfc526700 1 -- 172.21.15.12:0/3790457116 wait complete. 2023-07-07T18:15:13.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.997+0000 7fbcfc526700 1 Processor -- start 2023-07-07T18:15:13.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f4408d46700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f4404071370 0x7f4404069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:47882/0 (socket says 172.21.15.12:47882) 2023-07-07T18:15:13.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f4408d46700 1 -- 172.21.15.12:0/3387605061 learned_addr learned my addr 172.21.15.12:0/3387605061 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:13.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.997+0000 7f4409547700 1 --2- 172.21.15.12:0/3387605061 >> v2:172.21.15.160:3300/0 conn(0x7f44041605d0 0x7f440406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f5811428700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f580c0cb4e0 0x7f580c0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f5811428700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f580c0cc260 0x7f580c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f5811428700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f580c0ccc00 con 0x7f580c0b0d40 2023-07-07T18:15:13.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f5811428700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f580c1586a0 con 0x7f580c0cb4e0 2023-07-07T18:15:13.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f5811428700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c159710 con 0x7f580c0cc260 2023-07-07T18:15:13.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f580affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f580c0b0d40 0x7f580c159000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54640/0 (socket says 172.21.15.12:54640) 2023-07-07T18:15:13.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f580affd700 1 -- 172.21.15.12:0/2617937947 learned_addr learned my addr 172.21.15.12:0/2617937947 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:13.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f580a7fc700 1 --2- 172.21.15.12:0/2617937947 >> v2:172.21.15.160:3300/0 conn(0x7f580c0cb4e0 0x7f580c0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f8c08a71700 1 -- 172.21.15.12:0/3061758984 shutdown_connections 2023-07-07T18:15:13.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f8c08a71700 1 -- 172.21.15.12:0/3061758984 wait complete. 2023-07-07T18:15:13.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286593345 0 0) 0x7f580c0ccc00 con 0x7f580c0b0d40 2023-07-07T18:15:13.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f40035b0 con 0x7f580c0b0d40 2023-07-07T18:15:13.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.997+0000 7fbcfc526700 1 -- start start 2023-07-07T18:15:13.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcfc526700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbcf40b0d40 0x7fbcf40b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcfc526700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf40cb4e0 0x7fbcf40c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcfc526700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcf40cc260 0x7fbcf40c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcfc526700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4202c60 con 0x7fbcf40cb4e0 2023-07-07T18:15:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcfc526700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40b2170 con 0x7fbcf40b0d40 2023-07-07T18:15:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcfc526700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf4203190 con 0x7fbcf40cc260 2023-07-07T18:15:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcf9ac1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf40cb4e0 0x7fbcf40c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcf9ac1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf40cb4e0 0x7fbcf40c3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57456/0 (socket says 172.21.15.12:57456) 2023-07-07T18:15:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcf9ac1700 1 -- 172.21.15.12:0/766208985 learned_addr learned my addr 172.21.15.12:0/766208985 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcfa2c2700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbcf40b0d40 0x7fbcf40b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7fbcfaac3700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcf40cc260 0x7fbcf40c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f2241e6f700 1 Processor -- start 2023-07-07T18:15:13.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.996+0000 7f2241e6f700 1 -- start start 2023-07-07T18:15:13.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.997+0000 7f2241e6f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f223c1605d0 0x7f223c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.997+0000 7f2241e6f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f223c06e810 0x7f223c0ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.997+0000 7f2241e6f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0cc680 con 0x7f223c164d40 2023-07-07T18:15:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.997+0000 7f2241e6f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c0ce8a0 con 0x7f223c1605d0 2023-07-07T18:15:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.997+0000 7f2241e6f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c06c7f0 con 0x7f223c06e810 2023-07-07T18:15:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f223affd700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f223c164d40 0x7f223c06e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:47890/0 (socket says 172.21.15.12:47890) 2023-07-07T18:15:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f223affd700 1 -- 172.21.15.12:0/2110686566 learned_addr learned my addr 172.21.15.12:0/2110686566 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f223b7fe700 1 --2- 172.21.15.12:0/2110686566 >> v2:172.21.15.12:3300/0 conn(0x7f223c1605d0 0x7f223c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f223bfff700 1 --2- 172.21.15.12:0/2110686566 >> v2:172.21.15.160:3300/0 conn(0x7f223c06e810 0x7f223c0ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7fbcfaac3700 1 -- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbcf40b0d40 msgr2=0x7fbcf40b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7fbcfaac3700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbcf40b0d40 0x7fbcf40b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7fbcfaac3700 1 -- 172.21.15.12:0/766208985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf40cb4e0 msgr2=0x7fbcf40c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7fbcfaac3700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf40cb4e0 0x7fbcf40c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7fbcfaac3700 1 -- 172.21.15.12:0/766208985 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0009550 con 0x7fbcf40cc260 2023-07-07T18:15:13.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1573354961 0 0) 0x7f57f40035b0 con 0x7f580c0b0d40 2023-07-07T18:15:13.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f580c0cc260 msgr2=0x7f580c0cc6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T18:15:13.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f580c0cc260 0x7f580c0cc6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 >> v2:172.21.15.160:3300/0 conn(0x7f580c0cb4e0 msgr2=0x7f580c0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:13.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 --2- 172.21.15.12:0/2617937947 >> v2:172.21.15.160:3300/0 conn(0x7f580c0cb4e0 0x7f580c0cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c15bfd0 con 0x7f580c0b0d40 2023-07-07T18:15:13.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f58040019f0 con 0x7f580c0b0d40 2023-07-07T18:15:13.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 >> v1:172.21.15.12:6789/0 conn(0x7f580c0b0d40 legacy=0x7f580c159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f4003a00 0x7f57f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4004430 0x7f57f40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57f40050a0 0x7f57f400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f400bf80 con 0x7f57f40050a0 2023-07-07T18:15:13.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f400c0f0 con 0x7f57f4003a00 2023-07-07T18:15:13.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f400c2b0 con 0x7f57f4004430 2023-07-07T18:15:13.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f580affd700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f4003a00 0x7f57f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.997+0000 7f90cc5f6700 1 -- start start 2023-07-07T18:15:13.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f90cc5f6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90c40ae6c0 0x7f90c40b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f90cc5f6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c40b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f90cc5f6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c40ce1a0 0x7f90c40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f90cc5f6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40cb0f0 con 0x7f90c40ae6c0 2023-07-07T18:15:13.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f580a7fc700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4004430 0x7f57f40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f90cc5f6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40b4f40 con 0x7f90c40ce1a0 2023-07-07T18:15:13.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.998+0000 7f90cc5f6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c40ca7c0 con 0x7f90c40cddd0 2023-07-07T18:15:13.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90cab93700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c40ce1a0 0x7f90c40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90ca392700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90c40ae6c0 0x7f90c40b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90ca392700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90c40ae6c0 0x7f90c40b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57462/0 (socket says 172.21.15.12:57462) 2023-07-07T18:15:13.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90ca392700 1 -- 172.21.15.12:0/2031405303 learned_addr learned my addr 172.21.15.12:0/2031405303 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90c9b91700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c40b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7fbcfaac3700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcf40cc260 0x7fbcf40c3750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00cbd0 tx=0x7fbcec00cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f223b7fe700 1 -- 172.21.15.12:0/2110686566 >> v2:172.21.15.160:3300/0 conn(0x7f223c06e810 msgr2=0x7f223c0ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:13.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f223b7fe700 1 --2- 172.21.15.12:0/2110686566 >> v2:172.21.15.160:3300/0 conn(0x7f223c06e810 0x7f223c0ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f223b7fe700 1 -- 172.21.15.12:0/2110686566 >> v1:172.21.15.160:6789/0 conn(0x7f223c164d40 legacy=0x7f223c06e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f223b7fe700 1 -- 172.21.15.12:0/2110686566 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c06cad0 con 0x7f223c1605d0 2023-07-07T18:15:13.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90cab93700 1 -- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 msgr2=0x7f90c40b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90cab93700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c40b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90cab93700 1 -- 172.21.15.12:0/2031405303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90c40ae6c0 msgr2=0x7f90c40b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90cab93700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90c40ae6c0 0x7f90c40b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f90cab93700 1 -- 172.21.15.12:0/2031405303 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b800b7f0 con 0x7f90c40ce1a0 2023-07-07T18:15:13.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f8c08a71700 1 Processor -- start 2023-07-07T18:15:13.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f223b7fe700 1 --2- 172.21.15.12:0/2110686566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1605d0 0x7f223c0ccaf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f223c0ce150 tx=0x7f223400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290dfdeb06fb5457 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f580affd700 1 -- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4004430 msgr2=0x7f57f40048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:13.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f580affd700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4004430 0x7f57f40048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f580affd700 1 -- 172.21.15.12:0/2617937947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57f40050a0 msgr2=0x7f57f400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:13.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:12.999+0000 7f580affd700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57f40050a0 0x7f57f400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f580affd700 1 -- 172.21.15.12:0/2617937947 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c15bfd0 con 0x7f57f4003a00 2023-07-07T18:15:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f8c08a71700 1 -- start start 2023-07-07T18:15:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f90cab93700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c40ce1a0 0x7f90c40c83d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00be20 tx=0x7f90bc009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f580affd700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f4003a00 0x7f57f4003e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f580400a8c0 tx=0x7f57f4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a15e7c8dff0f5dc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f90b6ffd700 1 -- 172.21.15.12:0/2031405303 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc00cbb0 con 0x7f90c40ce1a0 2023-07-07T18:15:13.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7fbce6ffd700 1 -- 172.21.15.12:0/766208985 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00aa60 con 0x7fbcf40cc260 2023-07-07T18:15:13.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7fbce6ffd700 1 -- 172.21.15.12:0/766208985 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec00abc0 con 0x7fbcf40cc260 2023-07-07T18:15:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7fbce6ffd700 1 -- 172.21.15.12:0/766208985 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec0070d0 con 0x7fbcf40cc260 2023-07-07T18:15:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf40b1b60 con 0x7fbcf40cc260 2023-07-07T18:15:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf4202eb0 con 0x7fbcf40cc260 2023-07-07T18:15:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f90b6ffd700 1 -- 172.21.15.12:0/2031405303 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc00cd50 con 0x7f90c40ce1a0 2023-07-07T18:15:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f90b6ffd700 1 -- 172.21.15.12:0/2031405303 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc014680 con 0x7f90c40ce1a0 2023-07-07T18:15:13.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c40caaa0 con 0x7f90c40ce1a0 2023-07-07T18:15:13.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c40c8910 con 0x7f90c40ce1a0 2023-07-07T18:15:13.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f223a7fc700 1 -- 172.21.15.12:0/2110686566 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400e070 con 0x7f223c1605d0 2023-07-07T18:15:13.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f223a7fc700 1 -- 172.21.15.12:0/2110686566 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400bae0 con 0x7f223c1605d0 2023-07-07T18:15:13.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f223a7fc700 1 -- 172.21.15.12:0/2110686566 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400be70 con 0x7f223c1605d0 2023-07-07T18:15:13.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828360240 0 0) 0x7f44040c8ce0 con 0x7f4404071370 2023-07-07T18:15:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f00035b0 con 0x7f4404071370 2023-07-07T18:15:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944112180 0 0) 0x7f440406ad10 con 0x7f44040c1770 2023-07-07T18:15:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44040c8ce0 con 0x7f44040c1770 2023-07-07T18:15:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2889014387 0 0) 0x7f43f00035b0 con 0x7f4404071370 2023-07-07T18:15:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 >> v2:172.21.15.160:3300/0 conn(0x7f44041605d0 msgr2=0x7f440406c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 --2- 172.21.15.12:0/3387605061 >> v2:172.21.15.160:3300/0 conn(0x7f44041605d0 0x7f440406c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 >> v1:172.21.15.12:6789/0 conn(0x7f44040c1770 legacy=0x7f440406a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44040cdd50 con 0x7f4404071370 2023-07-07T18:15:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f4400001670 con 0x7f4404071370 2023-07-07T18:15:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 >> v1:172.21.15.160:6789/0 conn(0x7f4404071370 legacy=0x7f4404069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f0004c40 0x7f43f0005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f00037f0 0x7f43f0003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.000+0000 7f43fbfff700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f43f000ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44040cc8c0 con 0x7f43f0004c40 2023-07-07T18:15:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f000c1e0 con 0x7f43f00041f0 2023-07-07T18:15:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f000c3a0 con 0x7f43f00037f0 2023-07-07T18:15:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c08a71700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c040cb390 0x7f8c040b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c08a71700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c040cdd50 0x7f8c040b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c08a71700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c0415fdd0 0x7f8c041f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c08a71700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c041f0d80 con 0x7f8c0415fdd0 2023-07-07T18:15:13.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c08a71700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040b2ee0 con 0x7f8c040cdd50 2023-07-07T18:15:13.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c08a71700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040b2640 con 0x7f8c040cb390 2023-07-07T18:15:13.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f2241e6f700 1 -- 172.21.15.12:0/2110686566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1605d0 msgr2=0x7f223c0ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f2241e6f700 1 --2- 172.21.15.12:0/2110686566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1605d0 0x7f223c0ccaf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f223c0ce150 tx=0x7f223400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c01d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c040cdd50 0x7f8c040b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c01d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c040cdd50 0x7f8c040b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53084/0 (socket says 172.21.15.12:53084) 2023-07-07T18:15:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c01d9b700 1 -- 172.21.15.12:0/434653106 learned_addr learned my addr 172.21.15.12:0/434653106 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.001+0000 7f8c02d9d700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c0415fdd0 0x7f8c041f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f8c0259c700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c040cb390 0x7f8c040b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f8c01d9b700 1 -- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c040cb390 msgr2=0x7f8c040b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f8c01d9b700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c040cb390 0x7f8c040b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f8c01d9b700 1 -- 172.21.15.12:0/434653106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c0415fdd0 msgr2=0x7f8c041f9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f8c01d9b700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c0415fdd0 0x7f8c041f9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f8c01d9b700 1 -- 172.21.15.12:0/434653106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc009a70 con 0x7f8c040cdd50 2023-07-07T18:15:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f4408d46700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f00037f0 0x7f43f0003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f4409d48700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f43f000ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f2241e6f700 1 -- 172.21.15.12:0/2110686566 shutdown_connections 2023-07-07T18:15:13.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f2241e6f700 1 --2- 172.21.15.12:0/2110686566 >> v2:172.21.15.160:3300/0 conn(0x7f223c06e810 0x7f223c0ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f2241e6f700 1 --2- 172.21.15.12:0/2110686566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c1605d0 0x7f223c0ccaf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f2241e6f700 1 -- 172.21.15.12:0/2110686566 >> 172.21.15.12:0/2110686566 conn(0x7f223c0cf7d0 msgr2=0x7f223c0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f2241e6f700 1 -- 172.21.15.12:0/2110686566 shutdown_connections 2023-07-07T18:15:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f2241e6f700 1 -- 172.21.15.12:0/2110686566 wait complete. 2023-07-07T18:15:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804012600 con 0x7f57f4003a00 2023-07-07T18:15:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5804012780 con 0x7f57f4003a00 2023-07-07T18:15:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7f5809ffb700 1 -- 172.21.15.12:0/2617937947 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5804012b30 con 0x7f57f4003a00 2023-07-07T18:15:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f5811428700 1 -- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f4003a00 msgr2=0x7f57f4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f5811428700 1 --2- 172.21.15.12:0/2617937947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f4003a00 0x7f57f4003e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f580400a8c0 tx=0x7f57f4005880 comp rx=0 tx=0).stop 2023-07-07T18:15:13.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f580b7fe700 1 -- 172.21.15.12:0/2617937947 reap_dead start 2023-07-07T18:15:13.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.002+0000 7fbce6ffd700 1 -- 172.21.15.12:0/766208985 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbcec007230 con 0x7fbcf40cc260 2023-07-07T18:15:13.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7fbce6ffd700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbcd806ad30 0x7fbcd806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7fbce6ffd700 1 -- 172.21.15.12:0/766208985 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbcec089450 con 0x7fbcf40cc260 2023-07-07T18:15:13.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f4409d48700 1 -- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f00037f0 msgr2=0x7f43f0003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:13.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f4409d48700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43f00037f0 0x7f43f0003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f4409d48700 1 -- 172.21.15.12:0/3387605061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f0004c40 msgr2=0x7f43f0005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:13.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f4409d48700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43f0004c40 0x7f43f0005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f4409d48700 1 -- 172.21.15.12:0/3387605061 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44040cdd50 con 0x7f43f00041f0 2023-07-07T18:15:13.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f4409d48700 1 -- 172.21.15.12:0/3387605061 reap_dead start 2023-07-07T18:15:13.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f4409d48700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f43f000ba90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00c190 tx=0x7f43f0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44b84e91ad7c77a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f8c01d9b700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c040cdd50 0x7f8c040b2100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009fd0 tx=0x7f8bfc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f8bf2ffd700 1 -- 172.21.15.12:0/434653106 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc012630 con 0x7f8c040cdd50 2023-07-07T18:15:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f8bf2ffd700 1 -- 172.21.15.12:0/434653106 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc0127b0 con 0x7f8c040cdd50 2023-07-07T18:15:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f8bf2ffd700 1 -- 172.21.15.12:0/434653106 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc012b60 con 0x7f8c040cdd50 2023-07-07T18:15:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.003+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040b30d0 con 0x7f8c040cdd50 2023-07-07T18:15:13.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c040b3690 con 0x7f8c040cdd50 2023-07-07T18:15:13.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7fbcfa2c2700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbcd806ad30 0x7fbcd806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f90b6ffd700 1 -- 172.21.15.12:0/2031405303 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90bc006d50 con 0x7f90c40ce1a0 2023-07-07T18:15:13.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f5811428700 1 -- 172.21.15.12:0/2617937947 shutdown_connections 2023-07-07T18:15:13.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f5811428700 1 -- 172.21.15.12:0/2617937947 >> 172.21.15.12:0/2617937947 conn(0x7f580c0b0260 msgr2=0x7f580c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f2241e6f700 1 Processor -- start 2023-07-07T18:15:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f5811428700 1 -- 172.21.15.12:0/2617937947 shutdown_connections 2023-07-07T18:15:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7fbcfa2c2700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbcd806ad30 0x7fbcd806d1e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40c8810 tx=0x7fbce8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f2241e6f700 1 -- start start 2023-07-07T18:15:13.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f90b6ffd700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f90a806ace0 0x7f90a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f90b6ffd700 1 -- 172.21.15.12:0/2031405303 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f90bc089350 con 0x7f90c40ce1a0 2023-07-07T18:15:13.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f90ca392700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f90a806ace0 0x7f90a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc00cd30 con 0x7f43f00041f0 2023-07-07T18:15:13.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc003a00 con 0x7f43f00041f0 2023-07-07T18:15:13.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f43fbfff700 1 -- 172.21.15.12:0/3387605061 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc003db0 con 0x7f43f00041f0 2023-07-07T18:15:13.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcdc0052f0 con 0x7fbcf40cc260 2023-07-07T18:15:13.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f2241e6f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f223c06e810 0x7f223c0c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f2241e6f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f223c1605d0 0x7f223c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f2241e6f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c163940 0x7f223c15c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f2241e6f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15aff0 con 0x7f223c163940 2023-07-07T18:15:13.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f2241e6f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15b2d0 con 0x7f223c06e810 2023-07-07T18:15:13.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f2241e6f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15b5b0 con 0x7f223c1605d0 2023-07-07T18:15:13.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f223affd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f223c1605d0 0x7f223c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f223b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f223c06e810 0x7f223c0c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f223affd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f223c1605d0 0x7f223c15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46582/0 (socket says 172.21.15.12:46582) 2023-07-07T18:15:13.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f223affd700 1 -- 172.21.15.12:0/904259056 learned_addr learned my addr 172.21.15.12:0/904259056 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f440b7ab700 1 -- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 msgr2=0x7f43f000ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.005+0000 7f440b7ab700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f43f000ba90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00c190 tx=0x7f43f0005880 comp rx=0 tx=0).stop 2023-07-07T18:15:13.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f223bfff700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c163940 0x7f223c15c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f440b7ab700 1 -- 172.21.15.12:0/3387605061 shutdown_connections 2023-07-07T18:15:13.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f440b7ab700 1 --2- 172.21.15.12:0/3387605061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f43f000ba90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f440b7ab700 1 -- 172.21.15.12:0/3387605061 >> 172.21.15.12:0/3387605061 conn(0x7f44040b0260 msgr2=0x7f44040b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c40cb260 con 0x7f90c40ce1a0 2023-07-07T18:15:13.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f223b7fe700 1 -- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f223c1605d0 msgr2=0x7f223c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f223b7fe700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f223c1605d0 0x7f223c15a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f223b7fe700 1 -- 172.21.15.12:0/904259056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c163940 msgr2=0x7f223c15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f223b7fe700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c163940 0x7f223c15c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f223b7fe700 1 -- 172.21.15.12:0/904259056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234009a70 con 0x7f223c06e810 2023-07-07T18:15:13.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f223b7fe700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f223c06e810 0x7f223c0c0a40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2234016000 tx=0x7f2234004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f90ca392700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f90a806ace0 0x7f90a806d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f90b800bee0 tx=0x7f90b801b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.004+0000 7f5811428700 1 -- 172.21.15.12:0/2617937947 wait complete. 2023-07-07T18:15:13.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.006+0000 7f5811428700 1 Processor -- start 2023-07-07T18:15:13.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.007+0000 7f440b7ab700 1 -- 172.21.15.12:0/3387605061 shutdown_connections 2023-07-07T18:15:13.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.007+0000 7f440b7ab700 1 -- 172.21.15.12:0/3387605061 wait complete. 2023-07-07T18:15:13.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.007+0000 7f5811428700 1 -- start start 2023-07-07T18:15:13.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.007+0000 7f8bf2ffd700 1 -- 172.21.15.12:0/434653106 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8bfc012cc0 con 0x7f8c040cdd50 2023-07-07T18:15:13.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.008+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be80052f0 con 0x7f8c040cdd50 2023-07-07T18:15:13.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.008+0000 7f8bf2ffd700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8bec06ae90 0x7f8bec06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.008+0000 7f8bf2ffd700 1 -- 172.21.15.12:0/434653106 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8bfc08bb70 con 0x7f8c040cdd50 2023-07-07T18:15:13.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.008+0000 7f8c0259c700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8bec06ae90 0x7f8bec06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f5811428700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4003a00 0x7f580c0c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f8c0259c700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8bec06ae90 0x7f8bec06d340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8c040ae210 tx=0x7f8bf4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f5811428700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580c159ed0 0x7f580c154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f5811428700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580c1ed950 0x7f580c1eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f5811428700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0b25b0 con 0x7f580c159ed0 2023-07-07T18:15:13.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f5811428700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0b2800 con 0x7f580c1ed950 2023-07-07T18:15:13.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f5811428700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f580c0b2ae0 con 0x7f57f4003a00 2023-07-07T18:15:13.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f440b7ab700 1 Processor -- start 2023-07-07T18:15:13.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f440b7ab700 1 -- start start 2023-07-07T18:15:13.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580affd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4003a00 0x7f580c0c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580c159ed0 0x7f580c154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580affd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4003a00 0x7f580c0c2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46590/0 (socket says 172.21.15.12:46590) 2023-07-07T18:15:13.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580c159ed0 0x7f580c154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57498/0 (socket says 172.21.15.12:57498) 2023-07-07T18:15:13.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580affd700 1 -- 172.21.15.12:0/1375037146 learned_addr learned my addr 172.21.15.12:0/1375037146 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580b7fe700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580c1ed950 0x7f580c1eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580a7fc700 1 -- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4003a00 msgr2=0x7f580c0c2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580a7fc700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4003a00 0x7f580c0c2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580a7fc700 1 -- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580c1ed950 msgr2=0x7f580c1eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580a7fc700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580c1ed950 0x7f580c1eddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.009+0000 7f580a7fc700 1 -- 172.21.15.12:0/1375037146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c0b2dc0 con 0x7f580c159ed0 2023-07-07T18:15:13.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f580a7fc700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580c159ed0 0x7f580c154e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f57fc011980 tx=0x7f57fc011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f57f37fe700 1 -- 172.21.15.12:0/1375037146 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc011ed0 con 0x7f580c159ed0 2023-07-07T18:15:13.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f57f37fe700 1 -- 172.21.15.12:0/1375037146 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc00f940 con 0x7f580c159ed0 2023-07-07T18:15:13.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c0b30a0 con 0x7f580c159ed0 2023-07-07T18:15:13.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f57f37fe700 1 -- 172.21.15.12:0/1375037146 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc00fcb0 con 0x7f580c159ed0 2023-07-07T18:15:13.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c155360 con 0x7f580c159ed0 2023-07-07T18:15:13.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f440b7ab700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f4404162280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f440b7ab700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44041eba90 0x7f44040b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f440b7ab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4404162b80 0x7f44040b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f440b7ab700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44041651a0 con 0x7f4404162b80 2023-07-07T18:15:13.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f440b7ab700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4404160c20 con 0x7f43f00041f0 2023-07-07T18:15:13.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f440b7ab700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44041627c0 con 0x7f44041eba90 2023-07-07T18:15:13.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f4409547700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f4404162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f4409547700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f4404162280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53110/0 (socket says 172.21.15.12:53110) 2023-07-07T18:15:13.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.010+0000 7f4409547700 1 -- 172.21.15.12:0/3427060858 learned_addr learned my addr 172.21.15.12:0/3427060858 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.011+0000 7f4408d46700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44041eba90 0x7f44040b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.011+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f580c0b32e0 con 0x7f580c159ed0 2023-07-07T18:15:13.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.011+0000 7f4409547700 1 -- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44041eba90 msgr2=0x7f44040b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.011+0000 7f4409547700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44041eba90 0x7f44040b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.011+0000 7f4409547700 1 -- 172.21.15.12:0/3427060858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4404162b80 msgr2=0x7f44040b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.011+0000 7f4409547700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4404162b80 0x7f44040b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.011+0000 7f4409547700 1 -- 172.21.15.12:0/3427060858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4404163120 con 0x7f43f00041f0 2023-07-07T18:15:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.011+0000 7f4409547700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f4404162280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f43f400e590 tx=0x7f43f400e8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.012+0000 7f57f37fe700 1 -- 172.21.15.12:0/1375037146 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f57fc014440 con 0x7f580c159ed0 2023-07-07T18:15:13.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.012+0000 7f57f37fe700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f57f806ace0 0x7f57f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.012+0000 7f43f9ffb700 1 -- 172.21.15.12:0/3427060858 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f400c070 con 0x7f43f00041f0 2023-07-07T18:15:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.012+0000 7f57f37fe700 1 -- 172.21.15.12:0/1375037146 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f57fc089d90 con 0x7f580c159ed0 2023-07-07T18:15:13.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.012+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4404163400 con 0x7f43f00041f0 2023-07-07T18:15:13.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.012+0000 7f90b6ffd700 1 -- 172.21.15.12:0/2031405303 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f90bc054120 con 0x7f90c40ce1a0 2023-07-07T18:15:13.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.013+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4404161040 con 0x7f43f00041f0 2023-07-07T18:15:13.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.013+0000 7f580affd700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f57f806ace0 0x7f57f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.013+0000 7f580affd700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f57f806ace0 0x7f57f806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f580c0affb0 tx=0x7f5804009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.014+0000 7fbce6ffd700 1 -- 172.21.15.12:0/766208985 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbcec018080 con 0x7fbcf40cc260 2023-07-07T18:15:13.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.014+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4404163920 con 0x7f43f00041f0 2023-07-07T18:15:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.015+0000 7f2223fff700 1 -- 172.21.15.12:0/904259056 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234004690 con 0x7f223c06e810 2023-07-07T18:15:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.015+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c15b890 con 0x7f223c06e810 2023-07-07T18:15:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.015+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c0c0f80 con 0x7f223c06e810 2023-07-07T18:15:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.016+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c15bdb0 con 0x7f223c06e810 2023-07-07T18:15:13.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.017+0000 7f2223fff700 1 -- 172.21.15.12:0/904259056 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22340047f0 con 0x7f223c06e810 2023-07-07T18:15:13.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.017+0000 7f2223fff700 1 -- 172.21.15.12:0/904259056 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234030690 con 0x7f223c06e810 2023-07-07T18:15:13.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.017+0000 7f8bf2ffd700 1 -- 172.21.15.12:0/434653106 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8bfc056aa0 con 0x7f8c040cdd50 2023-07-07T18:15:13.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.018+0000 7f57f37fe700 1 -- 172.21.15.12:0/1375037146 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f580c0b32e0 con 0x7f580c159ed0 2023-07-07T18:15:13.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.018+0000 7f43f9ffb700 1 -- 172.21.15.12:0/3427060858 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f4005a20 con 0x7f43f00041f0 2023-07-07T18:15:13.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.018+0000 7f43f9ffb700 1 -- 172.21.15.12:0/3427060858 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4005d90 con 0x7f43f00041f0 2023-07-07T18:15:13.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.019+0000 7f43f9ffb700 1 -- 172.21.15.12:0/3427060858 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43f4013610 con 0x7f43f00041f0 2023-07-07T18:15:13.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.019+0000 7f43f9ffb700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f43e806ace0 0x7f43e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.018+0000 7f2223fff700 1 -- 172.21.15.12:0/904259056 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2234012430 con 0x7f223c06e810 2023-07-07T18:15:13.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.019+0000 7f2223fff700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f222806ace0 0x7f222806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.019+0000 7f2223fff700 1 -- 172.21.15.12:0/904259056 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f223408ba00 con 0x7f223c06e810 2023-07-07T18:15:13.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.019+0000 7f43f9ffb700 1 -- 172.21.15.12:0/3427060858 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f43f4089620 con 0x7f43f00041f0 2023-07-07T18:15:13.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.020+0000 7f223affd700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f222806ace0 0x7f222806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.020+0000 7f223affd700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f222806ace0 0x7f222806d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f222c004ed0 tx=0x7f222c007f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.021+0000 7f4408d46700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f43e806ace0 0x7f43e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.022+0000 7f4408d46700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f43e806ace0 0x7f43e806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f44040b00b0 tx=0x7f4400001760 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.023+0000 7f2223fff700 1 -- 172.21.15.12:0/904259056 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f22340567e0 con 0x7f223c06e810 2023-07-07T18:15:13.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.023+0000 7f2e39619700 1 Processor -- start 2023-07-07T18:15:13.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.023+0000 7f2e39619700 1 -- start start 2023-07-07T18:15:13.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e39619700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 0x7f2e3415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e39619700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2e340711f0 0x7f2e3415a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e39619700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e340cb580 con 0x7f2e34069ef0 2023-07-07T18:15:13.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e39619700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3406db80 con 0x7f2e340711f0 2023-07-07T18:15:13.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e39619700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3415eb10 con 0x7f2e34157a90 2023-07-07T18:15:13.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e32ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 0x7f2e3415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e32ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 0x7f2e3415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46606/0 (socket says 172.21.15.12:46606) 2023-07-07T18:15:13.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e327fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2e34069ef0 0x7f2e34070ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54718/0 (socket says 172.21.15.12:54718) 2023-07-07T18:15:13.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e32ffd700 1 -- 172.21.15.12:0/410633435 learned_addr learned my addr 172.21.15.12:0/410633435 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.024+0000 7f2e337fe700 1 --2- 172.21.15.12:0/410633435 >> v2:172.21.15.12:3300/0 conn(0x7f2e340711f0 0x7f2e3415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.025+0000 7f2e337fe700 1 -- 172.21.15.12:0/410633435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 msgr2=0x7f2e3415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:13.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.025+0000 7f2e337fe700 1 --2- 172.21.15.12:0/410633435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 0x7f2e3415e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.025+0000 7f2e337fe700 1 -- 172.21.15.12:0/410633435 >> v1:172.21.15.12:6789/0 conn(0x7f2e34069ef0 legacy=0x7f2e34070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.025+0000 7f2e337fe700 1 -- 172.21.15.12:0/410633435 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340cafb0 con 0x7f2e340711f0 2023-07-07T18:15:13.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.025+0000 7f2e337fe700 1 --2- 172.21.15.12:0/410633435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 0x7f2e3415a740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c010350 tx=0x7f2e2c010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff40e107fbfdae1 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.025+0000 7f2e31ffb700 1 -- 172.21.15.12:0/410633435 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c003c20 con 0x7f2e340711f0 2023-07-07T18:15:13.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.025+0000 7f2e31ffb700 1 -- 172.21.15.12:0/410633435 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c003d80 con 0x7f2e340711f0 2023-07-07T18:15:13.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.025+0000 7f2e31ffb700 1 -- 172.21.15.12:0/410633435 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c004250 con 0x7f2e340711f0 2023-07-07T18:15:13.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.026+0000 7f2e39619700 1 -- 172.21.15.12:0/410633435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 msgr2=0x7f2e3415a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.026+0000 7f2e39619700 1 --2- 172.21.15.12:0/410633435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 0x7f2e3415a740 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c010350 tx=0x7f2e2c010660 comp rx=0 tx=0).stop 2023-07-07T18:15:13.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.027+0000 7f43f9ffb700 1 -- 172.21.15.12:0/3427060858 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43f4054400 con 0x7f43f00041f0 2023-07-07T18:15:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.030+0000 7f2e39619700 1 -- 172.21.15.12:0/410633435 shutdown_connections 2023-07-07T18:15:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.030+0000 7f2e39619700 1 --2- 172.21.15.12:0/410633435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 0x7f2e3415a740 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.030+0000 7f2e39619700 1 --2- 172.21.15.12:0/410633435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 0x7f2e3415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.030+0000 7f2e39619700 1 -- 172.21.15.12:0/410633435 >> 172.21.15.12:0/410633435 conn(0x7f2e340b1740 msgr2=0x7f2e3406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.030+0000 7f2e39619700 1 -- 172.21.15.12:0/410633435 shutdown_connections 2023-07-07T18:15:13.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.030+0000 7f2e39619700 1 -- 172.21.15.12:0/410633435 wait complete. 2023-07-07T18:15:13.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.032+0000 7f2e39619700 1 Processor -- start 2023-07-07T18:15:13.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.038+0000 7f2e39619700 1 -- start start 2023-07-07T18:15:13.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.039+0000 7f2e39619700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e34069ef0 0x7f2e3414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.039+0000 7f2e39619700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 0x7f2e3415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.039+0000 7f2e39619700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 0x7f2e34150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.039+0000 7f2e39619700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e340c8ef0 con 0x7f2e340711f0 2023-07-07T18:15:13.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.039+0000 7f2e39619700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3415a870 con 0x7f2e34069ef0 2023-07-07T18:15:13.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.039+0000 7f2e39619700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3415d580 con 0x7f2e34157a90 2023-07-07T18:15:13.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.039+0000 7f2e327fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 0x7f2e3415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.039+0000 7f2e327fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 0x7f2e3415b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57524/0 (socket says 172.21.15.12:57524) 2023-07-07T18:15:13.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.039+0000 7f2e327fc700 1 -- 172.21.15.12:0/957815495 learned_addr learned my addr 172.21.15.12:0/957815495 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.040+0000 7f2e327fc700 1 -- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 msgr2=0x7f2e34150d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T18:15:13.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.040+0000 7f2e327fc700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 0x7f2e34150d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.040+0000 7f2e327fc700 1 -- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e34069ef0 msgr2=0x7f2e3414f300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-07T18:15:13.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.040+0000 7f2e327fc700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e34069ef0 0x7f2e3414f300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.040+0000 7f2e327fc700 1 -- 172.21.15.12:0/957815495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c00bc50 con 0x7f2e340711f0 2023-07-07T18:15:13.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.040+0000 7f2e327fc700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 0x7f2e3415b5f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c750 tx=0x7f2e2800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.041+0000 7f2e1b7fe700 1 -- 172.21.15.12:0/957815495 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28004c80 con 0x7f2e340711f0 2023-07-07T18:15:13.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.041+0000 7f2e1b7fe700 1 -- 172.21.15.12:0/957815495 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e28004de0 con 0x7f2e340711f0 2023-07-07T18:15:13.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.041+0000 7f2e1b7fe700 1 -- 172.21.15.12:0/957815495 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e280072f0 con 0x7f2e340711f0 2023-07-07T18:15:13.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.041+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3415ab10 con 0x7f2e340711f0 2023-07-07T18:15:13.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.041+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3415b0d0 con 0x7f2e340711f0 2023-07-07T18:15:13.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.044+0000 7f2e1b7fe700 1 -- 172.21.15.12:0/957815495 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e28007450 con 0x7f2e340711f0 2023-07-07T18:15:13.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.045+0000 7f2e1b7fe700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2e2006ad30 0x7f2e2006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.045+0000 7f2e1b7fe700 1 -- 172.21.15.12:0/957815495 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e28088c90 con 0x7f2e340711f0 2023-07-07T18:15:13.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.046+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e140052f0 con 0x7f2e340711f0 2023-07-07T18:15:13.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.047+0000 7f2e32ffd700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2e2006ad30 0x7f2e2006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.048+0000 7f2e32ffd700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2e2006ad30 0x7f2e2006d1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e240099c0 tx=0x7f2e240092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.049+0000 7f8c02e45700 1 Processor -- start 2023-07-07T18:15:13.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.049+0000 7f8c02e45700 1 -- start start 2023-07-07T18:15:13.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.050+0000 7f8c02e45700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8bfc0cbbf0 0x7f8bfc0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.050+0000 7f8c02e45700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc15bd30 con 0x7f8bfc0cc7a0 2023-07-07T18:15:13.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.050+0000 7f8c02e45700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc159640 con 0x7f8bfc159270 2023-07-07T18:15:13.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.050+0000 7f8c02e45700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc1586a0 con 0x7f8bfc0cbbf0 2023-07-07T18:15:13.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.050+0000 7f8bfbfff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8bfc0cbbf0 0x7f8bfc0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.050+0000 7f8bfbfff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8bfc0cbbf0 0x7f8bfc0cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53136/0 (socket says 172.21.15.12:53136) 2023-07-07T18:15:13.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.050+0000 7f8bfbfff700 1 -- 172.21.15.12:0/829429969 learned_addr learned my addr 172.21.15.12:0/829429969 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.051+0000 7f8bfbfff700 1 -- 172.21.15.12:0/829429969 >> v1:172.21.15.160:6789/0 conn(0x7f8bfc159270 legacy=0x7f8bfc0cb4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-07T18:15:13.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.051+0000 7f8bfbfff700 1 -- 172.21.15.12:0/829429969 >> v1:172.21.15.12:6789/0 conn(0x7f8bfc0cc7a0 legacy=0x7f8bfc06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:13.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.051+0000 7f8bfbfff700 1 -- 172.21.15.12:0/829429969 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0ccbe0 con 0x7f8bfc0cbbf0 2023-07-07T18:15:13.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.051+0000 7f8bfbfff700 1 --2- 172.21.15.12:0/829429969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bfc0cbbf0 0x7f8bfc0cc260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00088f0 tx=0x7f8bf000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64d8f061a9b9105f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.051+0000 7f8bfb7fe700 1 -- 172.21.15.12:0/829429969 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0010070 con 0x7f8bfc0cbbf0 2023-07-07T18:15:13.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.051+0000 7f8bfb7fe700 1 -- 172.21.15.12:0/829429969 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf000da00 con 0x7f8bfc0cbbf0 2023-07-07T18:15:13.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.051+0000 7f8bfb7fe700 1 -- 172.21.15.12:0/829429969 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000dd90 con 0x7f8bfc0cbbf0 2023-07-07T18:15:13.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.053+0000 7f8c02e45700 1 -- 172.21.15.12:0/829429969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bfc0cbbf0 msgr2=0x7f8bfc0cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.053+0000 7f8c02e45700 1 --2- 172.21.15.12:0/829429969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bfc0cbbf0 0x7f8bfc0cc260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00088f0 tx=0x7f8bf000d330 comp rx=0 tx=0).stop 2023-07-07T18:15:13.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.053+0000 7f8c02e45700 1 -- 172.21.15.12:0/829429969 shutdown_connections 2023-07-07T18:15:13.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.053+0000 7f8c02e45700 1 --2- 172.21.15.12:0/829429969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bfc0cbbf0 0x7f8bfc0cc260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.053+0000 7f8c02e45700 1 -- 172.21.15.12:0/829429969 >> 172.21.15.12:0/829429969 conn(0x7f8bfc0b0260 msgr2=0x7f8bfc0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.053+0000 7f8c02e45700 1 -- 172.21.15.12:0/829429969 shutdown_connections 2023-07-07T18:15:13.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.053+0000 7f8c02e45700 1 -- 172.21.15.12:0/829429969 wait complete. 2023-07-07T18:15:13.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.055+0000 7f8c02e45700 1 Processor -- start 2023-07-07T18:15:13.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.055+0000 7f2e1b7fe700 1 -- 172.21.15.12:0/957815495 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2e28053bc0 con 0x7f2e340711f0 2023-07-07T18:15:13.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.055+0000 7f8c02e45700 1 -- start start 2023-07-07T18:15:13.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8c02e45700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bfc0cbbf0 0x7f8bfc0c1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8c02e45700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bfc0cc7a0 0x7f8bfc0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8c02e45700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc159270 0x7f8bfc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8c02e45700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0b3b80 con 0x7f8bfc159270 2023-07-07T18:15:13.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8c02e45700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0b3760 con 0x7f8bfc0cbbf0 2023-07-07T18:15:13.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8c02e45700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0c4540 con 0x7f8bfc0cc7a0 2023-07-07T18:15:13.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8bfbfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bfc0cc7a0 0x7f8bfc0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8bfbfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bfc0cc7a0 0x7f8bfc0b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46624/0 (socket says 172.21.15.12:46624) 2023-07-07T18:15:13.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8bfbfff700 1 -- 172.21.15.12:0/1401883506 learned_addr learned my addr 172.21.15.12:0/1401883506 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:13.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.057+0000 7f8c013e2700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc159270 0x7f8bfc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.058+0000 7f8c013e2700 1 -- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bfc0cc7a0 msgr2=0x7f8bfc0b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.058+0000 7f8c013e2700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bfc0cc7a0 0x7f8bfc0b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.058+0000 7f8c013e2700 1 -- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bfc0cbbf0 msgr2=0x7f8bfc0c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.058+0000 7f8c013e2700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bfc0cbbf0 0x7f8bfc0c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.058+0000 7f8c013e2700 1 -- 172.21.15.12:0/1401883506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00085d0 con 0x7f8bfc159270 2023-07-07T18:15:13.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.058+0000 7f8c013e2700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc159270 0x7f8bfc0b24b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400c780 tx=0x7f8bf400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.062+0000 7f8bf97fa700 1 -- 172.21.15.12:0/1401883506 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4003e10 con 0x7f8bfc159270 2023-07-07T18:15:13.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.062+0000 7f8bf97fa700 1 -- 172.21.15.12:0/1401883506 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf40050f0 con 0x7f8bfc159270 2023-07-07T18:15:13.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.062+0000 7f8bf97fa700 1 -- 172.21.15.12:0/1401883506 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf40054a0 con 0x7f8bfc159270 2023-07-07T18:15:13.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.064+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc0b2ae0 con 0x7f8bfc159270 2023-07-07T18:15:13.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.064+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc0b30a0 con 0x7f8bfc159270 2023-07-07T18:15:13.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.066+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc0b38a0 con 0x7f8bfc159270 2023-07-07T18:15:13.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.081+0000 7f8bf97fa700 1 -- 172.21.15.12:0/1401883506 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8bf4005600 con 0x7f8bfc159270 2023-07-07T18:15:13.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.082+0000 7f8bf97fa700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8be806adb0 0x7f8be806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:13.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.082+0000 7f8bf97fa700 1 -- 172.21.15.12:0/1401883506 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8bf40891b0 con 0x7f8bfc159270 2023-07-07T18:15:13.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.082+0000 7f8bf97fa700 1 -- 172.21.15.12:0/1401883506 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8bf4089630 con 0x7f8bfc159270 2023-07-07T18:15:13.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.088+0000 7f8c00be1700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8be806adb0 0x7f8be806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:13.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.133+0000 7f8c00be1700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8be806adb0 0x7f8be806d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0096d0 tx=0x7f8bec006c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:13.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.412+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f223c15b410 con 0x7f223c06e810 2023-07-07T18:15:13.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.414+0000 7f2223fff700 1 -- 172.21.15.12:0/904259056 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f223c15b410 con 0x7f223c06e810 2023-07-07T18:15:13.416 INFO:teuthology.orchestra.run.smithi012.stdout:60129542154 2023-07-07T18:15:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.419+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f222806ace0 msgr2=0x7f222806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.419+0000 7f2241e6f700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f222806ace0 0x7f222806d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f222c004ed0 tx=0x7f222c007f70 comp rx=0 tx=0).stop 2023-07-07T18:15:13.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.419+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f223c06e810 msgr2=0x7f223c0c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.419+0000 7f2241e6f700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f223c06e810 0x7f223c0c0a40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2234016000 tx=0x7f2234004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.423 INFO:teuthology.orchestra.run.smithi012.stdout:64424509451 2023-07-07T18:15:13.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 shutdown_connections 2023-07-07T18:15:13.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f2241e6f700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f222806ace0 0x7f222806d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f2241e6f700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c163940 0x7f223c15c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f2241e6f700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f223c06e810 0x7f223c0c0a40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f2241e6f700 1 --2- 172.21.15.12:0/904259056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f223c1605d0 0x7f223c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 >> 172.21.15.12:0/904259056 conn(0x7f223c0cf7d0 msgr2=0x7f223c0b4470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.421+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f580c073910 con 0x7f580c159ed0 2023-07-07T18:15:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.421+0000 7f57f37fe700 1 -- 172.21.15.12:0/1375037146 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f57fc0585e0 con 0x7f580c159ed0 2023-07-07T18:15:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f57f806ace0 msgr2=0x7f57f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f5811428700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f57f806ace0 0x7f57f806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f580c0affb0 tx=0x7f5804009030 comp rx=0 tx=0).stop 2023-07-07T18:15:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580c159ed0 msgr2=0x7f580c154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.424+0000 7f5811428700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580c159ed0 0x7f580c154e20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f57fc011980 tx=0x7f57fc011c90 comp rx=0 tx=0).stop 2023-07-07T18:15:13.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.425+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 shutdown_connections 2023-07-07T18:15:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.425+0000 7f5811428700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f57f806ace0 0x7f57f806d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.425+0000 7f5811428700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580c1ed950 0x7f580c1eddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.425+0000 7f5811428700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57f4003a00 0x7f580c0c2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.425+0000 7f5811428700 1 --2- 172.21.15.12:0/1375037146 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f580c159ed0 0x7f580c154e20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.425+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 >> 172.21.15.12:0/1375037146 conn(0x7f580c0b0260 msgr2=0x7f580c158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.429+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 shutdown_connections 2023-07-07T18:15:13.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.429+0000 7f2241e6f700 1 -- 172.21.15.12:0/904259056 wait complete. 2023-07-07T18:15:13.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.429+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 shutdown_connections 2023-07-07T18:15:13.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.430+0000 7f5811428700 1 -- 172.21.15.12:0/1375037146 wait complete. 2023-07-07T18:15:13.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.431+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f90c4073910 con 0x7f90c40ce1a0 2023-07-07T18:15:13.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.433+0000 7f90b6ffd700 1 -- 172.21.15.12:0/2031405303 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90bc05b090 con 0x7f90c40ce1a0 2023-07-07T18:15:13.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.438+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8be8005870 con 0x7f8c040cdd50 2023-07-07T18:15:13.440 INFO:teuthology.orchestra.run.smithi012.stdout:60129542154 2023-07-07T18:15:13.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbcdc005870 con 0x7fbcf40cc260 2023-07-07T18:15:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f90a806ace0 msgr2=0x7f90a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7f90cc5f6700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f90a806ace0 0x7f90a806d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f90b800bee0 tx=0x7f90b801b040 comp rx=0 tx=0).stop 2023-07-07T18:15:13.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c40ce1a0 msgr2=0x7f90c40c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7f90cc5f6700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c40ce1a0 0x7f90c40c83d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00be20 tx=0x7f90bc009ef0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 shutdown_connections 2023-07-07T18:15:13.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7f90cc5f6700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f90a806ace0 0x7f90a806d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7f90cc5f6700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c40ce1a0 0x7f90c40c83d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7f90cc5f6700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90c40ae6c0 0x7f90c40b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.440+0000 7f90cc5f6700 1 --2- 172.21.15.12:0/2031405303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90c40cddd0 0x7f90c40b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.441+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 >> 172.21.15.12:0/2031405303 conn(0x7f90c406d4a0 msgr2=0x7f90c4156250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.441+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 shutdown_connections 2023-07-07T18:15:13.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.441+0000 7f90cc5f6700 1 -- 172.21.15.12:0/2031405303 wait complete. 2023-07-07T18:15:13.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.441+0000 7f8bf2ffd700 1 -- 172.21.15.12:0/434653106 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8bfc05a0c0 con 0x7f8c040cdd50 2023-07-07T18:15:13.445 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:13.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.443+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f44041609a0 con 0x7f43f00041f0 2023-07-07T18:15:13.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.443+0000 7f43f9ffb700 1 -- 172.21.15.12:0/3427060858 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43f4057a20 con 0x7f43f00041f0 2023-07-07T18:15:13.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.444+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8bec06ae90 msgr2=0x7f8bec06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.444+0000 7f8c08a71700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8bec06ae90 0x7f8bec06d340 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8c040ae210 tx=0x7f8bf4008040 comp rx=0 tx=0).stop 2023-07-07T18:15:13.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.444+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c040cdd50 msgr2=0x7f8c040b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.444+0000 7f8c08a71700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c040cdd50 0x7f8c040b2100 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009fd0 tx=0x7f8bfc004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.445+0000 7fbce6ffd700 1 -- 172.21.15.12:0/766208985 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcec057e50 con 0x7fbcf40cc260 2023-07-07T18:15:13.447 INFO:teuthology.orchestra.run.smithi012.stdout:60129542154 2023-07-07T18:15:13.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbcd806ad30 msgr2=0x7fbcd806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbcd806ad30 0x7fbcd806d1e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40c8810 tx=0x7fbce8009190 comp rx=0 tx=0).stop 2023-07-07T18:15:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcf40cc260 msgr2=0x7fbcf40c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcf40cc260 0x7fbcf40c3750 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00cbd0 tx=0x7fbcec00cee0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 shutdown_connections 2023-07-07T18:15:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbcd806ad30 0x7fbcd806d1e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbcf40cc260 0x7fbcf40c3750 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbcf40b0d40 0x7fbcf40b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 --2- 172.21.15.12:0/766208985 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcf40cb4e0 0x7fbcf40c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 >> 172.21.15.12:0/766208985 conn(0x7fbcf40b0260 msgr2=0x7fbcf40b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 shutdown_connections 2023-07-07T18:15:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 shutdown_connections 2023-07-07T18:15:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7f8c08a71700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8bec06ae90 0x7f8bec06d340 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7f8c08a71700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c0415fdd0 0x7f8c041f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7f8c08a71700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c040cb390 0x7f8c040b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7f8c08a71700 1 --2- 172.21.15.12:0/434653106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c040cdd50 0x7f8c040b2100 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.448+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 >> 172.21.15.12:0/434653106 conn(0x7f8c040b0260 msgr2=0x7f8c0406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.454 INFO:teuthology.orchestra.run.smithi012.stdout:60129542154 2023-07-07T18:15:13.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.2 2023-07-07T18:15:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.451+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 shutdown_connections 2023-07-07T18:15:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.451+0000 7f8c08a71700 1 -- 172.21.15.12:0/434653106 wait complete. 2023-07-07T18:15:13.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.452+0000 7fbcfc526700 1 -- 172.21.15.12:0/766208985 wait complete. 2023-07-07T18:15:13.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.7 2023-07-07T18:15:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.453+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f43e806ace0 msgr2=0x7f43e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.453+0000 7f440b7ab700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f43e806ace0 0x7f43e806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f44040b00b0 tx=0x7f4400001760 comp rx=0 tx=0).stop 2023-07-07T18:15:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.453+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 msgr2=0x7f4404162280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.453+0000 7f440b7ab700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f4404162280 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f43f400e590 tx=0x7f43f400e8a0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.454+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 shutdown_connections 2023-07-07T18:15:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.454+0000 7f440b7ab700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f43e806ace0 0x7f43e806d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.454+0000 7f440b7ab700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4404162b80 0x7f44040b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.454+0000 7f440b7ab700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43f00041f0 0x7f4404162280 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.454+0000 7f440b7ab700 1 --2- 172.21.15.12:0/3427060858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44041eba90 0x7f44040b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.454+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 >> 172.21.15.12:0/3427060858 conn(0x7f44040b0260 msgr2=0x7f4404069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.454+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 shutdown_connections 2023-07-07T18:15:13.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.454+0000 7f440b7ab700 1 -- 172.21.15.12:0/3427060858 wait complete. 2023-07-07T18:15:13.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.456+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2e14005870 con 0x7f2e340711f0 2023-07-07T18:15:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.459+0000 7f2e1b7fe700 1 -- 172.21.15.12:0/957815495 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e28018030 con 0x7f2e340711f0 2023-07-07T18:15:13.462 INFO:teuthology.orchestra.run.smithi012.stdout:60129542154 2023-07-07T18:15:13.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2023-07-07T18:15:13.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.464+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2e2006ad30 msgr2=0x7f2e2006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.464+0000 7f2e39619700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2e2006ad30 0x7f2e2006d1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2e240099c0 tx=0x7f2e240092c0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.464+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 msgr2=0x7f2e3415b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.464+0000 7f2e39619700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 0x7f2e3415b5f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c750 tx=0x7f2e2800cb10 comp rx=0 tx=0).stop 2023-07-07T18:15:13.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.464+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 shutdown_connections 2023-07-07T18:15:13.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.465+0000 7f2e39619700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2e2006ad30 0x7f2e2006d1e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.465+0000 7f2e39619700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e34157a90 0x7f2e34150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.465+0000 7f2e39619700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e34069ef0 0x7f2e3414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.465+0000 7f2e39619700 1 --2- 172.21.15.12:0/957815495 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e340711f0 0x7f2e3415b5f0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c750 tx=0x7f2e2800cb10 comp rx=0 tx=0).stop 2023-07-07T18:15:13.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.465+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 >> 172.21.15.12:0/957815495 conn(0x7f2e340b1740 msgr2=0x7f2e340cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.465+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 shutdown_connections 2023-07-07T18:15:13.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.465+0000 7f2e39619700 1 -- 172.21.15.12:0/957815495 wait complete. 2023-07-07T18:15:13.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.0 2023-07-07T18:15:13.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.471+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bfc0b38a0 con 0x7f8bfc159270 2023-07-07T18:15:13.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.472+0000 7f8bf97fa700 1 -- 172.21.15.12:0/1401883506 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8bfc0b38a0 con 0x7f8bfc159270 2023-07-07T18:15:13.474 INFO:teuthology.orchestra.run.smithi012.stdout:60129542153 2023-07-07T18:15:13.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.6 2023-07-07T18:15:13.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.5 2023-07-07T18:15:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.474+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8be806adb0 msgr2=0x7f8be806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.474+0000 7f8c02e45700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8be806adb0 0x7f8be806d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bec0096d0 tx=0x7f8bec006c30 comp rx=0 tx=0).stop 2023-07-07T18:15:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.474+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc159270 msgr2=0x7f8bfc0b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.474+0000 7f8c02e45700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc159270 0x7f8bfc0b24b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8bf400c780 tx=0x7f8bf400cb40 comp rx=0 tx=0).stop 2023-07-07T18:15:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.475+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 shutdown_connections 2023-07-07T18:15:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.475+0000 7f8c02e45700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8be806adb0 0x7f8be806d260 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.475+0000 7f8c02e45700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bfc159270 0x7f8bfc0b24b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.475+0000 7f8c02e45700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bfc0cbbf0 0x7f8bfc0c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.475+0000 7f8c02e45700 1 --2- 172.21.15.12:0/1401883506 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bfc0cc7a0 0x7f8bfc0b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.475+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 >> 172.21.15.12:0/1401883506 conn(0x7f8bfc0b0260 msgr2=0x7f8bfc0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.475+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 shutdown_connections 2023-07-07T18:15:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:13.475+0000 7f8c02e45700 1 -- 172.21.15.12:0/1401883506 wait complete. 2023-07-07T18:15:13.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.4 2023-07-07T18:15:13.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.1 2023-07-07T18:15:14.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:15:14.375 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:15:14.455 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-07T18:15:14.457 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-07T18:15:14.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-07T18:15:14.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-07T18:15:14.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-07T18:15:14.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-07T18:15:14.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-07T18:15:14.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-07T18:15:14.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.651+0000 7f5f55737700 1 Processor -- start 2023-07-07T18:15:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.651+0000 7f5f55737700 1 -- start start 2023-07-07T18:15:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.652+0000 7f5f55737700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f50159270 0x7f5f500cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.652+0000 7f5f55737700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5f500cc970 0x7f5f5006c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.652+0000 7f5f55737700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5015bd30 con 0x7f5f500cba20 2023-07-07T18:15:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.652+0000 7f5f55737700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f501586a0 con 0x7f5f500cc970 2023-07-07T18:15:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.652+0000 7f5f55737700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500cbe90 con 0x7f5f50159270 2023-07-07T18:15:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.653+0000 7f5f4f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5f500cc970 0x7f5f5006c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.653+0000 7f5f4f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5f500cc970 0x7f5f5006c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57544/0 (socket says 172.21.15.12:57544) 2023-07-07T18:15:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.653+0000 7f5f4f7fe700 1 -- 172.21.15.12:0/356977376 learned_addr learned my addr 172.21.15.12:0/356977376 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.653+0000 7f5f4effd700 1 --2- 172.21.15.12:0/356977376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f50159270 0x7f5f500cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.654+0000 7f5f4f7fe700 1 -- 172.21.15.12:0/356977376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f50159270 msgr2=0x7f5f500cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.654+0000 7f5f4f7fe700 1 --2- 172.21.15.12:0/356977376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f50159270 0x7f5f500cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.654+0000 7f5f4f7fe700 1 -- 172.21.15.12:0/356977376 >> v1:172.21.15.160:6789/0 conn(0x7f5f500cba20 legacy=0x7f5f500cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.654+0000 7f5f4f7fe700 1 -- 172.21.15.12:0/356977376 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f50159640 con 0x7f5f500cc970 2023-07-07T18:15:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.654+0000 7f5f4f7fe700 1 --2- 172.21.15.12:0/356977376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f500cc970 0x7f5f5006c270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800d3a0 tx=0x7f5f4800d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb339e6c06ffdc6e server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.654+0000 7f5f4dffb700 1 -- 172.21.15.12:0/356977376 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48010070 con 0x7f5f500cc970 2023-07-07T18:15:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.655+0000 7f5f4dffb700 1 -- 172.21.15.12:0/356977376 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4800dd00 con 0x7f5f500cc970 2023-07-07T18:15:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.655+0000 7f5f4dffb700 1 -- 172.21.15.12:0/356977376 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48007d70 con 0x7f5f500cc970 2023-07-07T18:15:14.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.656+0000 7f5f55737700 1 -- 172.21.15.12:0/356977376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f500cc970 msgr2=0x7f5f5006c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.656+0000 7f5f55737700 1 --2- 172.21.15.12:0/356977376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f500cc970 0x7f5f5006c270 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800d3a0 tx=0x7f5f4800d6b0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.658+0000 7f5f55737700 1 -- 172.21.15.12:0/356977376 shutdown_connections 2023-07-07T18:15:14.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.658+0000 7f5f55737700 1 --2- 172.21.15.12:0/356977376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f500cc970 0x7f5f5006c270 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.658+0000 7f5f55737700 1 --2- 172.21.15.12:0/356977376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f50159270 0x7f5f500cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.658+0000 7f5f55737700 1 -- 172.21.15.12:0/356977376 >> 172.21.15.12:0/356977376 conn(0x7f5f500b0260 msgr2=0x7f5f500b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:14.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.659+0000 7f5f55737700 1 -- 172.21.15.12:0/356977376 shutdown_connections 2023-07-07T18:15:14.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.659+0000 7f5f55737700 1 -- 172.21.15.12:0/356977376 wait complete. 2023-07-07T18:15:14.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.661+0000 7f5f55737700 1 Processor -- start 2023-07-07T18:15:14.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.663+0000 7f0ae0faf700 1 Processor -- start 2023-07-07T18:15:14.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.662+0000 7f5f55737700 1 -- start start 2023-07-07T18:15:14.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.663+0000 7f5f55737700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f500cba20 0x7f5f500ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.663+0000 7f5f55737700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f500cc970 0x7f5f501fe570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.663+0000 7f5f55737700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f50159270 0x7f5f501e52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.663+0000 7f5f55737700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500af650 con 0x7f5f50159270 2023-07-07T18:15:14.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.663+0000 7f5f55737700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500aea40 con 0x7f5f500cba20 2023-07-07T18:15:14.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.663+0000 7f5f55737700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500aed20 con 0x7f5f500cc970 2023-07-07T18:15:14.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.664+0000 7f5f4effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f500cba20 0x7f5f500ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.664+0000 7f5f4effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f500cba20 0x7f5f500ae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53158/0 (socket says 172.21.15.12:53158) 2023-07-07T18:15:14.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.664+0000 7f5f4effd700 1 -- 172.21.15.12:0/3024450740 learned_addr learned my addr 172.21.15.12:0/3024450740 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.663+0000 7f0ae0faf700 1 -- start start 2023-07-07T18:15:14.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f0ae0faf700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0adc159270 0x7f0adc0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f0ae0faf700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0adc0cba20 0x7f0adc0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f0ae0faf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cc7a0 0x7f0adc069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f0ae0faf700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc1586a0 con 0x7f0adc159270 2023-07-07T18:15:14.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f0ae0faf700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0adc0cbec0 con 0x7f0adc0cba20 2023-07-07T18:15:14.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f0ae0faf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc15bd30 con 0x7f0adc0cc7a0 2023-07-07T18:15:14.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f5f4f7fe700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f50159270 0x7f5f501e52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f0ada59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0adc159270 0x7f0adc0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f0ada59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0adc159270 0x7f0adc0cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57554/0 (socket says 172.21.15.12:57554) 2023-07-07T18:15:14.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.665+0000 7f0ada59c700 1 -- 172.21.15.12:0/915637855 learned_addr learned my addr 172.21.15.12:0/915637855 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f5f4e7fc700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f500cc970 0x7f5f501fe570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f0ad9d9b700 1 --2- 172.21.15.12:0/915637855 >> v2:172.21.15.160:3300/0 conn(0x7f0adc0cba20 0x7f0adc0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f0adad9d700 1 --2- 172.21.15.12:0/915637855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cc7a0 0x7f0adc069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f5f4f7fe700 1 -- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f500cc970 msgr2=0x7f5f501fe570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f5f4f7fe700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f500cc970 0x7f5f501fe570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f5f4f7fe700 1 -- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f500cba20 msgr2=0x7f5f500ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f5f4f7fe700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f500cba20 0x7f5f500ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f5f4f7fe700 1 -- 172.21.15.12:0/3024450740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4800d050 con 0x7f5f50159270 2023-07-07T18:15:14.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f0ada59c700 1 -- 172.21.15.12:0/915637855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cc7a0 msgr2=0x7f0adc069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f0ada59c700 1 --2- 172.21.15.12:0/915637855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cc7a0 0x7f0adc069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f0ada59c700 1 -- 172.21.15.12:0/915637855 >> v2:172.21.15.160:3300/0 conn(0x7f0adc0cba20 msgr2=0x7f0adc0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f0ada59c700 1 --2- 172.21.15.12:0/915637855 >> v2:172.21.15.160:3300/0 conn(0x7f0adc0cba20 0x7f0adc0cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f0ada59c700 1 -- 172.21.15.12:0/915637855 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0ccc00 con 0x7f0adc159270 2023-07-07T18:15:14.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.666+0000 7f5f4f7fe700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f50159270 0x7f5f501e52e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f48017000 tx=0x7f5f48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.667+0000 7f0ada59c700 1 --2- 172.21.15.12:0/915637855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc159270 0x7f0adc0cb4e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ad720 tx=0x7f0ad400d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f89fc887a1ea406 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.667+0000 7f0ad959a700 1 -- 172.21.15.12:0/915637855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4010070 con 0x7f0adc159270 2023-07-07T18:15:14.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.667+0000 7f0ad959a700 1 -- 172.21.15.12:0/915637855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad400dce0 con 0x7f0adc159270 2023-07-07T18:15:14.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.667+0000 7f0ad959a700 1 -- 172.21.15.12:0/915637855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4007d70 con 0x7f0adc159270 2023-07-07T18:15:14.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.668+0000 7f0ae0faf700 1 -- 172.21.15.12:0/915637855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc159270 msgr2=0x7f0adc0cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.668+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/915637855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc159270 0x7f0adc0cb4e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ad720 tx=0x7f0ad400d650 comp rx=0 tx=0).stop 2023-07-07T18:15:14.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.667+0000 7f5f377fe700 1 -- 172.21.15.12:0/3024450740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48004440 con 0x7f5f50159270 2023-07-07T18:15:14.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.667+0000 7f5f377fe700 1 -- 172.21.15.12:0/3024450740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480045a0 con 0x7f5f50159270 2023-07-07T18:15:14.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.667+0000 7f5f377fe700 1 -- 172.21.15.12:0/3024450740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48004950 con 0x7f5f50159270 2023-07-07T18:15:14.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.667+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f500af000 con 0x7f5f50159270 2023-07-07T18:15:14.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.667+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f501feab0 con 0x7f5f50159270 2023-07-07T18:15:14.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.670+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f300052f0 con 0x7f5f50159270 2023-07-07T18:15:14.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.677+0000 7f0ae0faf700 1 -- 172.21.15.12:0/915637855 shutdown_connections 2023-07-07T18:15:14.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.677+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/915637855 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cc7a0 0x7f0adc069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.677+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/915637855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc159270 0x7f0adc0cb4e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.677+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/915637855 >> v2:172.21.15.160:3300/0 conn(0x7f0adc0cba20 0x7f0adc0cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.677+0000 7f0ae0faf700 1 -- 172.21.15.12:0/915637855 >> 172.21.15.12:0/915637855 conn(0x7f0adc0b0260 msgr2=0x7f0adc0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:14.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.671+0000 7f5f377fe700 1 -- 172.21.15.12:0/3024450740 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f48008040 con 0x7f5f50159270 2023-07-07T18:15:14.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.672+0000 7f5f377fe700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5f3c06ad30 0x7f5f3c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.672+0000 7f5f377fe700 1 -- 172.21.15.12:0/3024450740 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f4808bed0 con 0x7f5f50159270 2023-07-07T18:15:14.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.677+0000 7f5f4effd700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5f3c06ad30 0x7f5f3c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.681+0000 7f0ae0faf700 1 -- 172.21.15.12:0/915637855 shutdown_connections 2023-07-07T18:15:14.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.681+0000 7f5f377fe700 1 -- 172.21.15.12:0/3024450740 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5f48056e00 con 0x7f5f50159270 2023-07-07T18:15:14.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.681+0000 7f5f4effd700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5f3c06ad30 0x7f5f3c06d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f500c56d0 tx=0x7f5f44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.681+0000 7f0ae0faf700 1 -- 172.21.15.12:0/915637855 wait complete. 2023-07-07T18:15:14.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.684+0000 7f0ae0faf700 1 Processor -- start 2023-07-07T18:15:14.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.685+0000 7f0ae0faf700 1 -- start start 2023-07-07T18:15:14.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.686+0000 7f0ae0faf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cba20 0x7f0adc0c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.687+0000 7f0ae0faf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0cc7a0 0x7f0adc0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.687+0000 7f0ae0faf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0adc159270 0x7f0adc1f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.687+0000 7f0ae0faf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0b25c0 con 0x7f0adc0cc7a0 2023-07-07T18:15:14.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.687+0000 7f0ae0faf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0b1940 con 0x7f0adc159270 2023-07-07T18:15:14.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.687+0000 7f0ae0faf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0adc0b1c20 con 0x7f0adc0cba20 2023-07-07T18:15:14.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.687+0000 7f0adad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0adc159270 0x7f0adc1f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.688+0000 7f0adad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0adc159270 0x7f0adc1f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53168/0 (socket says 172.21.15.12:53168) 2023-07-07T18:15:14.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.688+0000 7f0adad9d700 1 -- 172.21.15.12:0/42118718 learned_addr learned my addr 172.21.15.12:0/42118718 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.688+0000 7f0ad9d9b700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0cc7a0 0x7f0adc0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.689+0000 7f0ada59c700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cba20 0x7f0adc0c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.689+0000 7f0adad9d700 1 -- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cba20 msgr2=0x7f0adc0c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.689+0000 7f0adad9d700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cba20 0x7f0adc0c40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.689+0000 7f0adad9d700 1 -- 172.21.15.12:0/42118718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0cc7a0 msgr2=0x7f0adc0b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.689+0000 7f0adad9d700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0cc7a0 0x7f0adc0b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.689+0000 7f0adad9d700 1 -- 172.21.15.12:0/42118718 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad400d050 con 0x7f0adc159270 2023-07-07T18:15:14.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.689+0000 7f0adad9d700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0adc159270 0x7f0adc1f2d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c7f0 tx=0x7f0ad000cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.689+0000 7f0acaffd700 1 -- 172.21.15.12:0/42118718 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad0004220 con 0x7f0adc159270 2023-07-07T18:15:14.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.690+0000 7f0acaffd700 1 -- 172.21.15.12:0/42118718 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad0004380 con 0x7f0adc159270 2023-07-07T18:15:14.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.690+0000 7f0acaffd700 1 -- 172.21.15.12:0/42118718 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00036a0 con 0x7f0adc159270 2023-07-07T18:15:14.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.690+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0adc0b1f00 con 0x7f0adc159270 2023-07-07T18:15:14.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.690+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0adc0b1560 con 0x7f0adc159270 2023-07-07T18:15:14.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.692+0000 7f0acaffd700 1 -- 172.21.15.12:0/42118718 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ad0003800 con 0x7f0adc159270 2023-07-07T18:15:14.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.693+0000 7f0acaffd700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0abc06adb0 0x7f0abc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.693+0000 7f0acaffd700 1 -- 172.21.15.12:0/42118718 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0ad0089240 con 0x7f0adc159270 2023-07-07T18:15:14.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.693+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0adc073910 con 0x7f0adc159270 2023-07-07T18:15:14.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.697+0000 7f0ada59c700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0abc06adb0 0x7f0abc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.697+0000 7f0ada59c700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0abc06adb0 0x7f0abc06d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400d690 tx=0x7f0ad4012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.699+0000 7f0acaffd700 1 -- 172.21.15.12:0/42118718 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0ad0015080 con 0x7f0adc159270 2023-07-07T18:15:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.724+0000 7fddfd63a700 1 Processor -- start 2023-07-07T18:15:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.724+0000 7fddfd63a700 1 -- start start 2023-07-07T18:15:14.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.725+0000 7f9862a1a700 1 Processor -- start 2023-07-07T18:15:14.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7fddfd63a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80b0d40 0x7fddf8159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7fddfd63a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fddf80cb4e0 0x7fddf80cb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7fddfd63a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80cbe70 con 0x7fddf80cc260 2023-07-07T18:15:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7fddfd63a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf81586a0 con 0x7fddf80cb4e0 2023-07-07T18:15:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7fddfd63a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf815f0a0 con 0x7fddf80b0d40 2023-07-07T18:15:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.725+0000 7f9862a1a700 1 -- start start 2023-07-07T18:15:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7fddf6ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80b0d40 0x7fddf8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7f9862a1a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f985c0b0d40 0x7f985c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7f9862a1a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f985c0cb4e0 0x7f985c0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7f9862a1a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0cc260 0x7f985c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7f9862a1a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c159720 con 0x7f985c0b0d40 2023-07-07T18:15:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7f9862a1a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c1586a0 con 0x7f985c0cb4e0 2023-07-07T18:15:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7f9862a1a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0cbec0 con 0x7f985c0cc260 2023-07-07T18:15:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7fddf6ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80b0d40 0x7fddf8159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46660/0 (socket says 172.21.15.12:46660) 2023-07-07T18:15:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7fddf6ffd700 1 -- 172.21.15.12:0/2968620794 learned_addr learned my addr 172.21.15.12:0/2968620794 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.726+0000 7fddf67fc700 1 --2- 172.21.15.12:0/2968620794 >> v2:172.21.15.160:3300/0 conn(0x7fddf80cb4e0 0x7fddf80cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f985b7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f985c0cb4e0 0x7f985c0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7fddf6ffd700 1 -- 172.21.15.12:0/2968620794 >> v2:172.21.15.160:3300/0 conn(0x7fddf80cb4e0 msgr2=0x7fddf80cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7fddf6ffd700 1 --2- 172.21.15.12:0/2968620794 >> v2:172.21.15.160:3300/0 conn(0x7fddf80cb4e0 0x7fddf80cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7fddf6ffd700 1 -- 172.21.15.12:0/2968620794 >> v1:172.21.15.160:6789/0 conn(0x7fddf80cc260 legacy=0x7fddf80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7fddf6ffd700 1 -- 172.21.15.12:0/2968620794 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf815bfd0 con 0x7fddf80b0d40 2023-07-07T18:15:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7fddf6ffd700 1 --2- 172.21.15.12:0/2968620794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80b0d40 0x7fddf8159000 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e50 tx=0x7fddf000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49168e5a2b5e8595 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f9860fb7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0cc260 0x7f985c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f985b7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f985c0cb4e0 0x7f985c0cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53182/0 (socket says 172.21.15.12:53182) 2023-07-07T18:15:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f985b7fe700 1 -- 172.21.15.12:0/226808078 learned_addr learned my addr 172.21.15.12:0/226808078 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f9860fb7700 1 -- 172.21.15.12:0/226808078 >> v2:172.21.15.160:3300/0 conn(0x7f985c0cb4e0 msgr2=0x7f985c0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f9860fb7700 1 --2- 172.21.15.12:0/226808078 >> v2:172.21.15.160:3300/0 conn(0x7f985c0cb4e0 0x7f985c0cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f9860fb7700 1 -- 172.21.15.12:0/226808078 >> v2:172.21.15.12:3300/0 conn(0x7f985c0b0d40 msgr2=0x7f985c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f9860fb7700 1 --2- 172.21.15.12:0/226808078 >> v2:172.21.15.12:3300/0 conn(0x7f985c0b0d40 0x7f985c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f9860fb7700 1 -- 172.21.15.12:0/226808078 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c15bd30 con 0x7f985c0cc260 2023-07-07T18:15:14.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7f9860fb7700 1 --2- 172.21.15.12:0/226808078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0cc260 0x7f985c0cc6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f985c0ad720 tx=0x7f985400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=befcef23a37f5d81 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.727+0000 7fddf5ffb700 1 -- 172.21.15.12:0/2968620794 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000e070 con 0x7fddf80b0d40 2023-07-07T18:15:14.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.728+0000 7fddf5ffb700 1 -- 172.21.15.12:0/2968620794 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf000b9c0 con 0x7fddf80b0d40 2023-07-07T18:15:14.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.728+0000 7fddf5ffb700 1 -- 172.21.15.12:0/2968620794 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000bd70 con 0x7fddf80b0d40 2023-07-07T18:15:14.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.728+0000 7fddfd63a700 1 -- 172.21.15.12:0/2968620794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80b0d40 msgr2=0x7fddf8159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.728+0000 7fddfd63a700 1 --2- 172.21.15.12:0/2968620794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80b0d40 0x7fddf8159000 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e50 tx=0x7fddf000b330 comp rx=0 tx=0).stop 2023-07-07T18:15:14.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.732+0000 7f985affd700 1 -- 172.21.15.12:0/226808078 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985400e070 con 0x7f985c0cc260 2023-07-07T18:15:14.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.732+0000 7f985affd700 1 -- 172.21.15.12:0/226808078 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985400bb20 con 0x7f985c0cc260 2023-07-07T18:15:14.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.732+0000 7f985affd700 1 -- 172.21.15.12:0/226808078 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854012430 con 0x7f985c0cc260 2023-07-07T18:15:14.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.733+0000 7f9862a1a700 1 -- 172.21.15.12:0/226808078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0cc260 msgr2=0x7f985c0cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.733+0000 7f9862a1a700 1 --2- 172.21.15.12:0/226808078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0cc260 0x7f985c0cc6c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f985c0ad720 tx=0x7f985400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:14.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.733+0000 7f9862a1a700 1 -- 172.21.15.12:0/226808078 shutdown_connections 2023-07-07T18:15:14.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.733+0000 7f9862a1a700 1 --2- 172.21.15.12:0/226808078 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0cc260 0x7f985c0cc6c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.733+0000 7f9862a1a700 1 --2- 172.21.15.12:0/226808078 >> v2:172.21.15.12:3300/0 conn(0x7f985c0b0d40 0x7f985c1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.733+0000 7f9862a1a700 1 --2- 172.21.15.12:0/226808078 >> v2:172.21.15.160:3300/0 conn(0x7f985c0cb4e0 0x7f985c0cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.733+0000 7f9862a1a700 1 -- 172.21.15.12:0/226808078 >> 172.21.15.12:0/226808078 conn(0x7f985c0b0260 msgr2=0x7f985c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:14.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.733+0000 7f9862a1a700 1 -- 172.21.15.12:0/226808078 shutdown_connections 2023-07-07T18:15:14.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.733+0000 7f9862a1a700 1 -- 172.21.15.12:0/226808078 wait complete. 2023-07-07T18:15:14.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.735+0000 7f9862a1a700 1 Processor -- start 2023-07-07T18:15:14.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.735+0000 7fddfd63a700 1 -- 172.21.15.12:0/2968620794 shutdown_connections 2023-07-07T18:15:14.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.735+0000 7fddfd63a700 1 --2- 172.21.15.12:0/2968620794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80b0d40 0x7fddf8159000 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.735+0000 7fddfd63a700 1 --2- 172.21.15.12:0/2968620794 >> v2:172.21.15.160:3300/0 conn(0x7fddf80cb4e0 0x7fddf80cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.735+0000 7fddfd63a700 1 -- 172.21.15.12:0/2968620794 >> 172.21.15.12:0/2968620794 conn(0x7fddf80b0260 msgr2=0x7fddf80b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:14.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.735+0000 7f9862a1a700 1 -- start start 2023-07-07T18:15:14.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.735+0000 7ff883b01700 1 Processor -- start 2023-07-07T18:15:14.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.736+0000 7f9862a1a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b0d40 0x7f985c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.736+0000 7f9862a1a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c0cb4e0 0x7f985c1f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7fddfd63a700 1 -- 172.21.15.12:0/2968620794 shutdown_connections 2023-07-07T18:15:14.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.736+0000 7f9862a1a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c0cc260 0x7f985c0b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.736+0000 7f9862a1a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c1f0860 con 0x7f985c0cc260 2023-07-07T18:15:14.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.736+0000 7f9862a1a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c0b38e0 con 0x7f985c0cb4e0 2023-07-07T18:15:14.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.736+0000 7f9862a1a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c1f7260 con 0x7f985c0b0d40 2023-07-07T18:15:14.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7f985b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c0cb4e0 0x7f985c1f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.736+0000 7ff883b01700 1 -- start start 2023-07-07T18:15:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7ff883b01700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cbbf0 0x7ff87c0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7ff883b01700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff87c0cc7a0 0x7ff87c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7ff883b01700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87c15bd30 con 0x7ff87c159270 2023-07-07T18:15:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7ff883b01700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87c1586a0 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7ff883b01700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c0ccc00 con 0x7ff87c0cbbf0 2023-07-07T18:15:14.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7f9860fb7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c0cc260 0x7f985c0b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7f9860fb7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c0cc260 0x7f985c0b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57586/0 (socket says 172.21.15.12:57586) 2023-07-07T18:15:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7f9860fb7700 1 -- 172.21.15.12:0/639033173 learned_addr learned my addr 172.21.15.12:0/639033173 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7ff88209e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff87c0cc7a0 0x7ff87c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7ff88209e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff87c0cc7a0 0x7ff87c06c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57588/0 (socket says 172.21.15.12:57588) 2023-07-07T18:15:14.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7ff88209e700 1 -- 172.21.15.12:0/932949846 learned_addr learned my addr 172.21.15.12:0/932949846 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7ff88109c700 1 --2- 172.21.15.12:0/932949846 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cbbf0 0x7ff87c0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9860fb7700 1 -- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b0d40 msgr2=0x7f985c156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9860fb7700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b0d40 0x7f985c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9860fb7700 1 -- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c0cb4e0 msgr2=0x7f985c1f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9860fb7700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c0cb4e0 0x7f985c1f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9860fb7700 1 -- 172.21.15.12:0/639033173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854009a70 con 0x7f985c0cc260 2023-07-07T18:15:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7ff88209e700 1 -- 172.21.15.12:0/932949846 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cbbf0 msgr2=0x7ff87c0cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7ff88209e700 1 --2- 172.21.15.12:0/932949846 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cbbf0 0x7ff87c0cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7ff88209e700 1 -- 172.21.15.12:0/932949846 >> v1:172.21.15.160:6789/0 conn(0x7ff87c159270 legacy=0x7ff87c0cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7ff88209e700 1 -- 172.21.15.12:0/932949846 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c159640 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9860fb7700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c0cc260 0x7f985c0b3d70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9854014040 tx=0x7f9854004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7ff88209e700 1 --2- 172.21.15.12:0/932949846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cc7a0 0x7ff87c06c270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff87400d370 tx=0x7ff87400d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a43eac5d8c6926c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9858ff9700 1 -- 172.21.15.12:0/639033173 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98540048e0 con 0x7f985c0cc260 2023-07-07T18:15:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9858ff9700 1 -- 172.21.15.12:0/639033173 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854020070 con 0x7f985c0cc260 2023-07-07T18:15:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9858ff9700 1 -- 172.21.15.12:0/639033173 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98540276c0 con 0x7f985c0cc260 2023-07-07T18:15:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.737+0000 7fddfd63a700 1 -- 172.21.15.12:0/2968620794 wait complete. 2023-07-07T18:15:14.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.739+0000 7fddfd63a700 1 Processor -- start 2023-07-07T18:15:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.738+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c0b2cd0 con 0x7f985c0cc260 2023-07-07T18:15:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.739+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c0b3290 con 0x7f985c0cc260 2023-07-07T18:15:14.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.739+0000 7fddfd63a700 1 -- start start 2023-07-07T18:15:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7fddfd63a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddf80b0d40 0x7fddf80b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7fddfd63a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80cb4e0 0x7fddf80c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7fddfd63a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80cc260 0x7fddf814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7fddfd63a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c2d70 con 0x7fddf80b0d40 2023-07-07T18:15:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7fddfd63a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80b3fa0 con 0x7fddf80cc260 2023-07-07T18:15:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7fddfd63a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80c21c0 con 0x7fddf80cb4e0 2023-07-07T18:15:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7fddf6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddf80b0d40 0x7fddf80b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7fddf6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddf80b0d40 0x7fddf80b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57594/0 (socket says 172.21.15.12:57594) 2023-07-07T18:15:14.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7fddf6ffd700 1 -- 172.21.15.12:0/1037794432 learned_addr learned my addr 172.21.15.12:0/1037794432 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.740+0000 7f10c5acf700 1 Processor -- start 2023-07-07T18:15:14.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7fddf6ffd700 1 -- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80cb4e0 msgr2=0x7fddf80c4a40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-07T18:15:14.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7fddf6ffd700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80cb4e0 0x7fddf80c4a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7fddf6ffd700 1 -- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80cc260 msgr2=0x7fddf814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7fddf6ffd700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80cc260 0x7fddf814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7fddf6ffd700 1 -- 172.21.15.12:0/1037794432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0009b30 con 0x7fddf80b0d40 2023-07-07T18:15:14.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7ff88089b700 1 -- 172.21.15.12:0/932949846 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874010070 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7ff88089b700 1 -- 172.21.15.12:0/932949846 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87400dcd0 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7fddf6ffd700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddf80b0d40 0x7fddf80b37c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddf000b730 tx=0x7fddf0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7ff88089b700 1 -- 172.21.15.12:0/932949846 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874007d50 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7f9858ff9700 1 -- 172.21.15.12:0/639033173 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9854012430 con 0x7f985c0cc260 2023-07-07T18:15:14.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f9858ff9700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f984806ace0 0x7f984806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f9858ff9700 1 -- 172.21.15.12:0/639033173 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9854022070 con 0x7f985c0cc260 2023-07-07T18:15:14.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.741+0000 7f10c5acf700 1 -- start start 2023-07-07T18:15:14.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10c5acf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c0159270 0x7f10c00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10c5acf700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f10c00cba20 0x7f10c00cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10c5acf700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10c00cc7a0 0x7f10c0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10c5acf700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c01586a0 con 0x7f10c00cc7a0 2023-07-07T18:15:14.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10c5acf700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c00cbe90 con 0x7f10c00cba20 2023-07-07T18:15:14.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10c5acf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c015bd30 con 0x7f10c0159270 2023-07-07T18:15:14.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7ff883b01700 1 -- 172.21.15.12:0/932949846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cc7a0 msgr2=0x7ff87c06c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7ff883b01700 1 --2- 172.21.15.12:0/932949846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cc7a0 0x7ff87c06c270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff87400d370 tx=0x7ff87400d680 comp rx=0 tx=0).stop 2023-07-07T18:15:14.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7ff883b01700 1 -- 172.21.15.12:0/932949846 shutdown_connections 2023-07-07T18:15:14.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7ff883b01700 1 --2- 172.21.15.12:0/932949846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cc7a0 0x7ff87c06c270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7ff883b01700 1 --2- 172.21.15.12:0/932949846 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cbbf0 0x7ff87c0cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7ff883b01700 1 -- 172.21.15.12:0/932949846 >> 172.21.15.12:0/932949846 conn(0x7ff87c0b0260 msgr2=0x7ff87c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:14.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10bf7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c0159270 0x7f10c00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10beffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f10c00cba20 0x7f10c00cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10bf7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c0159270 0x7f10c00cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46692/0 (socket says 172.21.15.12:46692) 2023-07-07T18:15:14.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10bf7fe700 1 -- 172.21.15.12:0/2822137404 learned_addr learned my addr 172.21.15.12:0/2822137404 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7f10bffff700 1 --2- 172.21.15.12:0/2822137404 >> v2:172.21.15.12:3300/0 conn(0x7f10c00cc7a0 0x7f10c0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7fdddf7fe700 1 -- 172.21.15.12:0/1037794432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00092e0 con 0x7fddf80b0d40 2023-07-07T18:15:14.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7fdddf7fe700 1 -- 172.21.15.12:0/1037794432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf00094d0 con 0x7fddf80b0d40 2023-07-07T18:15:14.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7fdddf7fe700 1 -- 172.21.15.12:0/1037794432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf001c660 con 0x7fddf80b0d40 2023-07-07T18:15:14.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf80b3d00 con 0x7fddf80b0d40 2023-07-07T18:15:14.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.742+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf80c26b0 con 0x7fddf80b0d40 2023-07-07T18:15:14.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.743+0000 7f10bf7fe700 1 -- 172.21.15.12:0/2822137404 >> v2:172.21.15.160:3300/0 conn(0x7f10c00cba20 msgr2=0x7f10c00cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.743+0000 7f10bf7fe700 1 --2- 172.21.15.12:0/2822137404 >> v2:172.21.15.160:3300/0 conn(0x7f10c00cba20 0x7f10c00cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.743+0000 7f10bf7fe700 1 -- 172.21.15.12:0/2822137404 >> v2:172.21.15.12:3300/0 conn(0x7f10c00cc7a0 msgr2=0x7f10c0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.743+0000 7f10bf7fe700 1 --2- 172.21.15.12:0/2822137404 >> v2:172.21.15.12:3300/0 conn(0x7f10c00cc7a0 0x7f10c0069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.743+0000 7f10bf7fe700 1 -- 172.21.15.12:0/2822137404 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00ccc00 con 0x7f10c0159270 2023-07-07T18:15:14.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.743+0000 7f10bf7fe700 1 --2- 172.21.15.12:0/2822137404 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c0159270 0x7f10c00cb4e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10c0071cc0 tx=0x7f10b80076d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1730b7aba2123383 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.743+0000 7f10be7fc700 1 -- 172.21.15.12:0/2822137404 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8011070 con 0x7f10c0159270 2023-07-07T18:15:14.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.743+0000 7f10be7fc700 1 -- 172.21.15.12:0/2822137404 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b800c2e0 con 0x7f10c0159270 2023-07-07T18:15:14.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.743+0000 7f10be7fc700 1 -- 172.21.15.12:0/2822137404 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8007f70 con 0x7f10c0159270 2023-07-07T18:15:14.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7ff883b01700 1 -- 172.21.15.12:0/932949846 shutdown_connections 2023-07-07T18:15:14.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c073910 con 0x7f985c0cc260 2023-07-07T18:15:14.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f985bfff700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f984806ace0 0x7f984806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f10c5acf700 1 -- 172.21.15.12:0/2822137404 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c0159270 msgr2=0x7f10c00cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f10c5acf700 1 --2- 172.21.15.12:0/2822137404 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c0159270 0x7f10c00cb4e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10c0071cc0 tx=0x7f10b80076d0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f10c5acf700 1 -- 172.21.15.12:0/2822137404 shutdown_connections 2023-07-07T18:15:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f10c5acf700 1 --2- 172.21.15.12:0/2822137404 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c0159270 0x7f10c00cb4e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f10c5acf700 1 --2- 172.21.15.12:0/2822137404 >> v2:172.21.15.12:3300/0 conn(0x7f10c00cc7a0 0x7f10c0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f10c5acf700 1 --2- 172.21.15.12:0/2822137404 >> v2:172.21.15.160:3300/0 conn(0x7f10c00cba20 0x7f10c00cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f10c5acf700 1 -- 172.21.15.12:0/2822137404 >> 172.21.15.12:0/2822137404 conn(0x7f10c00b0260 msgr2=0x7f10c00b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7f10c5acf700 1 -- 172.21.15.12:0/2822137404 shutdown_connections 2023-07-07T18:15:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.745+0000 7f10c5acf700 1 -- 172.21.15.12:0/2822137404 wait complete. 2023-07-07T18:15:14.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.746+0000 7f10c5acf700 1 Processor -- start 2023-07-07T18:15:14.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.744+0000 7ff883b01700 1 -- 172.21.15.12:0/932949846 wait complete. 2023-07-07T18:15:14.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.746+0000 7ff883b01700 1 Processor -- start 2023-07-07T18:15:14.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.746+0000 7ff883b01700 1 -- start start 2023-07-07T18:15:14.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff883b01700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cbbf0 0x7ff87c0c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff883b01700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cc7a0 0x7ff87c0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff883b01700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff87c150d70 0x7ff87c1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff883b01700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c0b30f0 con 0x7ff87c0cbbf0 2023-07-07T18:15:14.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff883b01700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c0c1b50 con 0x7ff87c150d70 2023-07-07T18:15:14.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff883b01700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c0b3d30 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.745+0000 7fdddf7fe700 1 -- 172.21.15.12:0/1037794432 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddf001c7c0 con 0x7fddf80b0d40 2023-07-07T18:15:14.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.745+0000 7fdddf7fe700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdde406adb0 0x7fdde406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.746+0000 7fdddf7fe700 1 -- 172.21.15.12:0/1037794432 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fddf008b1c0 con 0x7fddf80b0d40 2023-07-07T18:15:14.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.746+0000 7fddf67fc700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdde406adb0 0x7fdde406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.746+0000 7fddf67fc700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdde406adb0 0x7fdde406d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009770 tx=0x7fdde8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7f985bfff700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f984806ace0 0x7f984806d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f985c06a9f0 tx=0x7f984c006d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff88109c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cc7a0 0x7ff87c0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff88109c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cc7a0 0x7ff87c0c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46702/0 (socket says 172.21.15.12:46702) 2023-07-07T18:15:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff88109c700 1 -- 172.21.15.12:0/859341617 learned_addr learned my addr 172.21.15.12:0/859341617 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7ff88189d700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cbbf0 0x7ff87c0c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7ff88209e700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff87c150d70 0x7ff87c1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7ff88109c700 1 -- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff87c150d70 msgr2=0x7ff87c1577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7ff88109c700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff87c150d70 0x7ff87c1577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7ff88109c700 1 -- 172.21.15.12:0/859341617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cbbf0 msgr2=0x7ff87c0c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7ff88109c700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cbbf0 0x7ff87c0c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7ff88109c700 1 -- 172.21.15.12:0/859341617 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87400d050 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.747+0000 7f10c5acf700 1 -- start start 2023-07-07T18:15:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10c5acf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c00cba20 0x7f10c00c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10c5acf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c00cc7a0 0x7f10c00b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10c5acf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0159270 0x7f10c01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10c5acf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00c4ef0 con 0x7f10c00cc7a0 2023-07-07T18:15:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10c5acf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00b2d90 con 0x7f10c0159270 2023-07-07T18:15:14.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10c5acf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00b3070 con 0x7f10c00cba20 2023-07-07T18:15:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7ff88189d700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cbbf0 0x7ff87c0c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7ff88109c700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cc7a0 0x7ff87c0c4780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff87800c7f0 tx=0x7ff87800cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10bffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0159270 0x7f10c01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10bffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0159270 0x7f10c01515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53224/0 (socket says 172.21.15.12:53224) 2023-07-07T18:15:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10bffff700 1 -- 172.21.15.12:0/4116434125 learned_addr learned my addr 172.21.15.12:0/4116434125 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.748+0000 7f10bf7fe700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c00cba20 0x7f10c00c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10beffd700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c00cc7a0 0x7f10c00b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10bf7fe700 1 -- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0159270 msgr2=0x7f10c01515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10bf7fe700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0159270 0x7f10c01515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10bf7fe700 1 -- 172.21.15.12:0/4116434125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c00cc7a0 msgr2=0x7f10c00b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10bf7fe700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c00cc7a0 0x7f10c00b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10bf7fe700 1 -- 172.21.15.12:0/4116434125 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b800cc70 con 0x7f10c00cba20 2023-07-07T18:15:14.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10bf7fe700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c00cba20 0x7f10c00c49b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10c00cf6f0 tx=0x7f10b8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10a7fff700 1 -- 172.21.15.12:0/4116434125 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b801e660 con 0x7f10c00cba20 2023-07-07T18:15:14.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10a7fff700 1 -- 172.21.15.12:0/4116434125 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b801e7e0 con 0x7f10c00cba20 2023-07-07T18:15:14.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c00b3350 con 0x7f10c00cba20 2023-07-07T18:15:14.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f08a9423700 1 Processor -- start 2023-07-07T18:15:14.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f08a9423700 1 -- start start 2023-07-07T18:15:14.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.750+0000 7f08a9423700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08a4159270 0x7f08a40cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.750+0000 7f08a9423700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f08a40cc970 0x7f08a406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.750+0000 7f08a9423700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a415bd30 con 0x7f08a40cba20 2023-07-07T18:15:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.750+0000 7f08a9423700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a41586a0 con 0x7f08a4159270 2023-07-07T18:15:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.750+0000 7f08a9423700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08a40cbec0 con 0x7f08a40cc970 2023-07-07T18:15:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.750+0000 7f08a2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08a4159270 0x7f08a40cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.750+0000 7f08a2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08a4159270 0x7f08a40cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57622/0 (socket says 172.21.15.12:57622) 2023-07-07T18:15:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.750+0000 7f08a2ffd700 1 -- 172.21.15.12:0/1699148488 learned_addr learned my addr 172.21.15.12:0/1699148488 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.750+0000 7f08a37fe700 1 --2- 172.21.15.12:0/1699148488 >> v2:172.21.15.160:3300/0 conn(0x7f08a40cc970 0x7f08a406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.751+0000 7f08a2ffd700 1 -- 172.21.15.12:0/1699148488 >> v2:172.21.15.160:3300/0 conn(0x7f08a40cc970 msgr2=0x7f08a406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.751+0000 7f08a2ffd700 1 --2- 172.21.15.12:0/1699148488 >> v2:172.21.15.160:3300/0 conn(0x7f08a40cc970 0x7f08a406c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.751+0000 7f08a2ffd700 1 -- 172.21.15.12:0/1699148488 >> v1:172.21.15.160:6789/0 conn(0x7f08a40cba20 legacy=0x7f08a40cc260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T18:15:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.751+0000 7f08a2ffd700 1 -- 172.21.15.12:0/1699148488 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a4159640 con 0x7f08a4159270 2023-07-07T18:15:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.751+0000 7f08a2ffd700 1 --2- 172.21.15.12:0/1699148488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a4159270 0x7f08a40cb4e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08a40cb0c0 tx=0x7f089c00d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3d87cce649f689 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10a7fff700 1 -- 172.21.15.12:0/4116434125 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b801eb90 con 0x7f10c00cba20 2023-07-07T18:15:14.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.749+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c00b3910 con 0x7f10c00cba20 2023-07-07T18:15:14.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.752+0000 7ff8727fc700 1 -- 172.21.15.12:0/859341617 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff878004220 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.752+0000 7ff8727fc700 1 -- 172.21.15.12:0/859341617 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff878004380 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.752+0000 7ff8727fc700 1 -- 172.21.15.12:0/859341617 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8780036c0 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.752+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf80c2eb0 con 0x7fddf80b0d40 2023-07-07T18:15:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.752+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87c0b2750 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.752+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87c0b2d10 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.753+0000 7f08a1ffb700 1 -- 172.21.15.12:0/1699148488 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c010070 con 0x7f08a4159270 2023-07-07T18:15:14.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.753+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87c0b3230 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.753+0000 7f9858ff9700 1 -- 172.21.15.12:0/639033173 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9854056310 con 0x7f985c0cc260 2023-07-07T18:15:14.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.754+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a00052f0 con 0x7f10c00cba20 2023-07-07T18:15:14.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.754+0000 7ff8727fc700 1 -- 172.21.15.12:0/859341617 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff878003820 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.754+0000 7ff8727fc700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff86006ad30 0x7ff86006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.755+0000 7ff8727fc700 1 -- 172.21.15.12:0/859341617 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff878089130 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.755+0000 7ff88189d700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff86006ad30 0x7ff86006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.755+0000 7ff88189d700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff86006ad30 0x7ff86006d1e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff86c007fd0 tx=0x7ff86c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.756+0000 7f10a7fff700 1 -- 172.21.15.12:0/4116434125 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10b801c070 con 0x7f10c00cba20 2023-07-07T18:15:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.756+0000 7f10a7fff700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10ac06ace0 0x7f10ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.757+0000 7f10a7fff700 1 -- 172.21.15.12:0/4116434125 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f10b808a7a0 con 0x7f10c00cba20 2023-07-07T18:15:14.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.757+0000 7f10beffd700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10ac06ace0 0x7f10ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.757+0000 7f10beffd700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10ac06ace0 0x7f10ac06d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10b40073b0 tx=0x7f10b4007340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.759+0000 7f08a1ffb700 1 -- 172.21.15.12:0/1699148488 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c00dc20 con 0x7f08a4159270 2023-07-07T18:15:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.759+0000 7f08a1ffb700 1 -- 172.21.15.12:0/1699148488 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c007b60 con 0x7f08a4159270 2023-07-07T18:15:14.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.759+0000 7ff8727fc700 1 -- 172.21.15.12:0/859341617 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff87c0b3230 con 0x7ff87c0cc7a0 2023-07-07T18:15:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.759+0000 7fdddf7fe700 1 -- 172.21.15.12:0/1037794432 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fddf80c2eb0 con 0x7fddf80b0d40 2023-07-07T18:15:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f08a9423700 1 -- 172.21.15.12:0/1699148488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a4159270 msgr2=0x7f08a40cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f08a9423700 1 --2- 172.21.15.12:0/1699148488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a4159270 0x7f08a40cb4e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08a40cb0c0 tx=0x7f089c00d4f0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f08a9423700 1 -- 172.21.15.12:0/1699148488 shutdown_connections 2023-07-07T18:15:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f08a9423700 1 --2- 172.21.15.12:0/1699148488 >> v2:172.21.15.160:3300/0 conn(0x7f08a40cc970 0x7f08a406c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f08a9423700 1 --2- 172.21.15.12:0/1699148488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a4159270 0x7f08a40cb4e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f08a9423700 1 -- 172.21.15.12:0/1699148488 >> 172.21.15.12:0/1699148488 conn(0x7f08a40b0260 msgr2=0x7f08a40b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:14.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f08a9423700 1 -- 172.21.15.12:0/1699148488 shutdown_connections 2023-07-07T18:15:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f3fa47f4700 1 Processor -- start 2023-07-07T18:15:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f3fa47f4700 1 -- start start 2023-07-07T18:15:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.760+0000 7f08a9423700 1 -- 172.21.15.12:0/1699148488 wait complete. 2023-07-07T18:15:14.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.762+0000 7f08a9423700 1 Processor -- start 2023-07-07T18:15:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.762+0000 7f3fa47f4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3f9c159f70 0x7f3f9c1606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.762+0000 7f3fa47f4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9c0cc260 0x7f3f9c06c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.762+0000 7f3fa47f4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c0ce4b0 con 0x7f3f9c06c5a0 2023-07-07T18:15:14.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.762+0000 7f3fa47f4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9c160c30 con 0x7f3f9c159f70 2023-07-07T18:15:14.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.762+0000 7f3fa47f4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0cdef0 con 0x7f3f9c0cc260 2023-07-07T18:15:14.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.762+0000 7f3fa2d91700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f3f9c06c5a0 0x7f3f9c15ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:48072/0 (socket says 172.21.15.12:48072) 2023-07-07T18:15:14.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.762+0000 7f3fa2d91700 1 -- 172.21.15.12:0/1022304275 learned_addr learned my addr 172.21.15.12:0/1022304275 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:14.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867604015 0 0) 0x7f3f9c0ce4b0 con 0x7f3f9c06c5a0 2023-07-07T18:15:14.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f880035b0 con 0x7f3f9c06c5a0 2023-07-07T18:15:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.762+0000 7f08a9423700 1 -- start start 2023-07-07T18:15:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a9423700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a40cba20 0x7f08a40b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a9423700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a40cc970 0x7f08a4156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a9423700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a4159270 0x7f08a40c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a9423700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40b31a0 con 0x7f08a40cba20 2023-07-07T18:15:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a9423700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40c4e90 con 0x7f08a40cc970 2023-07-07T18:15:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a9423700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08a40b25a0 con 0x7f08a4159270 2023-07-07T18:15:14.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 <== mon.1 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 413290463 0 0) 0x7f3f880035b0 con 0x7f3f9c06c5a0 2023-07-07T18:15:14.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9c0cc260 msgr2=0x7f3f9c06c060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-07T18:15:14.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f3fa158e700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9c0cc260 0x7f3f9c06c060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 >> v2:172.21.15.160:3300/0 conn(0x7f3f9c159f70 msgr2=0x7f3f9c1606f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-07T18:15:14.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f3fa158e700 1 --2- 172.21.15.12:0/1022304275 >> v2:172.21.15.160:3300/0 conn(0x7f3f9c159f70 0x7f3f9c1606f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c0ce1d0 con 0x7f3f9c06c5a0 2023-07-07T18:15:14.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 <== mon.1 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f3f940019f0 con 0x7f3f9c06c5a0 2023-07-07T18:15:14.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a40cc970 0x7f08a4156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a40cba20 0x7f08a40b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a40cba20 0x7f08a40b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57638/0 (socket says 172.21.15.12:57638) 2023-07-07T18:15:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a2ffd700 1 -- 172.21.15.12:0/3002963227 learned_addr learned my addr 172.21.15.12:0/3002963227 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.763+0000 7f08a37fe700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a4159270 0x7f08a40c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f10a7fff700 1 -- 172.21.15.12:0/4116434125 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10b8055710 con 0x7f10c00cba20 2023-07-07T18:15:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f08a2ffd700 1 -- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a4159270 msgr2=0x7f08a40c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f08a2ffd700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a4159270 0x7f08a40c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f08a2ffd700 1 -- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a40cc970 msgr2=0x7f08a4156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f08a2ffd700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a40cc970 0x7f08a4156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f08a2ffd700 1 -- 172.21.15.12:0/3002963227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c0079d0 con 0x7f08a40cba20 2023-07-07T18:15:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 >> v1:172.21.15.160:6789/0 conn(0x7f3f9c06c5a0 legacy=0x7f3f9c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f3fa158e700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f88003a00 0x7f3f88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f3fa158e700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f88004850 0x7f3f88004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f3fa158e700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9c0cc260 0x7f3f88005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c160c30 con 0x7f3f88003a00 2023-07-07T18:15:14.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0cdef0 con 0x7f3f88004850 2023-07-07T18:15:14.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88014460 con 0x7f3f9c0cc260 2023-07-07T18:15:14.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f3fa2590700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f88003a00 0x7f3f88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f08a2ffd700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a40cba20 0x7f08a40b35c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f089c00f010 tx=0x7f089c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f088b7fe700 1 -- 172.21.15.12:0/3002963227 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c004450 con 0x7f08a40cba20 2023-07-07T18:15:14.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.764+0000 7f3fa2d91700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9c0cc260 0x7f3f88005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f088b7fe700 1 -- 172.21.15.12:0/3002963227 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089c003e90 con 0x7f08a40cba20 2023-07-07T18:15:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a40b2820 con 0x7f08a40cba20 2023-07-07T18:15:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f088b7fe700 1 -- 172.21.15.12:0/3002963227 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c0047d0 con 0x7f08a40cba20 2023-07-07T18:15:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a40b2dc0 con 0x7f08a40cba20 2023-07-07T18:15:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f3fa1d8f700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f88004850 0x7f3f88004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f3fa2590700 1 -- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9c0cc260 msgr2=0x7f3f88005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f3fa2590700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9c0cc260 0x7f3f88005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f3fa2590700 1 -- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f88004850 msgr2=0x7f3f88004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f3fa2590700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f88004850 0x7f3f88004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.765+0000 7f3fa2590700 1 -- 172.21.15.12:0/1022304275 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f880035b0 con 0x7f3f88003a00 2023-07-07T18:15:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.766+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a40b3410 con 0x7f08a40cba20 2023-07-07T18:15:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.767+0000 7f3fa1d8f700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f88004850 0x7f3f88004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.767+0000 7f3fa2590700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f88003a00 0x7f3f88003dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009860 tx=0x7f3f88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacd86ceab67b1a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.767+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0092d0 con 0x7f3f88003a00 2023-07-07T18:15:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.768+0000 7f088b7fe700 1 -- 172.21.15.12:0/3002963227 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f089c02a460 con 0x7f08a40cba20 2023-07-07T18:15:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.767+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c011620 con 0x7f3f88003a00 2023-07-07T18:15:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.767+0000 7f3fa158e700 1 -- 172.21.15.12:0/1022304275 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0119d0 con 0x7f3f88003a00 2023-07-07T18:15:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.768+0000 7f3fa47f4700 1 -- 172.21.15.12:0/1022304275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f88003a00 msgr2=0x7f3f88003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.768+0000 7f3fa47f4700 1 --2- 172.21.15.12:0/1022304275 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f88003a00 0x7f3f88003dd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c009860 tx=0x7f3f88005880 comp rx=0 tx=0).stop 2023-07-07T18:15:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.768+0000 7f3fa2d91700 1 -- 172.21.15.12:0/1022304275 reap_dead start 2023-07-07T18:15:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.768+0000 7f3fa47f4700 1 -- 172.21.15.12:0/1022304275 shutdown_connections 2023-07-07T18:15:14.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.768+0000 7f3fa47f4700 1 -- 172.21.15.12:0/1022304275 >> 172.21.15.12:0/1022304275 conn(0x7f3f9c0b0260 msgr2=0x7f3f9c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:14.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.769+0000 7f088b7fe700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f088c06ae60 0x7f088c06d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.769+0000 7f088b7fe700 1 -- 172.21.15.12:0/3002963227 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f089c08c250 con 0x7f08a40cba20 2023-07-07T18:15:14.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.774+0000 7f3fa47f4700 1 -- 172.21.15.12:0/1022304275 shutdown_connections 2023-07-07T18:15:14.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.774+0000 7f3fa47f4700 1 -- 172.21.15.12:0/1022304275 wait complete. 2023-07-07T18:15:14.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.774+0000 7f08a27fc700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f088c06ae60 0x7f088c06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.776+0000 7f3fa47f4700 1 Processor -- start 2023-07-07T18:15:14.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.776+0000 7f3fa47f4700 1 -- start start 2023-07-07T18:15:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.777+0000 7f3fa47f4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f88003a00 0x7f3f9c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.777+0000 7f3fa47f4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f9c157730 0x7f3f9c15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.777+0000 7f3fa47f4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f9c14b480 0x7f3f9c15ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.777+0000 7f3fa47f4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0caf70 con 0x7f3f9c14b480 2023-07-07T18:15:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.777+0000 7f3fa47f4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c157ef0 con 0x7f3f9c157730 2023-07-07T18:15:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.777+0000 7f3fa47f4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c153530 con 0x7f3f88003a00 2023-07-07T18:15:14.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa1d8f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f9c157730 0x7f3f9c15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa1d8f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f9c157730 0x7f3f9c15ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53258/0 (socket says 172.21.15.12:53258) 2023-07-07T18:15:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa1d8f700 1 -- 172.21.15.12:0/2775165099 learned_addr learned my addr 172.21.15.12:0/2775165099 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa2d91700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f9c14b480 0x7f3f9c15ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa2590700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f88003a00 0x7f3f9c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa1d8f700 1 -- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f88003a00 msgr2=0x7f3f9c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa1d8f700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f88003a00 0x7f3f9c0c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa1d8f700 1 -- 172.21.15.12:0/2775165099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f9c14b480 msgr2=0x7f3f9c15ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa1d8f700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f9c14b480 0x7f3f9c15ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa1d8f700 1 -- 172.21.15.12:0/2775165099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c157c10 con 0x7f3f9c157730 2023-07-07T18:15:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa2590700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f88003a00 0x7f3f9c0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.778+0000 7f3fa1d8f700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f9c157730 0x7f3f9c15ea10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c850 tx=0x7f3f9800cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.780+0000 7f3f92ffd700 1 -- 172.21.15.12:0/2775165099 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98007730 con 0x7f3f9c157730 2023-07-07T18:15:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.780+0000 7f3f92ffd700 1 -- 172.21.15.12:0/2775165099 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f980078b0 con 0x7f3f9c157730 2023-07-07T18:15:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.780+0000 7f3f92ffd700 1 -- 172.21.15.12:0/2775165099 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98007c60 con 0x7f3f9c157730 2023-07-07T18:15:14.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.780+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c152ee0 con 0x7f3f9c157730 2023-07-07T18:15:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.780+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c14bb80 con 0x7f3f9c157730 2023-07-07T18:15:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.782+0000 7f3f92ffd700 1 -- 172.21.15.12:0/2775165099 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f980113f0 con 0x7f3f9c157730 2023-07-07T18:15:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.782+0000 7f3f92ffd700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3f8806c460 0x7f3f8806e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.782+0000 7f3f92ffd700 1 -- 172.21.15.12:0/2775165099 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f980894f0 con 0x7f3f9c157730 2023-07-07T18:15:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.783+0000 7f3fa2590700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3f8806c460 0x7f3f8806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.783+0000 7f3fa2590700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3f8806c460 0x7f3f8806e910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c152d60 tx=0x7f3f8c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.779+0000 7f088b7fe700 1 -- 172.21.15.12:0/3002963227 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f089c057080 con 0x7f08a40cba20 2023-07-07T18:15:14.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.784+0000 7f08a27fc700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f088c06ae60 0x7f088c06d310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f08a40c8710 tx=0x7f0898009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:14.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.790+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f840052f0 con 0x7f3f9c157730 2023-07-07T18:15:14.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:14.798+0000 7f3f92ffd700 1 -- 172.21.15.12:0/2775165099 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3f98054420 con 0x7f3f9c157730 2023-07-07T18:15:15.093 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.088+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5f30005870 con 0x7f5f50159270 2023-07-07T18:15:15.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.088+0000 7f5f377fe700 1 -- 172.21.15.12:0/3024450740 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f48007260 con 0x7f5f50159270 2023-07-07T18:15:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.091+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5f3c06ad30 msgr2=0x7f5f3c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.091+0000 7f5f55737700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5f3c06ad30 0x7f5f3c06d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f500c56d0 tx=0x7f5f44008040 comp rx=0 tx=0).stop 2023-07-07T18:15:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.091+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f50159270 msgr2=0x7f5f501e52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.091+0000 7f5f55737700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f50159270 0x7f5f501e52e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f48017000 tx=0x7f5f48004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.092+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 shutdown_connections 2023-07-07T18:15:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.092+0000 7f5f55737700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5f3c06ad30 0x7f5f3c06d1e0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f500c56d0 tx=0x7f5f44008040 comp rx=0 tx=0).stop 2023-07-07T18:15:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.092+0000 7f5f55737700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f50159270 0x7f5f501e52e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.092+0000 7f5f55737700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f500cba20 0x7f5f500ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.092+0000 7f5f55737700 1 --2- 172.21.15.12:0/3024450740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f500cc970 0x7f5f501fe570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.092+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 >> 172.21.15.12:0/3024450740 conn(0x7f5f500b0260 msgr2=0x7f5f500ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.092+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 shutdown_connections 2023-07-07T18:15:15.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.092+0000 7f5f55737700 1 -- 172.21.15.12:0/3024450740 wait complete. 2023-07-07T18:15:15.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.098+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0adc0714a0 con 0x7f0adc159270 2023-07-07T18:15:15.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.099+0000 7f0acaffd700 1 -- 172.21.15.12:0/42118718 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ad001e020 con 0x7f0adc159270 2023-07-07T18:15:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:64424509453 2023-07-07T18:15:15.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0abc06adb0 msgr2=0x7f0abc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0abc06adb0 0x7f0abc06d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400d690 tx=0x7f0ad4012000 comp rx=0 tx=0).stop 2023-07-07T18:15:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0adc159270 msgr2=0x7f0adc1f2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0adc159270 0x7f0adc1f2d40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000c7f0 tx=0x7f0ad000cb00 comp rx=0 tx=0).stop 2023-07-07T18:15:15.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 shutdown_connections 2023-07-07T18:15:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0abc06adb0 0x7f0abc06d260 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0adc159270 0x7f0adc1f2d40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0adc0cba20 0x7f0adc0c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 --2- 172.21.15.12:0/42118718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0adc0cc7a0 0x7f0adc0b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 >> 172.21.15.12:0/42118718 conn(0x7f0adc0b0260 msgr2=0x7f0adc06c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.103+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 shutdown_connections 2023-07-07T18:15:15.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.104+0000 7f0ae0faf700 1 -- 172.21.15.12:0/42118718 wait complete. 2023-07-07T18:15:15.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.2 2023-07-07T18:15:15.114 DEBUG:teuthology.parallel:result is None 2023-07-07T18:15:15.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509453 for osd.7 2023-07-07T18:15:15.125 DEBUG:teuthology.parallel:result is None 2023-07-07T18:15:15.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.147+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fddf80c2eb0 con 0x7fddf80b0d40 2023-07-07T18:15:15.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.147+0000 7fdddf7fe700 1 -- 172.21.15.12:0/1037794432 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddf80c2eb0 con 0x7fddf80b0d40 2023-07-07T18:15:15.149 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:15.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.149+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdde406adb0 msgr2=0x7fdde406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.149+0000 7fddfd63a700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdde406adb0 0x7fdde406d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009770 tx=0x7fdde8008040 comp rx=0 tx=0).stop 2023-07-07T18:15:15.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.149+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddf80b0d40 msgr2=0x7fddf80b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.149+0000 7fddfd63a700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddf80b0d40 0x7fddf80b37c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fddf000b730 tx=0x7fddf0004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.150+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 shutdown_connections 2023-07-07T18:15:15.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.150+0000 7fddfd63a700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdde406adb0 0x7fdde406d260 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.150+0000 7fddfd63a700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddf80cc260 0x7fddf814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.150+0000 7fddfd63a700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddf80b0d40 0x7fddf80b37c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.150+0000 7fddfd63a700 1 --2- 172.21.15.12:0/1037794432 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fddf80cb4e0 0x7fddf80c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.150+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 >> 172.21.15.12:0/1037794432 conn(0x7fddf80b0260 msgr2=0x7fddf8159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.150+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 shutdown_connections 2023-07-07T18:15:15.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.150+0000 7fddfd63a700 1 -- 172.21.15.12:0/1037794432 wait complete. 2023-07-07T18:15:15.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.150+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f985c0b3a20 con 0x7f985c0cc260 2023-07-07T18:15:15.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.151+0000 7f9858ff9700 1 -- 172.21.15.12:0/639033173 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f985402c030 con 0x7f985c0cc260 2023-07-07T18:15:15.154 INFO:teuthology.orchestra.run.smithi012.stdout:60129542154 2023-07-07T18:15:15.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.154+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f984806ace0 msgr2=0x7f984806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.154+0000 7f9862a1a700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f984806ace0 0x7f984806d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f985c06a9f0 tx=0x7f984c006d20 comp rx=0 tx=0).stop 2023-07-07T18:15:15.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.154+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c0cc260 msgr2=0x7f985c0b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.154+0000 7f9862a1a700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c0cc260 0x7f985c0b3d70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9854014040 tx=0x7f9854004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.155+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 shutdown_connections 2023-07-07T18:15:15.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.155+0000 7f9862a1a700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f984806ace0 0x7f984806d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.155+0000 7f9862a1a700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f985c0cc260 0x7f985c0b3d70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.155+0000 7f9862a1a700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f985c0b0d40 0x7f985c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.155+0000 7f9862a1a700 1 --2- 172.21.15.12:0/639033173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f985c0cb4e0 0x7f985c1f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.155+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 >> 172.21.15.12:0/639033173 conn(0x7f985c0b0260 msgr2=0x7f985c15a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.157+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 shutdown_connections 2023-07-07T18:15:15.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.157+0000 7f9862a1a700 1 -- 172.21.15.12:0/639033173 wait complete. 2023-07-07T18:15:15.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.161+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08a415c280 con 0x7f08a40cba20 2023-07-07T18:15:15.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.162+0000 7f088b7fe700 1 -- 172.21.15.12:0/3002963227 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f089c004930 con 0x7f08a40cba20 2023-07-07T18:15:15.164 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:15.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f088c06ae60 msgr2=0x7f088c06d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f088c06ae60 0x7f088c06d310 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f08a40c8710 tx=0x7f0898009190 comp rx=0 tx=0).stop 2023-07-07T18:15:15.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a40cba20 msgr2=0x7f08a40b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a40cba20 0x7f08a40b35c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f089c00f010 tx=0x7f089c004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 shutdown_connections 2023-07-07T18:15:15.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f088c06ae60 0x7f088c06d310 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f08a40c8710 tx=0x7f0898009190 comp rx=0 tx=0).stop 2023-07-07T18:15:15.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a4159270 0x7f08a40c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08a40cba20 0x7f08a40b35c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 --2- 172.21.15.12:0/3002963227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a40cc970 0x7f08a4156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.164+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 >> 172.21.15.12:0/3002963227 conn(0x7f08a40b0260 msgr2=0x7f08a4159a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.4 2023-07-07T18:15:15.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.166+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 shutdown_connections 2023-07-07T18:15:15.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.166+0000 7f08a9423700 1 -- 172.21.15.12:0/3002963227 wait complete. 2023-07-07T18:15:15.168 DEBUG:teuthology.parallel:result is None 2023-07-07T18:15:15.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.1 2023-07-07T18:15:15.179 DEBUG:teuthology.parallel:result is None 2023-07-07T18:15:15.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.178+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f10a0005870 con 0x7f10c00cba20 2023-07-07T18:15:15.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.0 2023-07-07T18:15:15.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.179+0000 7f10a7fff700 1 -- 172.21.15.12:0/4116434125 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10b8058d30 con 0x7f10c00cba20 2023-07-07T18:15:15.181 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:15.181 DEBUG:teuthology.parallel:result is None 2023-07-07T18:15:15.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10ac06ace0 msgr2=0x7f10ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10ac06ace0 0x7f10ac06d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10b40073b0 tx=0x7f10b4007340 comp rx=0 tx=0).stop 2023-07-07T18:15:15.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c00cba20 msgr2=0x7f10c00c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c00cba20 0x7f10c00c49b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10c00cf6f0 tx=0x7f10b8004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 shutdown_connections 2023-07-07T18:15:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f10ac06ace0 0x7f10ac06d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0159270 0x7f10c01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f10c00cba20 0x7f10c00c49b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 --2- 172.21.15.12:0/4116434125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10c00cc7a0 0x7f10c00b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 >> 172.21.15.12:0/4116434125 conn(0x7f10c00b0260 msgr2=0x7f10c015a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 shutdown_connections 2023-07-07T18:15:15.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.181+0000 7f10c5acf700 1 -- 172.21.15.12:0/4116434125 wait complete. 2023-07-07T18:15:15.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.187+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff87c0b3230 con 0x7ff87c0cc7a0 2023-07-07T18:15:15.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.188+0000 7ff8727fc700 1 -- 172.21.15.12:0/859341617 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff87c0b3230 con 0x7ff87c0cc7a0 2023-07-07T18:15:15.189 INFO:teuthology.orchestra.run.smithi012.stdout:60129542156 2023-07-07T18:15:15.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff86006ad30 msgr2=0x7ff86006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff86006ad30 0x7ff86006d1e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff86c007fd0 tx=0x7ff86c007ec0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cc7a0 msgr2=0x7ff87c0c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cc7a0 0x7ff87c0c4780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff87800c7f0 tx=0x7ff87800cb00 comp rx=0 tx=0).stop 2023-07-07T18:15:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 shutdown_connections 2023-07-07T18:15:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff86006ad30 0x7ff86006d1e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff87c150d70 0x7ff87c1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff87c0cbbf0 0x7ff87c0c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 --2- 172.21.15.12:0/859341617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff87c0cc7a0 0x7ff87c0c4780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 >> 172.21.15.12:0/859341617 conn(0x7ff87c0b0260 msgr2=0x7ff87c15b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 shutdown_connections 2023-07-07T18:15:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.191+0000 7ff883b01700 1 -- 172.21.15.12:0/859341617 wait complete. 2023-07-07T18:15:15.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2023-07-07T18:15:15.196 DEBUG:teuthology.parallel:result is None 2023-07-07T18:15:15.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.199+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3f84005870 con 0x7f3f9c157730 2023-07-07T18:15:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.199+0000 7f3f92ffd700 1 -- 172.21.15.12:0/2775165099 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f9801f070 con 0x7f3f9c157730 2023-07-07T18:15:15.201 INFO:teuthology.orchestra.run.smithi012.stdout:60129542155 2023-07-07T18:15:15.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3f8806c460 msgr2=0x7f3f8806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3f8806c460 0x7f3f8806e910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c152d60 tx=0x7f3f8c008030 comp rx=0 tx=0).stop 2023-07-07T18:15:15.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f9c157730 msgr2=0x7f3f9c15ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f9c157730 0x7f3f9c15ea10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c850 tx=0x7f3f9800cc10 comp rx=0 tx=0).stop 2023-07-07T18:15:15.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 shutdown_connections 2023-07-07T18:15:15.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3f8806c460 0x7f3f8806e910 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f9c14b480 0x7f3f9c15ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f88003a00 0x7f3f9c0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 --2- 172.21.15.12:0/2775165099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f9c157730 0x7f3f9c15ea10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 >> 172.21.15.12:0/2775165099 conn(0x7f3f9c0b0260 msgr2=0x7f3f9c0b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 shutdown_connections 2023-07-07T18:15:15.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.203+0000 7f3fa47f4700 1 -- 172.21.15.12:0/2775165099 wait complete. 2023-07-07T18:15:15.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.6 2023-07-07T18:15:15.210 DEBUG:teuthology.parallel:result is None 2023-07-07T18:15:15.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.5 2023-07-07T18:15:15.218 DEBUG:teuthology.parallel:result is None 2023-07-07T18:15:15.218 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-07T18:15:15.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T18:15:15.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.380+0000 7f8553610700 1 Processor -- start 2023-07-07T18:15:15.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.380+0000 7f8553610700 1 -- start start 2023-07-07T18:15:15.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8553610700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f854c070ae0 0x7f854c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8553610700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f854c15d200 0x7f854c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8553610700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854c0ccb60 con 0x7f854c06d760 2023-07-07T18:15:15.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8553610700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c0ce990 con 0x7f854c15d200 2023-07-07T18:15:15.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8553610700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c0cec70 con 0x7f854c070ae0 2023-07-07T18:15:15.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8551bad700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f854c15d200 0x7f854c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8551bad700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f854c15d200 0x7f854c06e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57662/0 (socket says 172.21.15.12:57662) 2023-07-07T18:15:15.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8551bad700 1 -- 172.21.15.12:0/3701087089 learned_addr learned my addr 172.21.15.12:0/3701087089 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:15.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f85513ac700 1 --2- 172.21.15.12:0/3701087089 >> v2:172.21.15.160:3300/0 conn(0x7f854c070ae0 0x7f854c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8551bad700 1 -- 172.21.15.12:0/3701087089 >> v2:172.21.15.160:3300/0 conn(0x7f854c070ae0 msgr2=0x7f854c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:15.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8551bad700 1 --2- 172.21.15.12:0/3701087089 >> v2:172.21.15.160:3300/0 conn(0x7f854c070ae0 0x7f854c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8551bad700 1 -- 172.21.15.12:0/3701087089 >> v1:172.21.15.160:6789/0 conn(0x7f854c06d760 legacy=0x7f854c070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8551bad700 1 -- 172.21.15.12:0/3701087089 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c0cce00 con 0x7f854c15d200 2023-07-07T18:15:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8551bad700 1 --2- 172.21.15.12:0/3701087089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c15d200 0x7f854c06e150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f854c0c2a90 tx=0x7f854400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335bd59dd6dc51a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8543fff700 1 -- 172.21.15.12:0/3701087089 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400e070 con 0x7f854c15d200 2023-07-07T18:15:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8543fff700 1 -- 172.21.15.12:0/3701087089 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854400b9c0 con 0x7f854c15d200 2023-07-07T18:15:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.381+0000 7f8543fff700 1 -- 172.21.15.12:0/3701087089 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400bd70 con 0x7f854c15d200 2023-07-07T18:15:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.382+0000 7f8553610700 1 -- 172.21.15.12:0/3701087089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c15d200 msgr2=0x7f854c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.382+0000 7f8553610700 1 --2- 172.21.15.12:0/3701087089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c15d200 0x7f854c06e150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f854c0c2a90 tx=0x7f854400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.382+0000 7f8553610700 1 -- 172.21.15.12:0/3701087089 shutdown_connections 2023-07-07T18:15:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.382+0000 7f8553610700 1 --2- 172.21.15.12:0/3701087089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c15d200 0x7f854c06e150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.382+0000 7f8553610700 1 --2- 172.21.15.12:0/3701087089 >> v2:172.21.15.160:3300/0 conn(0x7f854c070ae0 0x7f854c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.382+0000 7f8553610700 1 -- 172.21.15.12:0/3701087089 >> 172.21.15.12:0/3701087089 conn(0x7f854c0b1740 msgr2=0x7f854c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.382+0000 7f8553610700 1 -- 172.21.15.12:0/3701087089 shutdown_connections 2023-07-07T18:15:15.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.382+0000 7f8553610700 1 -- 172.21.15.12:0/3701087089 wait complete. 2023-07-07T18:15:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.383+0000 7f8553610700 1 Processor -- start 2023-07-07T18:15:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.383+0000 7f8553610700 1 -- start start 2023-07-07T18:15:15.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8553610700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c06d760 0x7f854c150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8553610700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c070ae0 0x7f854c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8553610700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f854c15d200 0x7f854c152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8553610700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0ab8d0 con 0x7f854c070ae0 2023-07-07T18:15:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8553610700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c1526c0 con 0x7f854c06d760 2023-07-07T18:15:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8553610700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c1529a0 con 0x7f854c15d200 2023-07-07T18:15:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8550bab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c070ae0 0x7f854c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8550bab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c070ae0 0x7f854c151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57666/0 (socket says 172.21.15.12:57666) 2023-07-07T18:15:15.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8550bab700 1 -- 172.21.15.12:0/142776232 learned_addr learned my addr 172.21.15.12:0/142776232 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8551bad700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f854c15d200 0x7f854c152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f85513ac700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c06d760 0x7f854c150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8550bab700 1 -- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f854c15d200 msgr2=0x7f854c152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8550bab700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f854c15d200 0x7f854c152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8550bab700 1 -- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c06d760 msgr2=0x7f854c150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8550bab700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c06d760 0x7f854c150080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.384+0000 7f8550bab700 1 -- 172.21.15.12:0/142776232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8544009b30 con 0x7f854c070ae0 2023-07-07T18:15:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.385+0000 7f8550bab700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c070ae0 0x7f854c151b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c4b0 tx=0x7f853c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.385+0000 7f8541ffb700 1 -- 172.21.15.12:0/142776232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0052d0 con 0x7f854c070ae0 2023-07-07T18:15:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.385+0000 7f8541ffb700 1 -- 172.21.15.12:0/142776232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c005430 con 0x7f854c070ae0 2023-07-07T18:15:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.385+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c0abb20 con 0x7f854c070ae0 2023-07-07T18:15:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.385+0000 7f8541ffb700 1 -- 172.21.15.12:0/142776232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0038c0 con 0x7f854c070ae0 2023-07-07T18:15:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.385+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c14e950 con 0x7f854c070ae0 2023-07-07T18:15:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.386+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c0ac040 con 0x7f854c070ae0 2023-07-07T18:15:15.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.386+0000 7f8541ffb700 1 -- 172.21.15.12:0/142776232 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f853c003a20 con 0x7f854c070ae0 2023-07-07T18:15:15.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.386+0000 7f8541ffb700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f853006ace0 0x7f853006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.387+0000 7f8541ffb700 1 -- 172.21.15.12:0/142776232 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f853c088c00 con 0x7f854c070ae0 2023-07-07T18:15:15.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.387+0000 7f85513ac700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f853006ace0 0x7f853006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.387+0000 7f85513ac700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f853006ace0 0x7f853006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8548009950 tx=0x7f8548008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:15.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.391+0000 7f8541ffb700 1 -- 172.21.15.12:0/142776232 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f853c08f080 con 0x7f854c070ae0 2023-07-07T18:15:15.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.585+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 --> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f854c0ce620 con 0x7f853006ace0 2023-07-07T18:15:15.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.596+0000 7f8541ffb700 1 -- 172.21.15.12:0/142776232 <== mgr.4100 v2:172.21.15.160:6832/4080099133 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367290 (secure 0 0 0) 0x7f85480095e0 con 0x7f853006ace0 2023-07-07T18:15:15.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f853006ace0 msgr2=0x7f853006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f853006ace0 0x7f853006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8548009950 tx=0x7f8548008040 comp rx=0 tx=0).stop 2023-07-07T18:15:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c070ae0 msgr2=0x7f854c151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c070ae0 0x7f854c151b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c4b0 tx=0x7f853c00c870 comp rx=0 tx=0).stop 2023-07-07T18:15:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 shutdown_connections 2023-07-07T18:15:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f853006ace0 0x7f853006d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f854c15d200 0x7f854c152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f854c06d760 0x7f854c150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 --2- 172.21.15.12:0/142776232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c070ae0 0x7f854c151b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 >> 172.21.15.12:0/142776232 conn(0x7f854c0b1740 msgr2=0x7f854c0b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 shutdown_connections 2023-07-07T18:15:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.599+0000 7f8553610700 1 -- 172.21.15.12:0/142776232 wait complete. 2023-07-07T18:15:15.605 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-07-07T18:15:15.613 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-07-07T18:15:14.596955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219268,"kb_used_data":3652,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755452,"statfs":{"total":773094113280,"available":772869582848,"internally_reserved":0,"allocated":3739648,"data_stored":2208171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003792"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287995+0000","last_change":"2023-07-07T18:14:46.251969+0000","last_active":"2023-07-07T18:14:51.287995+0000","last_peered":"2023-07-07T18:14:51.287995+0000","last_clean":"2023-07-07T18:14:51.287995+0000","last_became_active":"2023-07-07T18:14:46.251645+0000","last_became_peered":"2023-07-07T18:14:46.251645+0000","last_unstale":"2023-07-07T18:14:51.287995+0000","last_undegraded":"2023-07-07T18:14:51.287995+0000","last_fullsized":"2023-07-07T18:14:51.287995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:09:35.223387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786630+0000","last_change":"2023-07-07T18:14:46.246398+0000","last_active":"2023-07-07T18:14:50.786630+0000","last_peered":"2023-07-07T18:14:50.786630+0000","last_clean":"2023-07-07T18:14:50.786630+0000","last_became_active":"2023-07-07T18:14:46.246114+0000","last_became_peered":"2023-07-07T18:14:46.246114+0000","last_unstale":"2023-07-07T18:14:50.786630+0000","last_undegraded":"2023-07-07T18:14:50.786630+0000","last_fullsized":"2023-07-07T18:14:50.786630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:10:28.413855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696469+0000","last_change":"2023-07-07T18:14:46.260795+0000","last_active":"2023-07-07T18:14:50.696469+0000","last_peered":"2023-07-07T18:14:50.696469+0000","last_clean":"2023-07-07T18:14:50.696469+0000","last_became_active":"2023-07-07T18:14:46.260094+0000","last_became_peered":"2023-07-07T18:14:46.260094+0000","last_unstale":"2023-07-07T18:14:50.696469+0000","last_undegraded":"2023-07-07T18:14:50.696469+0000","last_fullsized":"2023-07-07T18:14:50.696469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:50:11.200504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287193+0000","last_change":"2023-07-07T18:14:46.256379+0000","last_active":"2023-07-07T18:14:51.287193+0000","last_peered":"2023-07-07T18:14:51.287193+0000","last_clean":"2023-07-07T18:14:51.287193+0000","last_became_active":"2023-07-07T18:14:46.256093+0000","last_became_peered":"2023-07-07T18:14:46.256093+0000","last_unstale":"2023-07-07T18:14:51.287193+0000","last_undegraded":"2023-07-07T18:14:51.287193+0000","last_fullsized":"2023-07-07T18:14:51.287193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:45.897131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768761+0000","last_change":"2023-07-07T18:14:46.256853+0000","last_active":"2023-07-07T18:14:50.768761+0000","last_peered":"2023-07-07T18:14:50.768761+0000","last_clean":"2023-07-07T18:14:50.768761+0000","last_became_active":"2023-07-07T18:14:46.256595+0000","last_became_peered":"2023-07-07T18:14:46.256595+0000","last_unstale":"2023-07-07T18:14:50.768761+0000","last_undegraded":"2023-07-07T18:14:50.768761+0000","last_fullsized":"2023-07-07T18:14:50.768761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:15:05.887018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694486+0000","last_change":"2023-07-07T18:14:46.256691+0000","last_active":"2023-07-07T18:14:50.694486+0000","last_peered":"2023-07-07T18:14:50.694486+0000","last_clean":"2023-07-07T18:14:50.694486+0000","last_became_active":"2023-07-07T18:14:46.254378+0000","last_became_peered":"2023-07-07T18:14:46.254378+0000","last_unstale":"2023-07-07T18:14:50.694486+0000","last_undegraded":"2023-07-07T18:14:50.694486+0000","last_fullsized":"2023-07-07T18:14:50.694486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:51:05.609476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695840+0000","last_change":"2023-07-07T18:14:46.259522+0000","last_active":"2023-07-07T18:14:50.695840+0000","last_peered":"2023-07-07T18:14:50.695840+0000","last_clean":"2023-07-07T18:14:50.695840+0000","last_became_active":"2023-07-07T18:14:46.259213+0000","last_became_peered":"2023-07-07T18:14:46.259213+0000","last_unstale":"2023-07-07T18:14:50.695840+0000","last_undegraded":"2023-07-07T18:14:50.695840+0000","last_fullsized":"2023-07-07T18:14:50.695840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:41:52.866809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786149+0000","last_change":"2023-07-07T18:14:46.257573+0000","last_active":"2023-07-07T18:14:50.786149+0000","last_peered":"2023-07-07T18:14:50.786149+0000","last_clean":"2023-07-07T18:14:50.786149+0000","last_became_active":"2023-07-07T18:14:46.257234+0000","last_became_peered":"2023-07-07T18:14:46.257234+0000","last_unstale":"2023-07-07T18:14:50.786149+0000","last_undegraded":"2023-07-07T18:14:50.786149+0000","last_fullsized":"2023-07-07T18:14:50.786149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:17.978840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769023+0000","last_change":"2023-07-07T18:14:46.256934+0000","last_active":"2023-07-07T18:14:50.769023+0000","last_peered":"2023-07-07T18:14:50.769023+0000","last_clean":"2023-07-07T18:14:50.769023+0000","last_became_active":"2023-07-07T18:14:46.256669+0000","last_became_peered":"2023-07-07T18:14:46.256669+0000","last_unstale":"2023-07-07T18:14:50.769023+0000","last_undegraded":"2023-07-07T18:14:50.769023+0000","last_fullsized":"2023-07-07T18:14:50.769023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:27.744408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786945+0000","last_change":"2023-07-07T18:14:46.253312+0000","last_active":"2023-07-07T18:14:50.786945+0000","last_peered":"2023-07-07T18:14:50.786945+0000","last_clean":"2023-07-07T18:14:50.786945+0000","last_became_active":"2023-07-07T18:14:46.253067+0000","last_became_peered":"2023-07-07T18:14:46.253067+0000","last_unstale":"2023-07-07T18:14:50.786945+0000","last_undegraded":"2023-07-07T18:14:50.786945+0000","last_fullsized":"2023-07-07T18:14:50.786945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:15:55.654834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696368+0000","last_change":"2023-07-07T18:14:46.257215+0000","last_active":"2023-07-07T18:14:50.696368+0000","last_peered":"2023-07-07T18:14:50.696368+0000","last_clean":"2023-07-07T18:14:50.696368+0000","last_became_active":"2023-07-07T18:14:46.254498+0000","last_became_peered":"2023-07-07T18:14:46.254498+0000","last_unstale":"2023-07-07T18:14:50.696368+0000","last_undegraded":"2023-07-07T18:14:50.696368+0000","last_fullsized":"2023-07-07T18:14:50.696368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:44:17.278555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287726+0000","last_change":"2023-07-07T18:14:46.261297+0000","last_active":"2023-07-07T18:14:51.287726+0000","last_peered":"2023-07-07T18:14:51.287726+0000","last_clean":"2023-07-07T18:14:51.287726+0000","last_became_active":"2023-07-07T18:14:46.260968+0000","last_became_peered":"2023-07-07T18:14:46.260968+0000","last_unstale":"2023-07-07T18:14:51.287726+0000","last_undegraded":"2023-07-07T18:14:51.287726+0000","last_fullsized":"2023-07-07T18:14:51.287726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:27:53.328227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287686+0000","last_change":"2023-07-07T18:14:46.251381+0000","last_active":"2023-07-07T18:14:51.287686+0000","last_peered":"2023-07-07T18:14:51.287686+0000","last_clean":"2023-07-07T18:14:51.287686+0000","last_became_active":"2023-07-07T18:14:46.251132+0000","last_became_peered":"2023-07-07T18:14:46.251132+0000","last_unstale":"2023-07-07T18:14:51.287686+0000","last_undegraded":"2023-07-07T18:14:51.287686+0000","last_fullsized":"2023-07-07T18:14:51.287686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:36:06.840784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786267+0000","last_change":"2023-07-07T18:14:46.237529+0000","last_active":"2023-07-07T18:14:50.786267+0000","last_peered":"2023-07-07T18:14:50.786267+0000","last_clean":"2023-07-07T18:14:50.786267+0000","last_became_active":"2023-07-07T18:14:46.237227+0000","last_became_peered":"2023-07-07T18:14:46.237227+0000","last_unstale":"2023-07-07T18:14:50.786267+0000","last_undegraded":"2023-07-07T18:14:50.786267+0000","last_fullsized":"2023-07-07T18:14:50.786267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:30.201313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695700+0000","last_change":"2023-07-07T18:14:46.250166+0000","last_active":"2023-07-07T18:14:50.695700+0000","last_peered":"2023-07-07T18:14:50.695700+0000","last_clean":"2023-07-07T18:14:50.695700+0000","last_became_active":"2023-07-07T18:14:46.249865+0000","last_became_peered":"2023-07-07T18:14:46.249865+0000","last_unstale":"2023-07-07T18:14:50.695700+0000","last_undegraded":"2023-07-07T18:14:50.695700+0000","last_fullsized":"2023-07-07T18:14:50.695700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:03:21.014607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694727+0000","last_change":"2023-07-07T18:14:46.260407+0000","last_active":"2023-07-07T18:14:50.694727+0000","last_peered":"2023-07-07T18:14:50.694727+0000","last_clean":"2023-07-07T18:14:50.694727+0000","last_became_active":"2023-07-07T18:14:46.259937+0000","last_became_peered":"2023-07-07T18:14:46.259937+0000","last_unstale":"2023-07-07T18:14:50.694727+0000","last_undegraded":"2023-07-07T18:14:50.694727+0000","last_fullsized":"2023-07-07T18:14:50.694727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:56:49.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769064+0000","last_change":"2023-07-07T18:14:46.256893+0000","last_active":"2023-07-07T18:14:50.769064+0000","last_peered":"2023-07-07T18:14:50.769064+0000","last_clean":"2023-07-07T18:14:50.769064+0000","last_became_active":"2023-07-07T18:14:46.256622+0000","last_became_peered":"2023-07-07T18:14:46.256622+0000","last_unstale":"2023-07-07T18:14:50.769064+0000","last_undegraded":"2023-07-07T18:14:50.769064+0000","last_fullsized":"2023-07-07T18:14:50.769064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:35.628378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696247+0000","last_change":"2023-07-07T18:14:46.260376+0000","last_active":"2023-07-07T18:14:50.696247+0000","last_peered":"2023-07-07T18:14:50.696247+0000","last_clean":"2023-07-07T18:14:50.696247+0000","last_became_active":"2023-07-07T18:14:46.257010+0000","last_became_peered":"2023-07-07T18:14:46.257010+0000","last_unstale":"2023-07-07T18:14:50.696247+0000","last_undegraded":"2023-07-07T18:14:50.696247+0000","last_fullsized":"2023-07-07T18:14:50.696247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:39:01.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287639+0000","last_change":"2023-07-07T18:14:46.254186+0000","last_active":"2023-07-07T18:14:51.287639+0000","last_peered":"2023-07-07T18:14:51.287639+0000","last_clean":"2023-07-07T18:14:51.287639+0000","last_became_active":"2023-07-07T18:14:46.253897+0000","last_became_peered":"2023-07-07T18:14:46.253897+0000","last_unstale":"2023-07-07T18:14:51.287639+0000","last_undegraded":"2023-07-07T18:14:51.287639+0000","last_fullsized":"2023-07-07T18:14:51.287639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:47:31.616916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695873+0000","last_change":"2023-07-07T18:14:46.260027+0000","last_active":"2023-07-07T18:14:50.695873+0000","last_peered":"2023-07-07T18:14:50.695873+0000","last_clean":"2023-07-07T18:14:50.695873+0000","last_became_active":"2023-07-07T18:14:46.259740+0000","last_became_peered":"2023-07-07T18:14:46.259740+0000","last_unstale":"2023-07-07T18:14:50.695873+0000","last_undegraded":"2023-07-07T18:14:50.695873+0000","last_fullsized":"2023-07-07T18:14:50.695873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:11:34.268952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695458+0000","last_change":"2023-07-07T18:14:46.258673+0000","last_active":"2023-07-07T18:14:50.695458+0000","last_peered":"2023-07-07T18:14:50.695458+0000","last_clean":"2023-07-07T18:14:50.695458+0000","last_became_active":"2023-07-07T18:14:46.258410+0000","last_became_peered":"2023-07-07T18:14:46.258410+0000","last_unstale":"2023-07-07T18:14:50.695458+0000","last_undegraded":"2023-07-07T18:14:50.695458+0000","last_fullsized":"2023-07-07T18:14:50.695458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:36.856794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768546+0000","last_change":"2023-07-07T18:14:46.250342+0000","last_active":"2023-07-07T18:14:50.768546+0000","last_peered":"2023-07-07T18:14:50.768546+0000","last_clean":"2023-07-07T18:14:50.768546+0000","last_became_active":"2023-07-07T18:14:46.250051+0000","last_became_peered":"2023-07-07T18:14:46.250051+0000","last_unstale":"2023-07-07T18:14:50.768546+0000","last_undegraded":"2023-07-07T18:14:50.768546+0000","last_fullsized":"2023-07-07T18:14:50.768546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:05.786354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286813+0000","last_change":"2023-07-07T18:14:46.255595+0000","last_active":"2023-07-07T18:14:51.286813+0000","last_peered":"2023-07-07T18:14:51.286813+0000","last_clean":"2023-07-07T18:14:51.286813+0000","last_became_active":"2023-07-07T18:14:46.255308+0000","last_became_peered":"2023-07-07T18:14:46.255308+0000","last_unstale":"2023-07-07T18:14:51.286813+0000","last_undegraded":"2023-07-07T18:14:51.286813+0000","last_fullsized":"2023-07-07T18:14:51.286813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:22.768246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695160+0000","last_change":"2023-07-07T18:14:46.259159+0000","last_active":"2023-07-07T18:14:50.695160+0000","last_peered":"2023-07-07T18:14:50.695160+0000","last_clean":"2023-07-07T18:14:50.695160+0000","last_became_active":"2023-07-07T18:14:46.258888+0000","last_became_peered":"2023-07-07T18:14:46.258888+0000","last_unstale":"2023-07-07T18:14:50.695160+0000","last_undegraded":"2023-07-07T18:14:50.695160+0000","last_fullsized":"2023-07-07T18:14:50.695160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:04:20.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693827+0000","last_change":"2023-07-07T18:14:46.251261+0000","last_active":"2023-07-07T18:14:50.693827+0000","last_peered":"2023-07-07T18:14:50.693827+0000","last_clean":"2023-07-07T18:14:50.693827+0000","last_became_active":"2023-07-07T18:14:46.250985+0000","last_became_peered":"2023-07-07T18:14:46.250985+0000","last_unstale":"2023-07-07T18:14:50.693827+0000","last_undegraded":"2023-07-07T18:14:50.693827+0000","last_fullsized":"2023-07-07T18:14:50.693827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:27.744408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693850+0000","last_change":"2023-07-07T18:14:46.238108+0000","last_active":"2023-07-07T18:14:50.693850+0000","last_peered":"2023-07-07T18:14:50.693850+0000","last_clean":"2023-07-07T18:14:50.693850+0000","last_became_active":"2023-07-07T18:14:46.237731+0000","last_became_peered":"2023-07-07T18:14:46.237731+0000","last_unstale":"2023-07-07T18:14:50.693850+0000","last_undegraded":"2023-07-07T18:14:50.693850+0000","last_fullsized":"2023-07-07T18:14:50.693850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:56.152988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786655+0000","last_change":"2023-07-07T18:14:46.252496+0000","last_active":"2023-07-07T18:14:50.786655+0000","last_peered":"2023-07-07T18:14:50.786655+0000","last_clean":"2023-07-07T18:14:50.786655+0000","last_became_active":"2023-07-07T18:14:46.251903+0000","last_became_peered":"2023-07-07T18:14:46.251903+0000","last_unstale":"2023-07-07T18:14:50.786655+0000","last_undegraded":"2023-07-07T18:14:50.786655+0000","last_fullsized":"2023-07-07T18:14:50.786655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:50:58.513809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696161+0000","last_change":"2023-07-07T18:14:50.275663+0000","last_active":"2023-07-07T18:14:50.696161+0000","last_peered":"2023-07-07T18:14:50.696161+0000","last_clean":"2023-07-07T18:14:50.696161+0000","last_became_active":"2023-07-07T18:14:50.274814+0000","last_became_peered":"2023-07-07T18:14:50.274814+0000","last_unstale":"2023-07-07T18:14:50.696161+0000","last_undegraded":"2023-07-07T18:14:50.696161+0000","last_fullsized":"2023-07-07T18:14:50.696161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:57:09.270949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695701+0000","last_change":"2023-07-07T18:14:45.827301+0000","last_active":"2023-07-07T18:14:50.695701+0000","last_peered":"2023-07-07T18:14:50.695701+0000","last_clean":"2023-07-07T18:14:50.695701+0000","last_became_active":"2023-07-07T18:14:45.827011+0000","last_became_peered":"2023-07-07T18:14:45.827011+0000","last_unstale":"2023-07-07T18:14:50.695701+0000","last_undegraded":"2023-07-07T18:14:50.695701+0000","last_fullsized":"2023-07-07T18:14:50.695701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:39:36.675751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288069+0000","last_change":"2023-07-07T18:14:46.238475+0000","last_active":"2023-07-07T18:14:51.288069+0000","last_peered":"2023-07-07T18:14:51.288069+0000","last_clean":"2023-07-07T18:14:51.288069+0000","last_became_active":"2023-07-07T18:14:46.238195+0000","last_became_peered":"2023-07-07T18:14:46.238195+0000","last_unstale":"2023-07-07T18:14:51.288069+0000","last_undegraded":"2023-07-07T18:14:51.288069+0000","last_fullsized":"2023-07-07T18:14:51.288069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:25:55.917107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287704+0000","last_change":"2023-07-07T18:14:50.280065+0000","last_active":"2023-07-07T18:14:51.287704+0000","last_peered":"2023-07-07T18:14:51.287704+0000","last_clean":"2023-07-07T18:14:51.287704+0000","last_became_active":"2023-07-07T18:14:50.279693+0000","last_became_peered":"2023-07-07T18:14:50.279693+0000","last_unstale":"2023-07-07T18:14:51.287704+0000","last_undegraded":"2023-07-07T18:14:51.287704+0000","last_fullsized":"2023-07-07T18:14:51.287704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:50:58.472479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693103+0000","last_change":"2023-07-07T18:14:45.823969+0000","last_active":"2023-07-07T18:14:50.693103+0000","last_peered":"2023-07-07T18:14:50.693103+0000","last_clean":"2023-07-07T18:14:50.693103+0000","last_became_active":"2023-07-07T18:14:45.823633+0000","last_became_peered":"2023-07-07T18:14:45.823633+0000","last_unstale":"2023-07-07T18:14:50.693103+0000","last_undegraded":"2023-07-07T18:14:50.693103+0000","last_fullsized":"2023-07-07T18:14:50.693103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:33:57.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769007+0000","last_change":"2023-07-07T18:14:46.252472+0000","last_active":"2023-07-07T18:14:50.769007+0000","last_peered":"2023-07-07T18:14:50.769007+0000","last_clean":"2023-07-07T18:14:50.769007+0000","last_became_active":"2023-07-07T18:14:46.251913+0000","last_became_peered":"2023-07-07T18:14:46.251913+0000","last_unstale":"2023-07-07T18:14:50.769007+0000","last_undegraded":"2023-07-07T18:14:50.769007+0000","last_fullsized":"2023-07-07T18:14:50.769007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:35.950124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769225+0000","last_change":"2023-07-07T18:14:50.279703+0000","last_active":"2023-07-07T18:14:50.769225+0000","last_peered":"2023-07-07T18:14:50.769225+0000","last_clean":"2023-07-07T18:14:50.769225+0000","last_became_active":"2023-07-07T18:14:50.278724+0000","last_became_peered":"2023-07-07T18:14:50.278724+0000","last_unstale":"2023-07-07T18:14:50.769225+0000","last_undegraded":"2023-07-07T18:14:50.769225+0000","last_fullsized":"2023-07-07T18:14:50.769225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:49:51.568617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287384+0000","last_change":"2023-07-07T18:14:45.825144+0000","last_active":"2023-07-07T18:14:51.287384+0000","last_peered":"2023-07-07T18:14:51.287384+0000","last_clean":"2023-07-07T18:14:51.287384+0000","last_became_active":"2023-07-07T18:14:45.824734+0000","last_became_peered":"2023-07-07T18:14:45.824734+0000","last_unstale":"2023-07-07T18:14:51.287384+0000","last_undegraded":"2023-07-07T18:14:51.287384+0000","last_fullsized":"2023-07-07T18:14:51.287384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:05:04.291822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287718+0000","last_change":"2023-07-07T18:14:46.250855+0000","last_active":"2023-07-07T18:14:51.287718+0000","last_peered":"2023-07-07T18:14:51.287718+0000","last_clean":"2023-07-07T18:14:51.287718+0000","last_became_active":"2023-07-07T18:14:46.250523+0000","last_became_peered":"2023-07-07T18:14:46.250523+0000","last_unstale":"2023-07-07T18:14:51.287718+0000","last_undegraded":"2023-07-07T18:14:51.287718+0000","last_fullsized":"2023-07-07T18:14:51.287718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:13:53.124487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287116+0000","last_change":"2023-07-07T18:14:50.284048+0000","last_active":"2023-07-07T18:14:51.287116+0000","last_peered":"2023-07-07T18:14:51.287116+0000","last_clean":"2023-07-07T18:14:51.287116+0000","last_became_active":"2023-07-07T18:14:50.283525+0000","last_became_peered":"2023-07-07T18:14:50.283525+0000","last_unstale":"2023-07-07T18:14:51.287116+0000","last_undegraded":"2023-07-07T18:14:51.287116+0000","last_fullsized":"2023-07-07T18:14:51.287116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:56:26.834793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769206+0000","last_change":"2023-07-07T18:14:45.820272+0000","last_active":"2023-07-07T18:14:50.769206+0000","last_peered":"2023-07-07T18:14:50.769206+0000","last_clean":"2023-07-07T18:14:50.769206+0000","last_became_active":"2023-07-07T18:14:45.819791+0000","last_became_peered":"2023-07-07T18:14:45.819791+0000","last_unstale":"2023-07-07T18:14:50.769206+0000","last_undegraded":"2023-07-07T18:14:50.769206+0000","last_fullsized":"2023-07-07T18:14:50.769206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:25:18.468002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287255+0000","last_change":"2023-07-07T18:14:46.237273+0000","last_active":"2023-07-07T18:14:51.287255+0000","last_peered":"2023-07-07T18:14:51.287255+0000","last_clean":"2023-07-07T18:14:51.287255+0000","last_became_active":"2023-07-07T18:14:46.236974+0000","last_became_peered":"2023-07-07T18:14:46.236974+0000","last_unstale":"2023-07-07T18:14:51.287255+0000","last_undegraded":"2023-07-07T18:14:51.287255+0000","last_fullsized":"2023-07-07T18:14:51.287255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:54:31.016985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694188+0000","last_change":"2023-07-07T18:14:50.273820+0000","last_active":"2023-07-07T18:14:50.694188+0000","last_peered":"2023-07-07T18:14:50.694188+0000","last_clean":"2023-07-07T18:14:50.694188+0000","last_became_active":"2023-07-07T18:14:50.273435+0000","last_became_peered":"2023-07-07T18:14:50.273435+0000","last_unstale":"2023-07-07T18:14:50.694188+0000","last_undegraded":"2023-07-07T18:14:50.694188+0000","last_fullsized":"2023-07-07T18:14:50.694188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:24.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786841+0000","last_change":"2023-07-07T18:14:45.825130+0000","last_active":"2023-07-07T18:14:50.786841+0000","last_peered":"2023-07-07T18:14:50.786841+0000","last_clean":"2023-07-07T18:14:50.786841+0000","last_became_active":"2023-07-07T18:14:45.824837+0000","last_became_peered":"2023-07-07T18:14:45.824837+0000","last_unstale":"2023-07-07T18:14:50.786841+0000","last_undegraded":"2023-07-07T18:14:50.786841+0000","last_fullsized":"2023-07-07T18:14:50.786841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:14:32.249281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286957+0000","last_change":"2023-07-07T18:14:46.251224+0000","last_active":"2023-07-07T18:14:51.286957+0000","last_peered":"2023-07-07T18:14:51.286957+0000","last_clean":"2023-07-07T18:14:51.286957+0000","last_became_active":"2023-07-07T18:14:46.250930+0000","last_became_peered":"2023-07-07T18:14:46.250930+0000","last_unstale":"2023-07-07T18:14:51.286957+0000","last_undegraded":"2023-07-07T18:14:51.286957+0000","last_fullsized":"2023-07-07T18:14:51.286957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:04:20.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287030+0000","last_change":"2023-07-07T18:14:50.279519+0000","last_active":"2023-07-07T18:14:51.287030+0000","last_peered":"2023-07-07T18:14:51.287030+0000","last_clean":"2023-07-07T18:14:51.287030+0000","last_became_active":"2023-07-07T18:14:50.279123+0000","last_became_peered":"2023-07-07T18:14:50.279123+0000","last_unstale":"2023-07-07T18:14:51.287030+0000","last_undegraded":"2023-07-07T18:14:51.287030+0000","last_fullsized":"2023-07-07T18:14:51.287030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:06:52.179086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695194+0000","last_change":"2023-07-07T18:14:45.826154+0000","last_active":"2023-07-07T18:14:50.695194+0000","last_peered":"2023-07-07T18:14:50.695194+0000","last_clean":"2023-07-07T18:14:50.695194+0000","last_became_active":"2023-07-07T18:14:45.825811+0000","last_became_peered":"2023-07-07T18:14:45.825811+0000","last_unstale":"2023-07-07T18:14:50.695194+0000","last_undegraded":"2023-07-07T18:14:50.695194+0000","last_fullsized":"2023-07-07T18:14:50.695194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:06:47.726217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693492+0000","last_change":"2023-07-07T18:14:46.253842+0000","last_active":"2023-07-07T18:14:50.693492+0000","last_peered":"2023-07-07T18:14:50.693492+0000","last_clean":"2023-07-07T18:14:50.693492+0000","last_became_active":"2023-07-07T18:14:46.253610+0000","last_became_peered":"2023-07-07T18:14:46.253610+0000","last_unstale":"2023-07-07T18:14:50.693492+0000","last_undegraded":"2023-07-07T18:14:50.693492+0000","last_fullsized":"2023-07-07T18:14:50.693492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:46:48.904277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693169+0000","last_change":"2023-07-07T18:14:50.279382+0000","last_active":"2023-07-07T18:14:50.693169+0000","last_peered":"2023-07-07T18:14:50.693169+0000","last_clean":"2023-07-07T18:14:50.693169+0000","last_became_active":"2023-07-07T18:14:50.278873+0000","last_became_peered":"2023-07-07T18:14:50.278873+0000","last_unstale":"2023-07-07T18:14:50.693169+0000","last_undegraded":"2023-07-07T18:14:50.693169+0000","last_fullsized":"2023-07-07T18:14:50.693169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:02:54.121461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:55.778055+0000","last_change":"2023-07-07T18:14:45.823952+0000","last_active":"2023-07-07T18:14:55.778055+0000","last_peered":"2023-07-07T18:14:55.778055+0000","last_clean":"2023-07-07T18:14:55.778055+0000","last_became_active":"2023-07-07T18:14:45.823624+0000","last_became_peered":"2023-07-07T18:14:45.823624+0000","last_unstale":"2023-07-07T18:14:55.778055+0000","last_undegraded":"2023-07-07T18:14:55.778055+0000","last_fullsized":"2023-07-07T18:14:55.778055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:40:13.757713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695689+0000","last_change":"2023-07-07T18:14:46.253886+0000","last_active":"2023-07-07T18:14:50.695689+0000","last_peered":"2023-07-07T18:14:50.695689+0000","last_clean":"2023-07-07T18:14:50.695689+0000","last_became_active":"2023-07-07T18:14:46.253553+0000","last_became_peered":"2023-07-07T18:14:46.253553+0000","last_unstale":"2023-07-07T18:14:50.695689+0000","last_undegraded":"2023-07-07T18:14:50.695689+0000","last_fullsized":"2023-07-07T18:14:50.695689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:50:15.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786900+0000","last_change":"2023-07-07T18:14:50.281424+0000","last_active":"2023-07-07T18:14:50.786900+0000","last_peered":"2023-07-07T18:14:50.786900+0000","last_clean":"2023-07-07T18:14:50.786900+0000","last_became_active":"2023-07-07T18:14:50.281010+0000","last_became_peered":"2023-07-07T18:14:50.281010+0000","last_unstale":"2023-07-07T18:14:50.786900+0000","last_undegraded":"2023-07-07T18:14:50.786900+0000","last_fullsized":"2023-07-07T18:14:50.786900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:25:33.168587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695467+0000","last_change":"2023-07-07T18:14:45.830163+0000","last_active":"2023-07-07T18:14:50.695467+0000","last_peered":"2023-07-07T18:14:50.695467+0000","last_clean":"2023-07-07T18:14:50.695467+0000","last_became_active":"2023-07-07T18:14:45.829928+0000","last_became_peered":"2023-07-07T18:14:45.829928+0000","last_unstale":"2023-07-07T18:14:50.695467+0000","last_undegraded":"2023-07-07T18:14:50.695467+0000","last_fullsized":"2023-07-07T18:14:50.695467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:23:48.677042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287433+0000","last_change":"2023-07-07T18:14:46.238712+0000","last_active":"2023-07-07T18:14:51.287433+0000","last_peered":"2023-07-07T18:14:51.287433+0000","last_clean":"2023-07-07T18:14:51.287433+0000","last_became_active":"2023-07-07T18:14:46.238414+0000","last_became_peered":"2023-07-07T18:14:46.238414+0000","last_unstale":"2023-07-07T18:14:51.287433+0000","last_undegraded":"2023-07-07T18:14:51.287433+0000","last_fullsized":"2023-07-07T18:14:51.287433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:01:57.247568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287657+0000","last_change":"2023-07-07T18:14:50.283995+0000","last_active":"2023-07-07T18:14:51.287657+0000","last_peered":"2023-07-07T18:14:51.287657+0000","last_clean":"2023-07-07T18:14:51.287657+0000","last_became_active":"2023-07-07T18:14:50.280787+0000","last_became_peered":"2023-07-07T18:14:50.280787+0000","last_unstale":"2023-07-07T18:14:51.287657+0000","last_undegraded":"2023-07-07T18:14:51.287657+0000","last_fullsized":"2023-07-07T18:14:51.287657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:40.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768416+0000","last_change":"2023-07-07T18:14:45.818817+0000","last_active":"2023-07-07T18:14:50.768416+0000","last_peered":"2023-07-07T18:14:50.768416+0000","last_clean":"2023-07-07T18:14:50.768416+0000","last_became_active":"2023-07-07T18:14:45.817217+0000","last_became_peered":"2023-07-07T18:14:45.817217+0000","last_unstale":"2023-07-07T18:14:50.768416+0000","last_undegraded":"2023-07-07T18:14:50.768416+0000","last_fullsized":"2023-07-07T18:14:50.768416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:35.237658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786635+0000","last_change":"2023-07-07T18:14:46.252322+0000","last_active":"2023-07-07T18:14:50.786635+0000","last_peered":"2023-07-07T18:14:50.786635+0000","last_clean":"2023-07-07T18:14:50.786635+0000","last_became_active":"2023-07-07T18:14:46.251581+0000","last_became_peered":"2023-07-07T18:14:46.251581+0000","last_unstale":"2023-07-07T18:14:50.786635+0000","last_undegraded":"2023-07-07T18:14:50.786635+0000","last_fullsized":"2023-07-07T18:14:50.786635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:25:19.477377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288314+0000","last_change":"2023-07-07T18:14:50.279662+0000","last_active":"2023-07-07T18:14:51.288314+0000","last_peered":"2023-07-07T18:14:51.288314+0000","last_clean":"2023-07-07T18:14:51.288314+0000","last_became_active":"2023-07-07T18:14:50.279182+0000","last_became_peered":"2023-07-07T18:14:50.279182+0000","last_unstale":"2023-07-07T18:14:51.288314+0000","last_undegraded":"2023-07-07T18:14:51.288314+0000","last_fullsized":"2023-07-07T18:14:51.288314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:29.387286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695766+0000","last_change":"2023-07-07T18:14:45.828779+0000","last_active":"2023-07-07T18:14:50.695766+0000","last_peered":"2023-07-07T18:14:50.695766+0000","last_clean":"2023-07-07T18:14:50.695766+0000","last_became_active":"2023-07-07T18:14:45.828387+0000","last_became_peered":"2023-07-07T18:14:45.828387+0000","last_unstale":"2023-07-07T18:14:50.695766+0000","last_undegraded":"2023-07-07T18:14:50.695766+0000","last_fullsized":"2023-07-07T18:14:50.695766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:25:54.907733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769086+0000","last_change":"2023-07-07T18:14:46.258991+0000","last_active":"2023-07-07T18:14:50.769086+0000","last_peered":"2023-07-07T18:14:50.769086+0000","last_clean":"2023-07-07T18:14:50.769086+0000","last_became_active":"2023-07-07T18:14:46.258711+0000","last_became_peered":"2023-07-07T18:14:46.258711+0000","last_unstale":"2023-07-07T18:14:50.769086+0000","last_undegraded":"2023-07-07T18:14:50.769086+0000","last_fullsized":"2023-07-07T18:14:50.769086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:10.136646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786752+0000","last_change":"2023-07-07T18:14:50.275066+0000","last_active":"2023-07-07T18:14:50.786752+0000","last_peered":"2023-07-07T18:14:50.786752+0000","last_clean":"2023-07-07T18:14:50.786752+0000","last_became_active":"2023-07-07T18:14:50.274631+0000","last_became_peered":"2023-07-07T18:14:50.274631+0000","last_unstale":"2023-07-07T18:14:50.786752+0000","last_undegraded":"2023-07-07T18:14:50.786752+0000","last_fullsized":"2023-07-07T18:14:50.786752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:26:07.680601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287040+0000","last_change":"2023-07-07T18:14:45.819945+0000","last_active":"2023-07-07T18:14:51.287040+0000","last_peered":"2023-07-07T18:14:51.287040+0000","last_clean":"2023-07-07T18:14:51.287040+0000","last_became_active":"2023-07-07T18:14:45.819662+0000","last_became_peered":"2023-07-07T18:14:45.819662+0000","last_unstale":"2023-07-07T18:14:51.287040+0000","last_undegraded":"2023-07-07T18:14:51.287040+0000","last_fullsized":"2023-07-07T18:14:51.287040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:05:21.194016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288364+0000","last_change":"2023-07-07T18:14:46.253586+0000","last_active":"2023-07-07T18:14:51.288364+0000","last_peered":"2023-07-07T18:14:51.288364+0000","last_clean":"2023-07-07T18:14:51.288364+0000","last_became_active":"2023-07-07T18:14:46.250668+0000","last_became_peered":"2023-07-07T18:14:46.250668+0000","last_unstale":"2023-07-07T18:14:51.288364+0000","last_undegraded":"2023-07-07T18:14:51.288364+0000","last_fullsized":"2023-07-07T18:14:51.288364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:18:50.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695970+0000","last_change":"2023-07-07T18:14:50.278682+0000","last_active":"2023-07-07T18:14:50.695970+0000","last_peered":"2023-07-07T18:14:50.695970+0000","last_clean":"2023-07-07T18:14:50.695970+0000","last_became_active":"2023-07-07T18:14:50.278199+0000","last_became_peered":"2023-07-07T18:14:50.278199+0000","last_unstale":"2023-07-07T18:14:50.695970+0000","last_undegraded":"2023-07-07T18:14:50.695970+0000","last_fullsized":"2023-07-07T18:14:50.695970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:29.387286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695323+0000","last_change":"2023-07-07T18:14:45.828517+0000","last_active":"2023-07-07T18:14:50.695323+0000","last_peered":"2023-07-07T18:14:50.695323+0000","last_clean":"2023-07-07T18:14:50.695323+0000","last_became_active":"2023-07-07T18:14:45.828221+0000","last_became_peered":"2023-07-07T18:14:45.828221+0000","last_unstale":"2023-07-07T18:14:50.695323+0000","last_undegraded":"2023-07-07T18:14:50.695323+0000","last_fullsized":"2023-07-07T18:14:50.695323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:55.691985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786013+0000","last_change":"2023-07-07T18:14:46.243955+0000","last_active":"2023-07-07T18:14:50.786013+0000","last_peered":"2023-07-07T18:14:50.786013+0000","last_clean":"2023-07-07T18:14:50.786013+0000","last_became_active":"2023-07-07T18:14:46.243697+0000","last_became_peered":"2023-07-07T18:14:46.243697+0000","last_unstale":"2023-07-07T18:14:50.786013+0000","last_undegraded":"2023-07-07T18:14:50.786013+0000","last_fullsized":"2023-07-07T18:14:50.786013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286669+0000","last_change":"2023-07-07T18:14:50.283314+0000","last_active":"2023-07-07T18:14:51.286669+0000","last_peered":"2023-07-07T18:14:51.286669+0000","last_clean":"2023-07-07T18:14:51.286669+0000","last_became_active":"2023-07-07T18:14:50.282741+0000","last_became_peered":"2023-07-07T18:14:50.282741+0000","last_unstale":"2023-07-07T18:14:51.286669+0000","last_undegraded":"2023-07-07T18:14:51.286669+0000","last_fullsized":"2023-07-07T18:14:51.286669+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:24:24.468449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695371+0000","last_change":"2023-07-07T18:14:45.828552+0000","last_active":"2023-07-07T18:14:50.695371+0000","last_peered":"2023-07-07T18:14:50.695371+0000","last_clean":"2023-07-07T18:14:50.695371+0000","last_became_active":"2023-07-07T18:14:45.828251+0000","last_became_peered":"2023-07-07T18:14:45.828251+0000","last_unstale":"2023-07-07T18:14:50.695371+0000","last_undegraded":"2023-07-07T18:14:50.695371+0000","last_fullsized":"2023-07-07T18:14:50.695371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:05:04.291822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694453+0000","last_change":"2023-07-07T18:14:46.254474+0000","last_active":"2023-07-07T18:14:50.694453+0000","last_peered":"2023-07-07T18:14:50.694453+0000","last_clean":"2023-07-07T18:14:50.694453+0000","last_became_active":"2023-07-07T18:14:46.253792+0000","last_became_peered":"2023-07-07T18:14:46.253792+0000","last_unstale":"2023-07-07T18:14:50.694453+0000","last_undegraded":"2023-07-07T18:14:50.694453+0000","last_fullsized":"2023-07-07T18:14:50.694453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:32:22.705610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287527+0000","last_change":"2023-07-07T18:14:50.275935+0000","last_active":"2023-07-07T18:14:51.287527+0000","last_peered":"2023-07-07T18:14:51.287527+0000","last_clean":"2023-07-07T18:14:51.287527+0000","last_became_active":"2023-07-07T18:14:50.275504+0000","last_became_peered":"2023-07-07T18:14:50.275504+0000","last_unstale":"2023-07-07T18:14:51.287527+0000","last_undegraded":"2023-07-07T18:14:51.287527+0000","last_fullsized":"2023-07-07T18:14:51.287527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:46:53.498090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695560+0000","last_change":"2023-07-07T18:14:45.824161+0000","last_active":"2023-07-07T18:14:50.695560+0000","last_peered":"2023-07-07T18:14:50.695560+0000","last_clean":"2023-07-07T18:14:50.695560+0000","last_became_active":"2023-07-07T18:14:45.823845+0000","last_became_peered":"2023-07-07T18:14:45.823845+0000","last_unstale":"2023-07-07T18:14:50.695560+0000","last_undegraded":"2023-07-07T18:14:50.695560+0000","last_fullsized":"2023-07-07T18:14:50.695560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:01:56.238194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287041+0000","last_change":"2023-07-07T18:14:46.251483+0000","last_active":"2023-07-07T18:14:51.287041+0000","last_peered":"2023-07-07T18:14:51.287041+0000","last_clean":"2023-07-07T18:14:51.287041+0000","last_became_active":"2023-07-07T18:14:46.251186+0000","last_became_peered":"2023-07-07T18:14:46.251186+0000","last_unstale":"2023-07-07T18:14:51.287041+0000","last_undegraded":"2023-07-07T18:14:51.287041+0000","last_fullsized":"2023-07-07T18:14:51.287041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:49:31.365534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287561+0000","last_change":"2023-07-07T18:14:50.284553+0000","last_active":"2023-07-07T18:14:51.287561+0000","last_peered":"2023-07-07T18:14:51.287561+0000","last_clean":"2023-07-07T18:14:51.287561+0000","last_became_active":"2023-07-07T18:14:50.284133+0000","last_became_peered":"2023-07-07T18:14:50.284133+0000","last_unstale":"2023-07-07T18:14:51.287561+0000","last_undegraded":"2023-07-07T18:14:51.287561+0000","last_fullsized":"2023-07-07T18:14:51.287561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:32:21.452429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786401+0000","last_change":"2023-07-07T18:14:45.825329+0000","last_active":"2023-07-07T18:14:50.786401+0000","last_peered":"2023-07-07T18:14:50.786401+0000","last_clean":"2023-07-07T18:14:50.786401+0000","last_became_active":"2023-07-07T18:14:45.824977+0000","last_became_peered":"2023-07-07T18:14:45.824977+0000","last_unstale":"2023-07-07T18:14:50.786401+0000","last_undegraded":"2023-07-07T18:14:50.786401+0000","last_fullsized":"2023-07-07T18:14:50.786401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:26.735034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769180+0000","last_change":"2023-07-07T18:14:46.253430+0000","last_active":"2023-07-07T18:14:50.769180+0000","last_peered":"2023-07-07T18:14:50.769180+0000","last_clean":"2023-07-07T18:14:50.769180+0000","last_became_active":"2023-07-07T18:14:46.252998+0000","last_became_peered":"2023-07-07T18:14:46.252998+0000","last_unstale":"2023-07-07T18:14:50.769180+0000","last_undegraded":"2023-07-07T18:14:50.769180+0000","last_fullsized":"2023-07-07T18:14:50.769180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:10:28.413855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287751+0000","last_change":"2023-07-07T18:14:50.281644+0000","last_active":"2023-07-07T18:14:51.287751+0000","last_peered":"2023-07-07T18:14:51.287751+0000","last_clean":"2023-07-07T18:14:51.287751+0000","last_became_active":"2023-07-07T18:14:50.281288+0000","last_became_peered":"2023-07-07T18:14:50.281288+0000","last_unstale":"2023-07-07T18:14:51.287751+0000","last_undegraded":"2023-07-07T18:14:51.287751+0000","last_fullsized":"2023-07-07T18:14:51.287751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:05:38.716449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286765+0000","last_change":"2023-07-07T18:14:45.825137+0000","last_active":"2023-07-07T18:14:51.286765+0000","last_peered":"2023-07-07T18:14:51.286765+0000","last_clean":"2023-07-07T18:14:51.286765+0000","last_became_active":"2023-07-07T18:14:45.824813+0000","last_became_peered":"2023-07-07T18:14:45.824813+0000","last_unstale":"2023-07-07T18:14:51.286765+0000","last_undegraded":"2023-07-07T18:14:51.286765+0000","last_fullsized":"2023-07-07T18:14:51.286765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:39:11.889878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695709+0000","last_change":"2023-07-07T18:14:46.261872+0000","last_active":"2023-07-07T18:14:50.695709+0000","last_peered":"2023-07-07T18:14:50.695709+0000","last_clean":"2023-07-07T18:14:50.695709+0000","last_became_active":"2023-07-07T18:14:46.261503+0000","last_became_peered":"2023-07-07T18:14:46.261503+0000","last_unstale":"2023-07-07T18:14:50.695709+0000","last_undegraded":"2023-07-07T18:14:50.695709+0000","last_fullsized":"2023-07-07T18:14:50.695709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:28:13.350106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693444+0000","last_change":"2023-07-07T18:14:50.282090+0000","last_active":"2023-07-07T18:14:50.693444+0000","last_peered":"2023-07-07T18:14:50.693444+0000","last_clean":"2023-07-07T18:14:50.693444+0000","last_became_active":"2023-07-07T18:14:50.281530+0000","last_became_peered":"2023-07-07T18:14:50.281530+0000","last_unstale":"2023-07-07T18:14:50.693444+0000","last_undegraded":"2023-07-07T18:14:50.693444+0000","last_fullsized":"2023-07-07T18:14:50.693444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:39.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287090+0000","last_change":"2023-07-07T18:14:45.827877+0000","last_active":"2023-07-07T18:14:51.287090+0000","last_peered":"2023-07-07T18:14:51.287090+0000","last_clean":"2023-07-07T18:14:51.287090+0000","last_became_active":"2023-07-07T18:14:45.827533+0000","last_became_peered":"2023-07-07T18:14:45.827533+0000","last_unstale":"2023-07-07T18:14:51.287090+0000","last_undegraded":"2023-07-07T18:14:51.287090+0000","last_fullsized":"2023-07-07T18:14:51.287090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:32:52.527564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696156+0000","last_change":"2023-07-07T18:14:46.256950+0000","last_active":"2023-07-07T18:14:50.696156+0000","last_peered":"2023-07-07T18:14:50.696156+0000","last_clean":"2023-07-07T18:14:50.696156+0000","last_became_active":"2023-07-07T18:14:46.254597+0000","last_became_peered":"2023-07-07T18:14:46.254597+0000","last_unstale":"2023-07-07T18:14:50.696156+0000","last_undegraded":"2023-07-07T18:14:50.696156+0000","last_fullsized":"2023-07-07T18:14:50.696156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:51:19.489510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786947+0000","last_change":"2023-07-07T18:14:50.275061+0000","last_active":"2023-07-07T18:14:50.786947+0000","last_peered":"2023-07-07T18:14:50.786947+0000","last_clean":"2023-07-07T18:14:50.786947+0000","last_became_active":"2023-07-07T18:14:50.274636+0000","last_became_peered":"2023-07-07T18:14:50.274636+0000","last_unstale":"2023-07-07T18:14:50.786947+0000","last_undegraded":"2023-07-07T18:14:50.786947+0000","last_fullsized":"2023-07-07T18:14:50.786947+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:17:32.136223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694160+0000","last_change":"2023-07-07T18:14:45.816489+0000","last_active":"2023-07-07T18:14:50.694160+0000","last_peered":"2023-07-07T18:14:50.694160+0000","last_clean":"2023-07-07T18:14:50.694160+0000","last_became_active":"2023-07-07T18:14:45.816126+0000","last_became_peered":"2023-07-07T18:14:45.816126+0000","last_unstale":"2023-07-07T18:14:50.694160+0000","last_undegraded":"2023-07-07T18:14:50.694160+0000","last_fullsized":"2023-07-07T18:14:50.694160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:19:43.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696412+0000","last_change":"2023-07-07T18:14:46.260154+0000","last_active":"2023-07-07T18:14:50.696412+0000","last_peered":"2023-07-07T18:14:50.696412+0000","last_clean":"2023-07-07T18:14:50.696412+0000","last_became_active":"2023-07-07T18:14:46.254390+0000","last_became_peered":"2023-07-07T18:14:46.254390+0000","last_unstale":"2023-07-07T18:14:50.696412+0000","last_undegraded":"2023-07-07T18:14:50.696412+0000","last_fullsized":"2023-07-07T18:14:50.696412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:39:54.707650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696102+0000","last_change":"2023-07-07T18:14:50.275972+0000","last_active":"2023-07-07T18:14:50.696102+0000","last_peered":"2023-07-07T18:14:50.696102+0000","last_clean":"2023-07-07T18:14:50.696102+0000","last_became_active":"2023-07-07T18:14:50.275539+0000","last_became_peered":"2023-07-07T18:14:50.275539+0000","last_unstale":"2023-07-07T18:14:50.696102+0000","last_undegraded":"2023-07-07T18:14:50.696102+0000","last_fullsized":"2023-07-07T18:14:50.696102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:48:45.018589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287119+0000","last_change":"2023-07-07T18:14:45.825399+0000","last_active":"2023-07-07T18:14:51.287119+0000","last_peered":"2023-07-07T18:14:51.287119+0000","last_clean":"2023-07-07T18:14:51.287119+0000","last_became_active":"2023-07-07T18:14:45.825119+0000","last_became_peered":"2023-07-07T18:14:45.825119+0000","last_unstale":"2023-07-07T18:14:51.287119+0000","last_undegraded":"2023-07-07T18:14:51.287119+0000","last_fullsized":"2023-07-07T18:14:51.287119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:58:05.705920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693893+0000","last_change":"2023-07-07T18:14:46.240829+0000","last_active":"2023-07-07T18:14:50.693893+0000","last_peered":"2023-07-07T18:14:50.693893+0000","last_clean":"2023-07-07T18:14:50.693893+0000","last_became_active":"2023-07-07T18:14:46.239938+0000","last_became_peered":"2023-07-07T18:14:46.239938+0000","last_unstale":"2023-07-07T18:14:50.693893+0000","last_undegraded":"2023-07-07T18:14:50.693893+0000","last_fullsized":"2023-07-07T18:14:50.693893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:35.628378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768716+0000","last_change":"2023-07-07T18:14:50.274346+0000","last_active":"2023-07-07T18:14:50.768716+0000","last_peered":"2023-07-07T18:14:50.768716+0000","last_clean":"2023-07-07T18:14:50.768716+0000","last_became_active":"2023-07-07T18:14:50.271130+0000","last_became_peered":"2023-07-07T18:14:50.271130+0000","last_unstale":"2023-07-07T18:14:50.768716+0000","last_undegraded":"2023-07-07T18:14:50.768716+0000","last_fullsized":"2023-07-07T18:14:50.768716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:46:52.347771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693665+0000","last_change":"2023-07-07T18:14:41.010006+0000","last_active":"2023-07-07T18:14:50.693665+0000","last_peered":"2023-07-07T18:14:50.693665+0000","last_clean":"2023-07-07T18:14:50.693665+0000","last_became_active":"2023-07-07T18:14:41.009625+0000","last_became_peered":"2023-07-07T18:14:41.009625+0000","last_unstale":"2023-07-07T18:14:50.693665+0000","last_undegraded":"2023-07-07T18:14:50.693665+0000","last_fullsized":"2023-07-07T18:14:50.693665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:11.821985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786501+0000","last_change":"2023-07-07T18:14:45.825558+0000","last_active":"2023-07-07T18:14:50.786501+0000","last_peered":"2023-07-07T18:14:50.786501+0000","last_clean":"2023-07-07T18:14:50.786501+0000","last_became_active":"2023-07-07T18:14:45.824990+0000","last_became_peered":"2023-07-07T18:14:45.824990+0000","last_unstale":"2023-07-07T18:14:50.786501+0000","last_undegraded":"2023-07-07T18:14:50.786501+0000","last_fullsized":"2023-07-07T18:14:50.786501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:49:47.115748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693078+0000","last_change":"2023-07-07T18:14:46.236943+0000","last_active":"2023-07-07T18:14:50.693078+0000","last_peered":"2023-07-07T18:14:50.693078+0000","last_clean":"2023-07-07T18:14:50.693078+0000","last_became_active":"2023-07-07T18:14:46.236679+0000","last_became_peered":"2023-07-07T18:14:46.236679+0000","last_unstale":"2023-07-07T18:14:50.693078+0000","last_undegraded":"2023-07-07T18:14:50.693078+0000","last_fullsized":"2023-07-07T18:14:50.693078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:32:08.214196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768915+0000","last_change":"2023-07-07T18:14:50.274560+0000","last_active":"2023-07-07T18:14:50.768915+0000","last_peered":"2023-07-07T18:14:50.768915+0000","last_clean":"2023-07-07T18:14:50.768915+0000","last_became_active":"2023-07-07T18:14:50.273900+0000","last_became_peered":"2023-07-07T18:14:50.273900+0000","last_unstale":"2023-07-07T18:14:50.768915+0000","last_undegraded":"2023-07-07T18:14:50.768915+0000","last_fullsized":"2023-07-07T18:14:50.768915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:21.422334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786290+0000","last_change":"2023-07-07T18:14:40.652460+0000","last_active":"2023-07-07T18:14:50.786290+0000","last_peered":"2023-07-07T18:14:50.786290+0000","last_clean":"2023-07-07T18:14:50.786290+0000","last_became_active":"2023-07-07T18:14:40.652046+0000","last_became_peered":"2023-07-07T18:14:40.652046+0000","last_unstale":"2023-07-07T18:14:50.786290+0000","last_undegraded":"2023-07-07T18:14:50.786290+0000","last_fullsized":"2023-07-07T18:14:50.786290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:29.793269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694562+0000","last_change":"2023-07-07T18:14:45.827286+0000","last_active":"2023-07-07T18:14:50.694562+0000","last_peered":"2023-07-07T18:14:50.694562+0000","last_clean":"2023-07-07T18:14:50.694562+0000","last_became_active":"2023-07-07T18:14:45.826913+0000","last_became_peered":"2023-07-07T18:14:45.826913+0000","last_unstale":"2023-07-07T18:14:50.694562+0000","last_undegraded":"2023-07-07T18:14:50.694562+0000","last_fullsized":"2023-07-07T18:14:50.694562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:36:09.401587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693546+0000","last_change":"2023-07-07T18:14:46.239120+0000","last_active":"2023-07-07T18:14:50.693546+0000","last_peered":"2023-07-07T18:14:50.693546+0000","last_clean":"2023-07-07T18:14:50.693546+0000","last_became_active":"2023-07-07T18:14:46.238876+0000","last_became_peered":"2023-07-07T18:14:46.238876+0000","last_unstale":"2023-07-07T18:14:50.693546+0000","last_undegraded":"2023-07-07T18:14:50.693546+0000","last_fullsized":"2023-07-07T18:14:50.693546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287928+0000","last_change":"2023-07-07T18:14:50.282994+0000","last_active":"2023-07-07T18:14:51.287928+0000","last_peered":"2023-07-07T18:14:51.287928+0000","last_clean":"2023-07-07T18:14:51.287928+0000","last_became_active":"2023-07-07T18:14:50.282569+0000","last_became_peered":"2023-07-07T18:14:50.282569+0000","last_unstale":"2023-07-07T18:14:51.287928+0000","last_undegraded":"2023-07-07T18:14:51.287928+0000","last_fullsized":"2023-07-07T18:14:51.287928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:00:27.527355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287831+0000","last_change":"2023-07-07T18:14:41.009938+0000","last_active":"2023-07-07T18:14:51.287831+0000","last_peered":"2023-07-07T18:14:51.287831+0000","last_clean":"2023-07-07T18:14:51.287831+0000","last_became_active":"2023-07-07T18:14:41.009637+0000","last_became_peered":"2023-07-07T18:14:41.009637+0000","last_unstale":"2023-07-07T18:14:51.287831+0000","last_undegraded":"2023-07-07T18:14:51.287831+0000","last_fullsized":"2023-07-07T18:14:51.287831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:47:01.369288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693129+0000","last_change":"2023-07-07T18:14:45.813731+0000","last_active":"2023-07-07T18:14:50.693129+0000","last_peered":"2023-07-07T18:14:50.693129+0000","last_clean":"2023-07-07T18:14:50.693129+0000","last_became_active":"2023-07-07T18:14:45.813444+0000","last_became_peered":"2023-07-07T18:14:45.813444+0000","last_unstale":"2023-07-07T18:14:50.693129+0000","last_undegraded":"2023-07-07T18:14:50.693129+0000","last_fullsized":"2023-07-07T18:14:50.693129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:04.776980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693755+0000","last_change":"2023-07-07T18:14:46.238296+0000","last_active":"2023-07-07T18:14:50.693755+0000","last_peered":"2023-07-07T18:14:50.693755+0000","last_clean":"2023-07-07T18:14:50.693755+0000","last_became_active":"2023-07-07T18:14:46.237650+0000","last_became_peered":"2023-07-07T18:14:46.237650+0000","last_unstale":"2023-07-07T18:14:50.693755+0000","last_undegraded":"2023-07-07T18:14:50.693755+0000","last_fullsized":"2023-07-07T18:14:50.693755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:35.950124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695160+0000","last_change":"2023-07-07T18:14:50.276840+0000","last_active":"2023-07-07T18:14:50.695160+0000","last_peered":"2023-07-07T18:14:50.695160+0000","last_clean":"2023-07-07T18:14:50.695160+0000","last_became_active":"2023-07-07T18:14:50.276444+0000","last_became_peered":"2023-07-07T18:14:50.276444+0000","last_unstale":"2023-07-07T18:14:50.695160+0000","last_undegraded":"2023-07-07T18:14:50.695160+0000","last_fullsized":"2023-07-07T18:14:50.695160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:26:07.867774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786425+0000","last_change":"2023-07-07T18:14:40.652887+0000","last_active":"2023-07-07T18:14:50.786425+0000","last_peered":"2023-07-07T18:14:50.786425+0000","last_clean":"2023-07-07T18:14:50.786425+0000","last_became_active":"2023-07-07T18:14:40.652550+0000","last_became_peered":"2023-07-07T18:14:40.652550+0000","last_unstale":"2023-07-07T18:14:50.786425+0000","last_undegraded":"2023-07-07T18:14:50.786425+0000","last_fullsized":"2023-07-07T18:14:50.786425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:29.471523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694978+0000","last_change":"2023-07-07T18:14:34.464008+0000","last_active":"2023-07-07T18:14:50.694978+0000","last_peered":"2023-07-07T18:14:50.694978+0000","last_clean":"2023-07-07T18:14:50.694978+0000","last_became_active":"2023-07-07T18:14:34.463018+0000","last_became_peered":"2023-07-07T18:14:34.463018+0000","last_unstale":"2023-07-07T18:14:50.694978+0000","last_undegraded":"2023-07-07T18:14:50.694978+0000","last_fullsized":"2023-07-07T18:14:50.694978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_clean_scrub_stamp":"2023-07-07T18:14:33.057285+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:10.029083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287082+0000","last_change":"2023-07-07T18:14:45.825928+0000","last_active":"2023-07-07T18:14:51.287082+0000","last_peered":"2023-07-07T18:14:51.287082+0000","last_clean":"2023-07-07T18:14:51.287082+0000","last_became_active":"2023-07-07T18:14:45.825599+0000","last_became_peered":"2023-07-07T18:14:45.825599+0000","last_unstale":"2023-07-07T18:14:51.287082+0000","last_undegraded":"2023-07-07T18:14:51.287082+0000","last_fullsized":"2023-07-07T18:14:51.287082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:04:44.156178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287267+0000","last_change":"2023-07-07T18:14:46.262476+0000","last_active":"2023-07-07T18:14:51.287267+0000","last_peered":"2023-07-07T18:14:51.287267+0000","last_clean":"2023-07-07T18:14:51.287267+0000","last_became_active":"2023-07-07T18:14:46.262165+0000","last_became_peered":"2023-07-07T18:14:46.262165+0000","last_unstale":"2023-07-07T18:14:51.287267+0000","last_undegraded":"2023-07-07T18:14:51.287267+0000","last_fullsized":"2023-07-07T18:14:51.287267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:21:36.267002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786724+0000","last_change":"2023-07-07T18:14:50.282211+0000","last_active":"2023-07-07T18:14:50.786724+0000","last_peered":"2023-07-07T18:14:50.786724+0000","last_clean":"2023-07-07T18:14:50.786724+0000","last_became_active":"2023-07-07T18:14:50.281448+0000","last_became_peered":"2023-07-07T18:14:50.281448+0000","last_unstale":"2023-07-07T18:14:50.786724+0000","last_undegraded":"2023-07-07T18:14:50.786724+0000","last_fullsized":"2023-07-07T18:14:50.786724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:17:53.884605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695381+0000","last_change":"2023-07-07T18:14:40.649525+0000","last_active":"2023-07-07T18:14:50.695381+0000","last_peered":"2023-07-07T18:14:50.695381+0000","last_clean":"2023-07-07T18:14:50.695381+0000","last_became_active":"2023-07-07T18:14:40.649168+0000","last_became_peered":"2023-07-07T18:14:40.649168+0000","last_unstale":"2023-07-07T18:14:50.695381+0000","last_undegraded":"2023-07-07T18:14:50.695381+0000","last_fullsized":"2023-07-07T18:14:50.695381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:04:39.008697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768373+0000","last_change":"2023-07-07T18:14:45.825496+0000","last_active":"2023-07-07T18:14:50.768373+0000","last_peered":"2023-07-07T18:14:50.768373+0000","last_clean":"2023-07-07T18:14:50.768373+0000","last_became_active":"2023-07-07T18:14:45.825173+0000","last_became_peered":"2023-07-07T18:14:45.825173+0000","last_unstale":"2023-07-07T18:14:50.768373+0000","last_undegraded":"2023-07-07T18:14:50.768373+0000","last_fullsized":"2023-07-07T18:14:50.768373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:32:07.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768857+0000","last_change":"2023-07-07T18:14:46.252633+0000","last_active":"2023-07-07T18:14:50.768857+0000","last_peered":"2023-07-07T18:14:50.768857+0000","last_clean":"2023-07-07T18:14:50.768857+0000","last_became_active":"2023-07-07T18:14:46.252199+0000","last_became_peered":"2023-07-07T18:14:46.252199+0000","last_unstale":"2023-07-07T18:14:50.768857+0000","last_undegraded":"2023-07-07T18:14:50.768857+0000","last_fullsized":"2023-07-07T18:14:50.768857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287489+0000","last_change":"2023-07-07T18:14:50.276895+0000","last_active":"2023-07-07T18:14:51.287489+0000","last_peered":"2023-07-07T18:14:51.287489+0000","last_clean":"2023-07-07T18:14:51.287489+0000","last_became_active":"2023-07-07T18:14:50.276507+0000","last_became_peered":"2023-07-07T18:14:50.276507+0000","last_unstale":"2023-07-07T18:14:51.287489+0000","last_undegraded":"2023-07-07T18:14:51.287489+0000","last_fullsized":"2023-07-07T18:14:51.287489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:34:18.314525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695369+0000","last_change":"2023-07-07T18:14:41.009946+0000","last_active":"2023-07-07T18:14:50.695369+0000","last_peered":"2023-07-07T18:14:50.695369+0000","last_clean":"2023-07-07T18:14:50.695369+0000","last_became_active":"2023-07-07T18:14:41.009627+0000","last_became_peered":"2023-07-07T18:14:41.009627+0000","last_unstale":"2023-07-07T18:14:50.695369+0000","last_undegraded":"2023-07-07T18:14:50.695369+0000","last_fullsized":"2023-07-07T18:14:50.695369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:58:00.558439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693986+0000","last_change":"2023-07-07T18:14:45.814432+0000","last_active":"2023-07-07T18:14:50.693986+0000","last_peered":"2023-07-07T18:14:50.693986+0000","last_clean":"2023-07-07T18:14:50.693986+0000","last_became_active":"2023-07-07T18:14:45.814128+0000","last_became_peered":"2023-07-07T18:14:45.814128+0000","last_unstale":"2023-07-07T18:14:50.693986+0000","last_undegraded":"2023-07-07T18:14:50.693986+0000","last_fullsized":"2023-07-07T18:14:50.693986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:09.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769002+0000","last_change":"2023-07-07T18:14:46.253259+0000","last_active":"2023-07-07T18:14:50.769002+0000","last_peered":"2023-07-07T18:14:50.769002+0000","last_clean":"2023-07-07T18:14:50.769002+0000","last_became_active":"2023-07-07T18:14:46.252670+0000","last_became_peered":"2023-07-07T18:14:46.252670+0000","last_unstale":"2023-07-07T18:14:50.769002+0000","last_undegraded":"2023-07-07T18:14:50.769002+0000","last_fullsized":"2023-07-07T18:14:50.769002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:56.152988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695641+0000","last_change":"2023-07-07T18:14:50.279532+0000","last_active":"2023-07-07T18:14:50.695641+0000","last_peered":"2023-07-07T18:14:50.695641+0000","last_clean":"2023-07-07T18:14:50.695641+0000","last_became_active":"2023-07-07T18:14:50.279056+0000","last_became_peered":"2023-07-07T18:14:50.279056+0000","last_unstale":"2023-07-07T18:14:50.695641+0000","last_undegraded":"2023-07-07T18:14:50.695641+0000","last_fullsized":"2023-07-07T18:14:50.695641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:08:30.223728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288438+0000","last_change":"2023-07-07T18:14:45.825994+0000","last_active":"2023-07-07T18:14:51.288438+0000","last_peered":"2023-07-07T18:14:51.288438+0000","last_clean":"2023-07-07T18:14:51.288438+0000","last_became_active":"2023-07-07T18:14:45.825663+0000","last_became_peered":"2023-07-07T18:14:45.825663+0000","last_unstale":"2023-07-07T18:14:51.288438+0000","last_undegraded":"2023-07-07T18:14:51.288438+0000","last_fullsized":"2023-07-07T18:14:51.288438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:39:19.689182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693519+0000","last_change":"2023-07-07T18:14:40.651911+0000","last_active":"2023-07-07T18:14:50.693519+0000","last_peered":"2023-07-07T18:14:50.693519+0000","last_clean":"2023-07-07T18:14:50.693519+0000","last_became_active":"2023-07-07T18:14:40.651592+0000","last_became_peered":"2023-07-07T18:14:40.651592+0000","last_unstale":"2023-07-07T18:14:50.693519+0000","last_undegraded":"2023-07-07T18:14:50.693519+0000","last_fullsized":"2023-07-07T18:14:50.693519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:14:59.730163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286989+0000","last_change":"2023-07-07T18:14:46.251841+0000","last_active":"2023-07-07T18:14:51.286989+0000","last_peered":"2023-07-07T18:14:51.286989+0000","last_clean":"2023-07-07T18:14:51.286989+0000","last_became_active":"2023-07-07T18:14:46.251574+0000","last_became_peered":"2023-07-07T18:14:46.251574+0000","last_unstale":"2023-07-07T18:14:51.286989+0000","last_undegraded":"2023-07-07T18:14:51.286989+0000","last_fullsized":"2023-07-07T18:14:51.286989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:56.701359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286832+0000","last_change":"2023-07-07T18:14:50.280371+0000","last_active":"2023-07-07T18:14:51.286832+0000","last_peered":"2023-07-07T18:14:51.286832+0000","last_clean":"2023-07-07T18:14:51.286832+0000","last_became_active":"2023-07-07T18:14:50.279833+0000","last_became_peered":"2023-07-07T18:14:50.279833+0000","last_unstale":"2023-07-07T18:14:51.286832+0000","last_undegraded":"2023-07-07T18:14:51.286832+0000","last_fullsized":"2023-07-07T18:14:51.286832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:24.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287631+0000","last_change":"2023-07-07T18:14:40.653854+0000","last_active":"2023-07-07T18:14:51.287631+0000","last_peered":"2023-07-07T18:14:51.287631+0000","last_clean":"2023-07-07T18:14:51.287631+0000","last_became_active":"2023-07-07T18:14:40.653556+0000","last_became_peered":"2023-07-07T18:14:40.653556+0000","last_unstale":"2023-07-07T18:14:51.287631+0000","last_undegraded":"2023-07-07T18:14:51.287631+0000","last_fullsized":"2023-07-07T18:14:51.287631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:49:03.953888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:15:00.768001+0000","last_change":"2023-07-07T18:14:45.813532+0000","last_active":"2023-07-07T18:15:00.768001+0000","last_peered":"2023-07-07T18:15:00.768001+0000","last_clean":"2023-07-07T18:15:00.768001+0000","last_became_active":"2023-07-07T18:14:45.813237+0000","last_became_peered":"2023-07-07T18:14:45.813237+0000","last_unstale":"2023-07-07T18:15:00.768001+0000","last_undegraded":"2023-07-07T18:15:00.768001+0000","last_fullsized":"2023-07-07T18:15:00.768001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:29.191939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694299+0000","last_change":"2023-07-07T18:14:46.256921+0000","last_active":"2023-07-07T18:14:50.694299+0000","last_peered":"2023-07-07T18:14:50.694299+0000","last_clean":"2023-07-07T18:14:50.694299+0000","last_became_active":"2023-07-07T18:14:46.255057+0000","last_became_peered":"2023-07-07T18:14:46.255057+0000","last_unstale":"2023-07-07T18:14:50.694299+0000","last_undegraded":"2023-07-07T18:14:50.694299+0000","last_fullsized":"2023-07-07T18:14:50.694299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:01:33.602440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693740+0000","last_change":"2023-07-07T18:14:50.281352+0000","last_active":"2023-07-07T18:14:50.693740+0000","last_peered":"2023-07-07T18:14:50.693740+0000","last_clean":"2023-07-07T18:14:50.693740+0000","last_became_active":"2023-07-07T18:14:50.280740+0000","last_became_peered":"2023-07-07T18:14:50.280740+0000","last_unstale":"2023-07-07T18:14:50.693740+0000","last_undegraded":"2023-07-07T18:14:50.693740+0000","last_fullsized":"2023-07-07T18:14:50.693740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:33.644807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768930+0000","last_change":"2023-07-07T18:14:45.828162+0000","last_active":"2023-07-07T18:14:50.768930+0000","last_peered":"2023-07-07T18:14:50.768930+0000","last_clean":"2023-07-07T18:14:50.768930+0000","last_became_active":"2023-07-07T18:14:45.827811+0000","last_became_peered":"2023-07-07T18:14:45.827811+0000","last_unstale":"2023-07-07T18:14:50.768930+0000","last_undegraded":"2023-07-07T18:14:50.768930+0000","last_fullsized":"2023-07-07T18:14:50.768930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:24.297526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287464+0000","last_change":"2023-07-07T18:14:46.246578+0000","last_active":"2023-07-07T18:14:51.287464+0000","last_peered":"2023-07-07T18:14:51.287464+0000","last_clean":"2023-07-07T18:14:51.287464+0000","last_became_active":"2023-07-07T18:14:46.246295+0000","last_became_peered":"2023-07-07T18:14:46.246295+0000","last_unstale":"2023-07-07T18:14:51.287464+0000","last_undegraded":"2023-07-07T18:14:51.287464+0000","last_fullsized":"2023-07-07T18:14:51.287464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:48:00.728010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695529+0000","last_change":"2023-07-07T18:14:50.272282+0000","last_active":"2023-07-07T18:14:50.695529+0000","last_peered":"2023-07-07T18:14:50.695529+0000","last_clean":"2023-07-07T18:14:50.695529+0000","last_became_active":"2023-07-07T18:14:50.271865+0000","last_became_peered":"2023-07-07T18:14:50.271865+0000","last_unstale":"2023-07-07T18:14:50.695529+0000","last_undegraded":"2023-07-07T18:14:50.695529+0000","last_fullsized":"2023-07-07T18:14:50.695529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:54:34.460479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786378+0000","last_change":"2023-07-07T18:14:45.827922+0000","last_active":"2023-07-07T18:14:50.786378+0000","last_peered":"2023-07-07T18:14:50.786378+0000","last_clean":"2023-07-07T18:14:50.786378+0000","last_became_active":"2023-07-07T18:14:45.827638+0000","last_became_peered":"2023-07-07T18:14:45.827638+0000","last_unstale":"2023-07-07T18:14:50.786378+0000","last_undegraded":"2023-07-07T18:14:50.786378+0000","last_fullsized":"2023-07-07T18:14:50.786378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:24.297526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694444+0000","last_change":"2023-07-07T18:14:46.261660+0000","last_active":"2023-07-07T18:14:50.694444+0000","last_peered":"2023-07-07T18:14:50.694444+0000","last_clean":"2023-07-07T18:14:50.694444+0000","last_became_active":"2023-07-07T18:14:46.260861+0000","last_became_peered":"2023-07-07T18:14:46.260861+0000","last_unstale":"2023-07-07T18:14:50.694444+0000","last_undegraded":"2023-07-07T18:14:50.694444+0000","last_fullsized":"2023-07-07T18:14:50.694444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:47:43.651762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786504+0000","last_change":"2023-07-07T18:14:50.281633+0000","last_active":"2023-07-07T18:14:50.786504+0000","last_peered":"2023-07-07T18:14:50.786504+0000","last_clean":"2023-07-07T18:14:50.786504+0000","last_became_active":"2023-07-07T18:14:50.280606+0000","last_became_peered":"2023-07-07T18:14:50.280606+0000","last_unstale":"2023-07-07T18:14:50.786504+0000","last_undegraded":"2023-07-07T18:14:50.786504+0000","last_fullsized":"2023-07-07T18:14:50.786504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:59.596483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786476+0000","last_change":"2023-07-07T18:14:45.828754+0000","last_active":"2023-07-07T18:14:50.786476+0000","last_peered":"2023-07-07T18:14:50.786476+0000","last_clean":"2023-07-07T18:14:50.786476+0000","last_became_active":"2023-07-07T18:14:45.828425+0000","last_became_peered":"2023-07-07T18:14:45.828425+0000","last_unstale":"2023-07-07T18:14:50.786476+0000","last_undegraded":"2023-07-07T18:14:50.786476+0000","last_fullsized":"2023-07-07T18:14:50.786476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:09.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694287+0000","last_change":"2023-07-07T18:14:46.261672+0000","last_active":"2023-07-07T18:14:50.694287+0000","last_peered":"2023-07-07T18:14:50.694287+0000","last_clean":"2023-07-07T18:14:50.694287+0000","last_became_active":"2023-07-07T18:14:46.260782+0000","last_became_peered":"2023-07-07T18:14:46.260782+0000","last_unstale":"2023-07-07T18:14:50.694287+0000","last_undegraded":"2023-07-07T18:14:50.694287+0000","last_fullsized":"2023-07-07T18:14:50.694287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:51:02.683189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694186+0000","last_change":"2023-07-07T18:14:50.280851+0000","last_active":"2023-07-07T18:14:50.694186+0000","last_peered":"2023-07-07T18:14:50.694186+0000","last_clean":"2023-07-07T18:14:50.694186+0000","last_became_active":"2023-07-07T18:14:50.280316+0000","last_became_peered":"2023-07-07T18:14:50.280316+0000","last_unstale":"2023-07-07T18:14:50.694186+0000","last_undegraded":"2023-07-07T18:14:50.694186+0000","last_fullsized":"2023-07-07T18:14:50.694186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:28:18.418331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288205+0000","last_change":"2023-07-07T18:14:45.827930+0000","last_active":"2023-07-07T18:14:51.288205+0000","last_peered":"2023-07-07T18:14:51.288205+0000","last_clean":"2023-07-07T18:14:51.288205+0000","last_became_active":"2023-07-07T18:14:45.827650+0000","last_became_peered":"2023-07-07T18:14:45.827650+0000","last_unstale":"2023-07-07T18:14:51.288205+0000","last_undegraded":"2023-07-07T18:14:51.288205+0000","last_fullsized":"2023-07-07T18:14:51.288205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:41:51.857434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287208+0000","last_change":"2023-07-07T18:14:46.238211+0000","last_active":"2023-07-07T18:14:51.287208+0000","last_peered":"2023-07-07T18:14:51.287208+0000","last_clean":"2023-07-07T18:14:51.287208+0000","last_became_active":"2023-07-07T18:14:46.237822+0000","last_became_peered":"2023-07-07T18:14:46.237822+0000","last_unstale":"2023-07-07T18:14:51.287208+0000","last_undegraded":"2023-07-07T18:14:51.287208+0000","last_fullsized":"2023-07-07T18:14:51.287208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:23:49.686417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693146+0000","last_change":"2023-07-07T18:14:50.279713+0000","last_active":"2023-07-07T18:14:50.693146+0000","last_peered":"2023-07-07T18:14:50.693146+0000","last_clean":"2023-07-07T18:14:50.693146+0000","last_became_active":"2023-07-07T18:14:50.278898+0000","last_became_peered":"2023-07-07T18:14:50.278898+0000","last_unstale":"2023-07-07T18:14:50.693146+0000","last_undegraded":"2023-07-07T18:14:50.693146+0000","last_fullsized":"2023-07-07T18:14:50.693146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:41:35.250768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769299+0000","last_change":"2023-07-07T18:14:45.820079+0000","last_active":"2023-07-07T18:14:50.769299+0000","last_peered":"2023-07-07T18:14:50.769299+0000","last_clean":"2023-07-07T18:14:50.769299+0000","last_became_active":"2023-07-07T18:14:45.819405+0000","last_became_peered":"2023-07-07T18:14:45.819405+0000","last_unstale":"2023-07-07T18:14:50.769299+0000","last_undegraded":"2023-07-07T18:14:50.769299+0000","last_fullsized":"2023-07-07T18:14:50.769299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:50:57.504435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695320+0000","last_change":"2023-07-07T18:14:46.256641+0000","last_active":"2023-07-07T18:14:50.695320+0000","last_peered":"2023-07-07T18:14:50.695320+0000","last_clean":"2023-07-07T18:14:50.695320+0000","last_became_active":"2023-07-07T18:14:46.253883+0000","last_became_peered":"2023-07-07T18:14:46.253883+0000","last_unstale":"2023-07-07T18:14:50.695320+0000","last_undegraded":"2023-07-07T18:14:50.695320+0000","last_fullsized":"2023-07-07T18:14:50.695320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:00:41.025452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287193+0000","last_change":"2023-07-07T18:14:46.253192+0000","last_active":"2023-07-07T18:14:51.287193+0000","last_peered":"2023-07-07T18:14:51.287193+0000","last_clean":"2023-07-07T18:14:51.287193+0000","last_became_active":"2023-07-07T18:14:46.250853+0000","last_became_peered":"2023-07-07T18:14:46.250853+0000","last_unstale":"2023-07-07T18:14:51.287193+0000","last_undegraded":"2023-07-07T18:14:51.287193+0000","last_fullsized":"2023-07-07T18:14:51.287193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:29:26.486548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287484+0000","last_change":"2023-07-07T18:14:46.238908+0000","last_active":"2023-07-07T18:14:51.287484+0000","last_peered":"2023-07-07T18:14:51.287484+0000","last_clean":"2023-07-07T18:14:51.287484+0000","last_became_active":"2023-07-07T18:14:46.238441+0000","last_became_peered":"2023-07-07T18:14:46.238441+0000","last_unstale":"2023-07-07T18:14:51.287484+0000","last_undegraded":"2023-07-07T18:14:51.287484+0000","last_fullsized":"2023-07-07T18:14:51.287484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:03:21.014607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694640+0000","last_change":"2023-07-07T18:14:46.256362+0000","last_active":"2023-07-07T18:14:50.694640+0000","last_peered":"2023-07-07T18:14:50.694640+0000","last_clean":"2023-07-07T18:14:50.694640+0000","last_became_active":"2023-07-07T18:14:46.254215+0000","last_became_peered":"2023-07-07T18:14:46.254215+0000","last_unstale":"2023-07-07T18:14:50.694640+0000","last_undegraded":"2023-07-07T18:14:50.694640+0000","last_fullsized":"2023-07-07T18:14:50.694640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:51.783149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286797+0000","last_change":"2023-07-07T18:14:46.254566+0000","last_active":"2023-07-07T18:14:51.286797+0000","last_peered":"2023-07-07T18:14:51.286797+0000","last_clean":"2023-07-07T18:14:51.286797+0000","last_became_active":"2023-07-07T18:14:46.250615+0000","last_became_peered":"2023-07-07T18:14:46.250615+0000","last_unstale":"2023-07-07T18:14:51.286797+0000","last_undegraded":"2023-07-07T18:14:51.286797+0000","last_fullsized":"2023-07-07T18:14:51.286797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:26:04.424280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693785+0000","last_change":"2023-07-07T18:14:46.245808+0000","last_active":"2023-07-07T18:14:50.693785+0000","last_peered":"2023-07-07T18:14:50.693785+0000","last_clean":"2023-07-07T18:14:50.693785+0000","last_became_active":"2023-07-07T18:14:46.245489+0000","last_became_peered":"2023-07-07T18:14:46.245489+0000","last_unstale":"2023-07-07T18:14:50.693785+0000","last_undegraded":"2023-07-07T18:14:50.693785+0000","last_fullsized":"2023-07-07T18:14:50.693785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:25.306900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":933888,"data_stored":721743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":717646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8380000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":127455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":131215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":128017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T18:15:15.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T18:15:15.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.778+0000 7f99c89e1700 1 Processor -- start 2023-07-07T18:15:15.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.778+0000 7f99c89e1700 1 -- start start 2023-07-07T18:15:15.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c89e1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c406b270 0x7f99c40cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c89e1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c40ce8e0 con 0x7f99c40d02d0 2023-07-07T18:15:15.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c89e1700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c406f140 con 0x7f99c406b640 2023-07-07T18:15:15.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c89e1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c406f420 con 0x7f99c406b270 2023-07-07T18:15:15.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c1d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f99c40d02d0 0x7f99c40cd760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54870/0 (socket says 172.21.15.12:54870) 2023-07-07T18:15:15.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c1d9b700 1 -- 172.21.15.12:0/2340007915 learned_addr learned my addr 172.21.15.12:0/2340007915 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:15.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c259c700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c406b270 0x7f99c40cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841162274 0 0) 0x7f99c40ce8e0 con 0x7f99c40d02d0 2023-07-07T18:15:15.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ac0035b0 con 0x7f99c40d02d0 2023-07-07T18:15:15.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2459865527 0 0) 0x7f99ac0035b0 con 0x7f99c40d02d0 2023-07-07T18:15:15.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c406b270 msgr2=0x7f99c40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:15.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c406b270 0x7f99c40cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 >> v1:172.21.15.160:6789/0 conn(0x7f99c406b640 legacy=0x7f99c40ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c406f700 con 0x7f99c40d02d0 2023-07-07T18:15:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f99b8001670 con 0x7f99c40d02d0 2023-07-07T18:15:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 >> v1:172.21.15.12:6789/0 conn(0x7f99c40d02d0 legacy=0x7f99c40cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99ac003a30 0x7f99ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c406b270 0x7f99ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.779+0000 7f99c159a700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99ac004d90 0x7f99ac005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c406f420 con 0x7f99ac004d90 2023-07-07T18:15:15.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac00bac0 con 0x7f99ac003a30 2023-07-07T18:15:15.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac00bc50 con 0x7f99c406b270 2023-07-07T18:15:15.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c2d9d700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99ac004d90 0x7f99ac005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c259c700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99ac003a30 0x7f99ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c1d9b700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c406b270 0x7f99ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c2d9d700 1 -- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c406b270 msgr2=0x7f99ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:15.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c2d9d700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c406b270 0x7f99ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c2d9d700 1 -- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99ac003a30 msgr2=0x7f99ac003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c2d9d700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99ac003a30 0x7f99ac003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c2d9d700 1 -- 172.21.15.12:0/2340007915 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0035b0 con 0x7f99ac004d90 2023-07-07T18:15:15.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c2d9d700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99ac004d90 0x7f99ac005200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c290 tx=0x7f99ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed720cd7ffa0bc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc001e70 con 0x7f99ac004d90 2023-07-07T18:15:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc00ce50 con 0x7f99ac004d90 2023-07-07T18:15:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.780+0000 7f99c159a700 1 -- 172.21.15.12:0/2340007915 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc012660 con 0x7f99ac004d90 2023-07-07T18:15:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.781+0000 7f99c89e1700 1 -- 172.21.15.12:0/2340007915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99ac004d90 msgr2=0x7f99ac005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.781+0000 7f99c89e1700 1 --2- 172.21.15.12:0/2340007915 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99ac004d90 0x7f99ac005200 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c290 tx=0x7f99ac005880 comp rx=0 tx=0).stop 2023-07-07T18:15:15.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.781+0000 7f99c2d9d700 1 -- 172.21.15.12:0/2340007915 reap_dead start 2023-07-07T18:15:15.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.781+0000 7f99c89e1700 1 -- 172.21.15.12:0/2340007915 shutdown_connections 2023-07-07T18:15:15.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.781+0000 7f99c89e1700 1 -- 172.21.15.12:0/2340007915 >> 172.21.15.12:0/2340007915 conn(0x7f99c4089fe0 msgr2=0x7f99c40d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:15.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.781+0000 7f99c89e1700 1 -- 172.21.15.12:0/2340007915 shutdown_connections 2023-07-07T18:15:15.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.781+0000 7f99c89e1700 1 -- 172.21.15.12:0/2340007915 wait complete. 2023-07-07T18:15:15.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.782+0000 7f99c89e1700 1 Processor -- start 2023-07-07T18:15:15.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.782+0000 7f99c89e1700 1 -- start start 2023-07-07T18:15:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c89e1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99ac004d90 0x7f99c409b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c89e1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c409a6e0 0x7f99c40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c89e1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c409ab50 0x7f99c40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c89e1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c409beb0 con 0x7f99c409ab50 2023-07-07T18:15:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c89e1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c414b6f0 con 0x7f99ac004d90 2023-07-07T18:15:15.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c89e1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c41f54c0 con 0x7f99c409a6e0 2023-07-07T18:15:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c409ab50 0x7f99c40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c409ab50 0x7f99c40b4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57686/0 (socket says 172.21.15.12:57686) 2023-07-07T18:15:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c2d9d700 1 -- 172.21.15.12:0/2236158157 learned_addr learned my addr 172.21.15.12:0/2236158157 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c1d9b700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c409a6e0 0x7f99c40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c259c700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99ac004d90 0x7f99c409b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c2d9d700 1 -- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c409a6e0 msgr2=0x7f99c40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c2d9d700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c409a6e0 0x7f99c40b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c2d9d700 1 -- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99ac004d90 msgr2=0x7f99c409b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c2d9d700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99ac004d90 0x7f99c409b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.783+0000 7f99c2d9d700 1 -- 172.21.15.12:0/2236158157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c41f57a0 con 0x7f99c409ab50 2023-07-07T18:15:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.784+0000 7f99c2d9d700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c409ab50 0x7f99c40b4b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0047a0 tx=0x7f99bc0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.784+0000 7f99b2ffd700 1 -- 172.21.15.12:0/2236158157 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0050c0 con 0x7f99c409ab50 2023-07-07T18:15:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.784+0000 7f99b2ffd700 1 -- 172.21.15.12:0/2236158157 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc005220 con 0x7f99c409ab50 2023-07-07T18:15:15.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.784+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c41f5a80 con 0x7f99c409ab50 2023-07-07T18:15:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.784+0000 7f99b2ffd700 1 -- 172.21.15.12:0/2236158157 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0055d0 con 0x7f99c409ab50 2023-07-07T18:15:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.784+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c41f6040 con 0x7f99c409ab50 2023-07-07T18:15:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.785+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c406be90 con 0x7f99c409ab50 2023-07-07T18:15:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.785+0000 7f99b2ffd700 1 -- 172.21.15.12:0/2236158157 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99bc023070 con 0x7f99c409ab50 2023-07-07T18:15:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.786+0000 7f99b2ffd700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f99a406ace0 0x7f99a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:15.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.786+0000 7f99b2ffd700 1 -- 172.21.15.12:0/2236158157 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f99bc08b0b0 con 0x7f99c409ab50 2023-07-07T18:15:15.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.786+0000 7f99c259c700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f99a406ace0 0x7f99a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:15.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.786+0000 7f99c259c700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f99a406ace0 0x7f99a406d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009aa0 tx=0x7f99b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:15.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.790+0000 7f99b2ffd700 1 -- 172.21.15.12:0/2236158157 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99bc055f00 con 0x7f99c409ab50 2023-07-07T18:15:15.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.984+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 --> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99c40ce570 con 0x7f99a406ace0 2023-07-07T18:15:15.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.994+0000 7f99b2ffd700 1 -- 172.21.15.12:0/2236158157 <== mgr.4100 v2:172.21.15.160:6832/4080099133 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367290 (secure 0 0 0) 0x7f99b40137d0 con 0x7f99a406ace0 2023-07-07T18:15:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f99a406ace0 msgr2=0x7f99a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f99a406ace0 0x7f99a406d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009aa0 tx=0x7f99b4008040 comp rx=0 tx=0).stop 2023-07-07T18:15:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c409ab50 msgr2=0x7f99c40b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c409ab50 0x7f99c40b4b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0047a0 tx=0x7f99bc0015b0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 shutdown_connections 2023-07-07T18:15:16.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f99a406ace0 0x7f99a406d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99c409ab50 0x7f99c40b4b50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99ac004d90 0x7f99c409b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 --2- 172.21.15.12:0/2236158157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c409a6e0 0x7f99c40b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 >> 172.21.15.12:0/2236158157 conn(0x7f99c4089fe0 msgr2=0x7f99c4155980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:16.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 shutdown_connections 2023-07-07T18:15:16.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:15.998+0000 7f99c89e1700 1 -- 172.21.15.12:0/2236158157 wait complete. 2023-07-07T18:15:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-07-07T18:15:16.012 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-07-07T18:15:14.596955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219268,"kb_used_data":3652,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755452,"statfs":{"total":773094113280,"available":772869582848,"internally_reserved":0,"allocated":3739648,"data_stored":2208171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003792"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287995+0000","last_change":"2023-07-07T18:14:46.251969+0000","last_active":"2023-07-07T18:14:51.287995+0000","last_peered":"2023-07-07T18:14:51.287995+0000","last_clean":"2023-07-07T18:14:51.287995+0000","last_became_active":"2023-07-07T18:14:46.251645+0000","last_became_peered":"2023-07-07T18:14:46.251645+0000","last_unstale":"2023-07-07T18:14:51.287995+0000","last_undegraded":"2023-07-07T18:14:51.287995+0000","last_fullsized":"2023-07-07T18:14:51.287995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:09:35.223387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786630+0000","last_change":"2023-07-07T18:14:46.246398+0000","last_active":"2023-07-07T18:14:50.786630+0000","last_peered":"2023-07-07T18:14:50.786630+0000","last_clean":"2023-07-07T18:14:50.786630+0000","last_became_active":"2023-07-07T18:14:46.246114+0000","last_became_peered":"2023-07-07T18:14:46.246114+0000","last_unstale":"2023-07-07T18:14:50.786630+0000","last_undegraded":"2023-07-07T18:14:50.786630+0000","last_fullsized":"2023-07-07T18:14:50.786630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:10:28.413855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696469+0000","last_change":"2023-07-07T18:14:46.260795+0000","last_active":"2023-07-07T18:14:50.696469+0000","last_peered":"2023-07-07T18:14:50.696469+0000","last_clean":"2023-07-07T18:14:50.696469+0000","last_became_active":"2023-07-07T18:14:46.260094+0000","last_became_peered":"2023-07-07T18:14:46.260094+0000","last_unstale":"2023-07-07T18:14:50.696469+0000","last_undegraded":"2023-07-07T18:14:50.696469+0000","last_fullsized":"2023-07-07T18:14:50.696469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:50:11.200504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287193+0000","last_change":"2023-07-07T18:14:46.256379+0000","last_active":"2023-07-07T18:14:51.287193+0000","last_peered":"2023-07-07T18:14:51.287193+0000","last_clean":"2023-07-07T18:14:51.287193+0000","last_became_active":"2023-07-07T18:14:46.256093+0000","last_became_peered":"2023-07-07T18:14:46.256093+0000","last_unstale":"2023-07-07T18:14:51.287193+0000","last_undegraded":"2023-07-07T18:14:51.287193+0000","last_fullsized":"2023-07-07T18:14:51.287193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:45.897131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768761+0000","last_change":"2023-07-07T18:14:46.256853+0000","last_active":"2023-07-07T18:14:50.768761+0000","last_peered":"2023-07-07T18:14:50.768761+0000","last_clean":"2023-07-07T18:14:50.768761+0000","last_became_active":"2023-07-07T18:14:46.256595+0000","last_became_peered":"2023-07-07T18:14:46.256595+0000","last_unstale":"2023-07-07T18:14:50.768761+0000","last_undegraded":"2023-07-07T18:14:50.768761+0000","last_fullsized":"2023-07-07T18:14:50.768761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:15:05.887018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694486+0000","last_change":"2023-07-07T18:14:46.256691+0000","last_active":"2023-07-07T18:14:50.694486+0000","last_peered":"2023-07-07T18:14:50.694486+0000","last_clean":"2023-07-07T18:14:50.694486+0000","last_became_active":"2023-07-07T18:14:46.254378+0000","last_became_peered":"2023-07-07T18:14:46.254378+0000","last_unstale":"2023-07-07T18:14:50.694486+0000","last_undegraded":"2023-07-07T18:14:50.694486+0000","last_fullsized":"2023-07-07T18:14:50.694486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:51:05.609476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695840+0000","last_change":"2023-07-07T18:14:46.259522+0000","last_active":"2023-07-07T18:14:50.695840+0000","last_peered":"2023-07-07T18:14:50.695840+0000","last_clean":"2023-07-07T18:14:50.695840+0000","last_became_active":"2023-07-07T18:14:46.259213+0000","last_became_peered":"2023-07-07T18:14:46.259213+0000","last_unstale":"2023-07-07T18:14:50.695840+0000","last_undegraded":"2023-07-07T18:14:50.695840+0000","last_fullsized":"2023-07-07T18:14:50.695840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:41:52.866809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786149+0000","last_change":"2023-07-07T18:14:46.257573+0000","last_active":"2023-07-07T18:14:50.786149+0000","last_peered":"2023-07-07T18:14:50.786149+0000","last_clean":"2023-07-07T18:14:50.786149+0000","last_became_active":"2023-07-07T18:14:46.257234+0000","last_became_peered":"2023-07-07T18:14:46.257234+0000","last_unstale":"2023-07-07T18:14:50.786149+0000","last_undegraded":"2023-07-07T18:14:50.786149+0000","last_fullsized":"2023-07-07T18:14:50.786149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:17.978840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769023+0000","last_change":"2023-07-07T18:14:46.256934+0000","last_active":"2023-07-07T18:14:50.769023+0000","last_peered":"2023-07-07T18:14:50.769023+0000","last_clean":"2023-07-07T18:14:50.769023+0000","last_became_active":"2023-07-07T18:14:46.256669+0000","last_became_peered":"2023-07-07T18:14:46.256669+0000","last_unstale":"2023-07-07T18:14:50.769023+0000","last_undegraded":"2023-07-07T18:14:50.769023+0000","last_fullsized":"2023-07-07T18:14:50.769023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:27.744408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786945+0000","last_change":"2023-07-07T18:14:46.253312+0000","last_active":"2023-07-07T18:14:50.786945+0000","last_peered":"2023-07-07T18:14:50.786945+0000","last_clean":"2023-07-07T18:14:50.786945+0000","last_became_active":"2023-07-07T18:14:46.253067+0000","last_became_peered":"2023-07-07T18:14:46.253067+0000","last_unstale":"2023-07-07T18:14:50.786945+0000","last_undegraded":"2023-07-07T18:14:50.786945+0000","last_fullsized":"2023-07-07T18:14:50.786945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:15:55.654834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696368+0000","last_change":"2023-07-07T18:14:46.257215+0000","last_active":"2023-07-07T18:14:50.696368+0000","last_peered":"2023-07-07T18:14:50.696368+0000","last_clean":"2023-07-07T18:14:50.696368+0000","last_became_active":"2023-07-07T18:14:46.254498+0000","last_became_peered":"2023-07-07T18:14:46.254498+0000","last_unstale":"2023-07-07T18:14:50.696368+0000","last_undegraded":"2023-07-07T18:14:50.696368+0000","last_fullsized":"2023-07-07T18:14:50.696368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:44:17.278555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287726+0000","last_change":"2023-07-07T18:14:46.261297+0000","last_active":"2023-07-07T18:14:51.287726+0000","last_peered":"2023-07-07T18:14:51.287726+0000","last_clean":"2023-07-07T18:14:51.287726+0000","last_became_active":"2023-07-07T18:14:46.260968+0000","last_became_peered":"2023-07-07T18:14:46.260968+0000","last_unstale":"2023-07-07T18:14:51.287726+0000","last_undegraded":"2023-07-07T18:14:51.287726+0000","last_fullsized":"2023-07-07T18:14:51.287726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:27:53.328227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287686+0000","last_change":"2023-07-07T18:14:46.251381+0000","last_active":"2023-07-07T18:14:51.287686+0000","last_peered":"2023-07-07T18:14:51.287686+0000","last_clean":"2023-07-07T18:14:51.287686+0000","last_became_active":"2023-07-07T18:14:46.251132+0000","last_became_peered":"2023-07-07T18:14:46.251132+0000","last_unstale":"2023-07-07T18:14:51.287686+0000","last_undegraded":"2023-07-07T18:14:51.287686+0000","last_fullsized":"2023-07-07T18:14:51.287686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:36:06.840784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786267+0000","last_change":"2023-07-07T18:14:46.237529+0000","last_active":"2023-07-07T18:14:50.786267+0000","last_peered":"2023-07-07T18:14:50.786267+0000","last_clean":"2023-07-07T18:14:50.786267+0000","last_became_active":"2023-07-07T18:14:46.237227+0000","last_became_peered":"2023-07-07T18:14:46.237227+0000","last_unstale":"2023-07-07T18:14:50.786267+0000","last_undegraded":"2023-07-07T18:14:50.786267+0000","last_fullsized":"2023-07-07T18:14:50.786267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:30.201313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695700+0000","last_change":"2023-07-07T18:14:46.250166+0000","last_active":"2023-07-07T18:14:50.695700+0000","last_peered":"2023-07-07T18:14:50.695700+0000","last_clean":"2023-07-07T18:14:50.695700+0000","last_became_active":"2023-07-07T18:14:46.249865+0000","last_became_peered":"2023-07-07T18:14:46.249865+0000","last_unstale":"2023-07-07T18:14:50.695700+0000","last_undegraded":"2023-07-07T18:14:50.695700+0000","last_fullsized":"2023-07-07T18:14:50.695700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:03:21.014607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694727+0000","last_change":"2023-07-07T18:14:46.260407+0000","last_active":"2023-07-07T18:14:50.694727+0000","last_peered":"2023-07-07T18:14:50.694727+0000","last_clean":"2023-07-07T18:14:50.694727+0000","last_became_active":"2023-07-07T18:14:46.259937+0000","last_became_peered":"2023-07-07T18:14:46.259937+0000","last_unstale":"2023-07-07T18:14:50.694727+0000","last_undegraded":"2023-07-07T18:14:50.694727+0000","last_fullsized":"2023-07-07T18:14:50.694727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:56:49.808415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769064+0000","last_change":"2023-07-07T18:14:46.256893+0000","last_active":"2023-07-07T18:14:50.769064+0000","last_peered":"2023-07-07T18:14:50.769064+0000","last_clean":"2023-07-07T18:14:50.769064+0000","last_became_active":"2023-07-07T18:14:46.256622+0000","last_became_peered":"2023-07-07T18:14:46.256622+0000","last_unstale":"2023-07-07T18:14:50.769064+0000","last_undegraded":"2023-07-07T18:14:50.769064+0000","last_fullsized":"2023-07-07T18:14:50.769064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:35.628378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696247+0000","last_change":"2023-07-07T18:14:46.260376+0000","last_active":"2023-07-07T18:14:50.696247+0000","last_peered":"2023-07-07T18:14:50.696247+0000","last_clean":"2023-07-07T18:14:50.696247+0000","last_became_active":"2023-07-07T18:14:46.257010+0000","last_became_peered":"2023-07-07T18:14:46.257010+0000","last_unstale":"2023-07-07T18:14:50.696247+0000","last_undegraded":"2023-07-07T18:14:50.696247+0000","last_fullsized":"2023-07-07T18:14:50.696247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:39:01.079844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287639+0000","last_change":"2023-07-07T18:14:46.254186+0000","last_active":"2023-07-07T18:14:51.287639+0000","last_peered":"2023-07-07T18:14:51.287639+0000","last_clean":"2023-07-07T18:14:51.287639+0000","last_became_active":"2023-07-07T18:14:46.253897+0000","last_became_peered":"2023-07-07T18:14:46.253897+0000","last_unstale":"2023-07-07T18:14:51.287639+0000","last_undegraded":"2023-07-07T18:14:51.287639+0000","last_fullsized":"2023-07-07T18:14:51.287639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:47:31.616916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695873+0000","last_change":"2023-07-07T18:14:46.260027+0000","last_active":"2023-07-07T18:14:50.695873+0000","last_peered":"2023-07-07T18:14:50.695873+0000","last_clean":"2023-07-07T18:14:50.695873+0000","last_became_active":"2023-07-07T18:14:46.259740+0000","last_became_peered":"2023-07-07T18:14:46.259740+0000","last_unstale":"2023-07-07T18:14:50.695873+0000","last_undegraded":"2023-07-07T18:14:50.695873+0000","last_fullsized":"2023-07-07T18:14:50.695873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:11:34.268952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695458+0000","last_change":"2023-07-07T18:14:46.258673+0000","last_active":"2023-07-07T18:14:50.695458+0000","last_peered":"2023-07-07T18:14:50.695458+0000","last_clean":"2023-07-07T18:14:50.695458+0000","last_became_active":"2023-07-07T18:14:46.258410+0000","last_became_peered":"2023-07-07T18:14:46.258410+0000","last_unstale":"2023-07-07T18:14:50.695458+0000","last_undegraded":"2023-07-07T18:14:50.695458+0000","last_fullsized":"2023-07-07T18:14:50.695458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:36.856794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768546+0000","last_change":"2023-07-07T18:14:46.250342+0000","last_active":"2023-07-07T18:14:50.768546+0000","last_peered":"2023-07-07T18:14:50.768546+0000","last_clean":"2023-07-07T18:14:50.768546+0000","last_became_active":"2023-07-07T18:14:46.250051+0000","last_became_peered":"2023-07-07T18:14:46.250051+0000","last_unstale":"2023-07-07T18:14:50.768546+0000","last_undegraded":"2023-07-07T18:14:50.768546+0000","last_fullsized":"2023-07-07T18:14:50.768546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:05.786354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286813+0000","last_change":"2023-07-07T18:14:46.255595+0000","last_active":"2023-07-07T18:14:51.286813+0000","last_peered":"2023-07-07T18:14:51.286813+0000","last_clean":"2023-07-07T18:14:51.286813+0000","last_became_active":"2023-07-07T18:14:46.255308+0000","last_became_peered":"2023-07-07T18:14:46.255308+0000","last_unstale":"2023-07-07T18:14:51.286813+0000","last_undegraded":"2023-07-07T18:14:51.286813+0000","last_fullsized":"2023-07-07T18:14:51.286813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:22.768246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695160+0000","last_change":"2023-07-07T18:14:46.259159+0000","last_active":"2023-07-07T18:14:50.695160+0000","last_peered":"2023-07-07T18:14:50.695160+0000","last_clean":"2023-07-07T18:14:50.695160+0000","last_became_active":"2023-07-07T18:14:46.258888+0000","last_became_peered":"2023-07-07T18:14:46.258888+0000","last_unstale":"2023-07-07T18:14:50.695160+0000","last_undegraded":"2023-07-07T18:14:50.695160+0000","last_fullsized":"2023-07-07T18:14:50.695160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:04:20.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693827+0000","last_change":"2023-07-07T18:14:46.251261+0000","last_active":"2023-07-07T18:14:50.693827+0000","last_peered":"2023-07-07T18:14:50.693827+0000","last_clean":"2023-07-07T18:14:50.693827+0000","last_became_active":"2023-07-07T18:14:46.250985+0000","last_became_peered":"2023-07-07T18:14:46.250985+0000","last_unstale":"2023-07-07T18:14:50.693827+0000","last_undegraded":"2023-07-07T18:14:50.693827+0000","last_fullsized":"2023-07-07T18:14:50.693827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:27.744408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693850+0000","last_change":"2023-07-07T18:14:46.238108+0000","last_active":"2023-07-07T18:14:50.693850+0000","last_peered":"2023-07-07T18:14:50.693850+0000","last_clean":"2023-07-07T18:14:50.693850+0000","last_became_active":"2023-07-07T18:14:46.237731+0000","last_became_peered":"2023-07-07T18:14:46.237731+0000","last_unstale":"2023-07-07T18:14:50.693850+0000","last_undegraded":"2023-07-07T18:14:50.693850+0000","last_fullsized":"2023-07-07T18:14:50.693850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:56.152988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786655+0000","last_change":"2023-07-07T18:14:46.252496+0000","last_active":"2023-07-07T18:14:50.786655+0000","last_peered":"2023-07-07T18:14:50.786655+0000","last_clean":"2023-07-07T18:14:50.786655+0000","last_became_active":"2023-07-07T18:14:46.251903+0000","last_became_peered":"2023-07-07T18:14:46.251903+0000","last_unstale":"2023-07-07T18:14:50.786655+0000","last_undegraded":"2023-07-07T18:14:50.786655+0000","last_fullsized":"2023-07-07T18:14:50.786655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:50:58.513809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696161+0000","last_change":"2023-07-07T18:14:50.275663+0000","last_active":"2023-07-07T18:14:50.696161+0000","last_peered":"2023-07-07T18:14:50.696161+0000","last_clean":"2023-07-07T18:14:50.696161+0000","last_became_active":"2023-07-07T18:14:50.274814+0000","last_became_peered":"2023-07-07T18:14:50.274814+0000","last_unstale":"2023-07-07T18:14:50.696161+0000","last_undegraded":"2023-07-07T18:14:50.696161+0000","last_fullsized":"2023-07-07T18:14:50.696161+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:57:09.270949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695701+0000","last_change":"2023-07-07T18:14:45.827301+0000","last_active":"2023-07-07T18:14:50.695701+0000","last_peered":"2023-07-07T18:14:50.695701+0000","last_clean":"2023-07-07T18:14:50.695701+0000","last_became_active":"2023-07-07T18:14:45.827011+0000","last_became_peered":"2023-07-07T18:14:45.827011+0000","last_unstale":"2023-07-07T18:14:50.695701+0000","last_undegraded":"2023-07-07T18:14:50.695701+0000","last_fullsized":"2023-07-07T18:14:50.695701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:39:36.675751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288069+0000","last_change":"2023-07-07T18:14:46.238475+0000","last_active":"2023-07-07T18:14:51.288069+0000","last_peered":"2023-07-07T18:14:51.288069+0000","last_clean":"2023-07-07T18:14:51.288069+0000","last_became_active":"2023-07-07T18:14:46.238195+0000","last_became_peered":"2023-07-07T18:14:46.238195+0000","last_unstale":"2023-07-07T18:14:51.288069+0000","last_undegraded":"2023-07-07T18:14:51.288069+0000","last_fullsized":"2023-07-07T18:14:51.288069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:25:55.917107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287704+0000","last_change":"2023-07-07T18:14:50.280065+0000","last_active":"2023-07-07T18:14:51.287704+0000","last_peered":"2023-07-07T18:14:51.287704+0000","last_clean":"2023-07-07T18:14:51.287704+0000","last_became_active":"2023-07-07T18:14:50.279693+0000","last_became_peered":"2023-07-07T18:14:50.279693+0000","last_unstale":"2023-07-07T18:14:51.287704+0000","last_undegraded":"2023-07-07T18:14:51.287704+0000","last_fullsized":"2023-07-07T18:14:51.287704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:50:58.472479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693103+0000","last_change":"2023-07-07T18:14:45.823969+0000","last_active":"2023-07-07T18:14:50.693103+0000","last_peered":"2023-07-07T18:14:50.693103+0000","last_clean":"2023-07-07T18:14:50.693103+0000","last_became_active":"2023-07-07T18:14:45.823633+0000","last_became_peered":"2023-07-07T18:14:45.823633+0000","last_unstale":"2023-07-07T18:14:50.693103+0000","last_undegraded":"2023-07-07T18:14:50.693103+0000","last_fullsized":"2023-07-07T18:14:50.693103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:33:57.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769007+0000","last_change":"2023-07-07T18:14:46.252472+0000","last_active":"2023-07-07T18:14:50.769007+0000","last_peered":"2023-07-07T18:14:50.769007+0000","last_clean":"2023-07-07T18:14:50.769007+0000","last_became_active":"2023-07-07T18:14:46.251913+0000","last_became_peered":"2023-07-07T18:14:46.251913+0000","last_unstale":"2023-07-07T18:14:50.769007+0000","last_undegraded":"2023-07-07T18:14:50.769007+0000","last_fullsized":"2023-07-07T18:14:50.769007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:35.950124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769225+0000","last_change":"2023-07-07T18:14:50.279703+0000","last_active":"2023-07-07T18:14:50.769225+0000","last_peered":"2023-07-07T18:14:50.769225+0000","last_clean":"2023-07-07T18:14:50.769225+0000","last_became_active":"2023-07-07T18:14:50.278724+0000","last_became_peered":"2023-07-07T18:14:50.278724+0000","last_unstale":"2023-07-07T18:14:50.769225+0000","last_undegraded":"2023-07-07T18:14:50.769225+0000","last_fullsized":"2023-07-07T18:14:50.769225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:49:51.568617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287384+0000","last_change":"2023-07-07T18:14:45.825144+0000","last_active":"2023-07-07T18:14:51.287384+0000","last_peered":"2023-07-07T18:14:51.287384+0000","last_clean":"2023-07-07T18:14:51.287384+0000","last_became_active":"2023-07-07T18:14:45.824734+0000","last_became_peered":"2023-07-07T18:14:45.824734+0000","last_unstale":"2023-07-07T18:14:51.287384+0000","last_undegraded":"2023-07-07T18:14:51.287384+0000","last_fullsized":"2023-07-07T18:14:51.287384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:05:04.291822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287718+0000","last_change":"2023-07-07T18:14:46.250855+0000","last_active":"2023-07-07T18:14:51.287718+0000","last_peered":"2023-07-07T18:14:51.287718+0000","last_clean":"2023-07-07T18:14:51.287718+0000","last_became_active":"2023-07-07T18:14:46.250523+0000","last_became_peered":"2023-07-07T18:14:46.250523+0000","last_unstale":"2023-07-07T18:14:51.287718+0000","last_undegraded":"2023-07-07T18:14:51.287718+0000","last_fullsized":"2023-07-07T18:14:51.287718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:13:53.124487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287116+0000","last_change":"2023-07-07T18:14:50.284048+0000","last_active":"2023-07-07T18:14:51.287116+0000","last_peered":"2023-07-07T18:14:51.287116+0000","last_clean":"2023-07-07T18:14:51.287116+0000","last_became_active":"2023-07-07T18:14:50.283525+0000","last_became_peered":"2023-07-07T18:14:50.283525+0000","last_unstale":"2023-07-07T18:14:51.287116+0000","last_undegraded":"2023-07-07T18:14:51.287116+0000","last_fullsized":"2023-07-07T18:14:51.287116+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:56:26.834793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769206+0000","last_change":"2023-07-07T18:14:45.820272+0000","last_active":"2023-07-07T18:14:50.769206+0000","last_peered":"2023-07-07T18:14:50.769206+0000","last_clean":"2023-07-07T18:14:50.769206+0000","last_became_active":"2023-07-07T18:14:45.819791+0000","last_became_peered":"2023-07-07T18:14:45.819791+0000","last_unstale":"2023-07-07T18:14:50.769206+0000","last_undegraded":"2023-07-07T18:14:50.769206+0000","last_fullsized":"2023-07-07T18:14:50.769206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:25:18.468002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287255+0000","last_change":"2023-07-07T18:14:46.237273+0000","last_active":"2023-07-07T18:14:51.287255+0000","last_peered":"2023-07-07T18:14:51.287255+0000","last_clean":"2023-07-07T18:14:51.287255+0000","last_became_active":"2023-07-07T18:14:46.236974+0000","last_became_peered":"2023-07-07T18:14:46.236974+0000","last_unstale":"2023-07-07T18:14:51.287255+0000","last_undegraded":"2023-07-07T18:14:51.287255+0000","last_fullsized":"2023-07-07T18:14:51.287255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:54:31.016985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694188+0000","last_change":"2023-07-07T18:14:50.273820+0000","last_active":"2023-07-07T18:14:50.694188+0000","last_peered":"2023-07-07T18:14:50.694188+0000","last_clean":"2023-07-07T18:14:50.694188+0000","last_became_active":"2023-07-07T18:14:50.273435+0000","last_became_peered":"2023-07-07T18:14:50.273435+0000","last_unstale":"2023-07-07T18:14:50.694188+0000","last_undegraded":"2023-07-07T18:14:50.694188+0000","last_fullsized":"2023-07-07T18:14:50.694188+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:24.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786841+0000","last_change":"2023-07-07T18:14:45.825130+0000","last_active":"2023-07-07T18:14:50.786841+0000","last_peered":"2023-07-07T18:14:50.786841+0000","last_clean":"2023-07-07T18:14:50.786841+0000","last_became_active":"2023-07-07T18:14:45.824837+0000","last_became_peered":"2023-07-07T18:14:45.824837+0000","last_unstale":"2023-07-07T18:14:50.786841+0000","last_undegraded":"2023-07-07T18:14:50.786841+0000","last_fullsized":"2023-07-07T18:14:50.786841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:14:32.249281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286957+0000","last_change":"2023-07-07T18:14:46.251224+0000","last_active":"2023-07-07T18:14:51.286957+0000","last_peered":"2023-07-07T18:14:51.286957+0000","last_clean":"2023-07-07T18:14:51.286957+0000","last_became_active":"2023-07-07T18:14:46.250930+0000","last_became_peered":"2023-07-07T18:14:46.250930+0000","last_unstale":"2023-07-07T18:14:51.286957+0000","last_undegraded":"2023-07-07T18:14:51.286957+0000","last_fullsized":"2023-07-07T18:14:51.286957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:04:20.168978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287030+0000","last_change":"2023-07-07T18:14:50.279519+0000","last_active":"2023-07-07T18:14:51.287030+0000","last_peered":"2023-07-07T18:14:51.287030+0000","last_clean":"2023-07-07T18:14:51.287030+0000","last_became_active":"2023-07-07T18:14:50.279123+0000","last_became_peered":"2023-07-07T18:14:50.279123+0000","last_unstale":"2023-07-07T18:14:51.287030+0000","last_undegraded":"2023-07-07T18:14:51.287030+0000","last_fullsized":"2023-07-07T18:14:51.287030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:06:52.179086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695194+0000","last_change":"2023-07-07T18:14:45.826154+0000","last_active":"2023-07-07T18:14:50.695194+0000","last_peered":"2023-07-07T18:14:50.695194+0000","last_clean":"2023-07-07T18:14:50.695194+0000","last_became_active":"2023-07-07T18:14:45.825811+0000","last_became_peered":"2023-07-07T18:14:45.825811+0000","last_unstale":"2023-07-07T18:14:50.695194+0000","last_undegraded":"2023-07-07T18:14:50.695194+0000","last_fullsized":"2023-07-07T18:14:50.695194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:06:47.726217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693492+0000","last_change":"2023-07-07T18:14:46.253842+0000","last_active":"2023-07-07T18:14:50.693492+0000","last_peered":"2023-07-07T18:14:50.693492+0000","last_clean":"2023-07-07T18:14:50.693492+0000","last_became_active":"2023-07-07T18:14:46.253610+0000","last_became_peered":"2023-07-07T18:14:46.253610+0000","last_unstale":"2023-07-07T18:14:50.693492+0000","last_undegraded":"2023-07-07T18:14:50.693492+0000","last_fullsized":"2023-07-07T18:14:50.693492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:46:48.904277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693169+0000","last_change":"2023-07-07T18:14:50.279382+0000","last_active":"2023-07-07T18:14:50.693169+0000","last_peered":"2023-07-07T18:14:50.693169+0000","last_clean":"2023-07-07T18:14:50.693169+0000","last_became_active":"2023-07-07T18:14:50.278873+0000","last_became_peered":"2023-07-07T18:14:50.278873+0000","last_unstale":"2023-07-07T18:14:50.693169+0000","last_undegraded":"2023-07-07T18:14:50.693169+0000","last_fullsized":"2023-07-07T18:14:50.693169+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:02:54.121461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:55.778055+0000","last_change":"2023-07-07T18:14:45.823952+0000","last_active":"2023-07-07T18:14:55.778055+0000","last_peered":"2023-07-07T18:14:55.778055+0000","last_clean":"2023-07-07T18:14:55.778055+0000","last_became_active":"2023-07-07T18:14:45.823624+0000","last_became_peered":"2023-07-07T18:14:45.823624+0000","last_unstale":"2023-07-07T18:14:55.778055+0000","last_undegraded":"2023-07-07T18:14:55.778055+0000","last_fullsized":"2023-07-07T18:14:55.778055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:40:13.757713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695689+0000","last_change":"2023-07-07T18:14:46.253886+0000","last_active":"2023-07-07T18:14:50.695689+0000","last_peered":"2023-07-07T18:14:50.695689+0000","last_clean":"2023-07-07T18:14:50.695689+0000","last_became_active":"2023-07-07T18:14:46.253553+0000","last_became_peered":"2023-07-07T18:14:46.253553+0000","last_unstale":"2023-07-07T18:14:50.695689+0000","last_undegraded":"2023-07-07T18:14:50.695689+0000","last_fullsized":"2023-07-07T18:14:50.695689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:50:15.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786900+0000","last_change":"2023-07-07T18:14:50.281424+0000","last_active":"2023-07-07T18:14:50.786900+0000","last_peered":"2023-07-07T18:14:50.786900+0000","last_clean":"2023-07-07T18:14:50.786900+0000","last_became_active":"2023-07-07T18:14:50.281010+0000","last_became_peered":"2023-07-07T18:14:50.281010+0000","last_unstale":"2023-07-07T18:14:50.786900+0000","last_undegraded":"2023-07-07T18:14:50.786900+0000","last_fullsized":"2023-07-07T18:14:50.786900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:25:33.168587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695467+0000","last_change":"2023-07-07T18:14:45.830163+0000","last_active":"2023-07-07T18:14:50.695467+0000","last_peered":"2023-07-07T18:14:50.695467+0000","last_clean":"2023-07-07T18:14:50.695467+0000","last_became_active":"2023-07-07T18:14:45.829928+0000","last_became_peered":"2023-07-07T18:14:45.829928+0000","last_unstale":"2023-07-07T18:14:50.695467+0000","last_undegraded":"2023-07-07T18:14:50.695467+0000","last_fullsized":"2023-07-07T18:14:50.695467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:23:48.677042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287433+0000","last_change":"2023-07-07T18:14:46.238712+0000","last_active":"2023-07-07T18:14:51.287433+0000","last_peered":"2023-07-07T18:14:51.287433+0000","last_clean":"2023-07-07T18:14:51.287433+0000","last_became_active":"2023-07-07T18:14:46.238414+0000","last_became_peered":"2023-07-07T18:14:46.238414+0000","last_unstale":"2023-07-07T18:14:51.287433+0000","last_undegraded":"2023-07-07T18:14:51.287433+0000","last_fullsized":"2023-07-07T18:14:51.287433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:01:57.247568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287657+0000","last_change":"2023-07-07T18:14:50.283995+0000","last_active":"2023-07-07T18:14:51.287657+0000","last_peered":"2023-07-07T18:14:51.287657+0000","last_clean":"2023-07-07T18:14:51.287657+0000","last_became_active":"2023-07-07T18:14:50.280787+0000","last_became_peered":"2023-07-07T18:14:50.280787+0000","last_unstale":"2023-07-07T18:14:51.287657+0000","last_undegraded":"2023-07-07T18:14:51.287657+0000","last_fullsized":"2023-07-07T18:14:51.287657+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:40.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768416+0000","last_change":"2023-07-07T18:14:45.818817+0000","last_active":"2023-07-07T18:14:50.768416+0000","last_peered":"2023-07-07T18:14:50.768416+0000","last_clean":"2023-07-07T18:14:50.768416+0000","last_became_active":"2023-07-07T18:14:45.817217+0000","last_became_peered":"2023-07-07T18:14:45.817217+0000","last_unstale":"2023-07-07T18:14:50.768416+0000","last_undegraded":"2023-07-07T18:14:50.768416+0000","last_fullsized":"2023-07-07T18:14:50.768416+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:35.237658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786635+0000","last_change":"2023-07-07T18:14:46.252322+0000","last_active":"2023-07-07T18:14:50.786635+0000","last_peered":"2023-07-07T18:14:50.786635+0000","last_clean":"2023-07-07T18:14:50.786635+0000","last_became_active":"2023-07-07T18:14:46.251581+0000","last_became_peered":"2023-07-07T18:14:46.251581+0000","last_unstale":"2023-07-07T18:14:50.786635+0000","last_undegraded":"2023-07-07T18:14:50.786635+0000","last_fullsized":"2023-07-07T18:14:50.786635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:25:19.477377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288314+0000","last_change":"2023-07-07T18:14:50.279662+0000","last_active":"2023-07-07T18:14:51.288314+0000","last_peered":"2023-07-07T18:14:51.288314+0000","last_clean":"2023-07-07T18:14:51.288314+0000","last_became_active":"2023-07-07T18:14:50.279182+0000","last_became_peered":"2023-07-07T18:14:50.279182+0000","last_unstale":"2023-07-07T18:14:51.288314+0000","last_undegraded":"2023-07-07T18:14:51.288314+0000","last_fullsized":"2023-07-07T18:14:51.288314+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:29.387286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695766+0000","last_change":"2023-07-07T18:14:45.828779+0000","last_active":"2023-07-07T18:14:50.695766+0000","last_peered":"2023-07-07T18:14:50.695766+0000","last_clean":"2023-07-07T18:14:50.695766+0000","last_became_active":"2023-07-07T18:14:45.828387+0000","last_became_peered":"2023-07-07T18:14:45.828387+0000","last_unstale":"2023-07-07T18:14:50.695766+0000","last_undegraded":"2023-07-07T18:14:50.695766+0000","last_fullsized":"2023-07-07T18:14:50.695766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:25:54.907733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769086+0000","last_change":"2023-07-07T18:14:46.258991+0000","last_active":"2023-07-07T18:14:50.769086+0000","last_peered":"2023-07-07T18:14:50.769086+0000","last_clean":"2023-07-07T18:14:50.769086+0000","last_became_active":"2023-07-07T18:14:46.258711+0000","last_became_peered":"2023-07-07T18:14:46.258711+0000","last_unstale":"2023-07-07T18:14:50.769086+0000","last_undegraded":"2023-07-07T18:14:50.769086+0000","last_fullsized":"2023-07-07T18:14:50.769086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:10.136646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786752+0000","last_change":"2023-07-07T18:14:50.275066+0000","last_active":"2023-07-07T18:14:50.786752+0000","last_peered":"2023-07-07T18:14:50.786752+0000","last_clean":"2023-07-07T18:14:50.786752+0000","last_became_active":"2023-07-07T18:14:50.274631+0000","last_became_peered":"2023-07-07T18:14:50.274631+0000","last_unstale":"2023-07-07T18:14:50.786752+0000","last_undegraded":"2023-07-07T18:14:50.786752+0000","last_fullsized":"2023-07-07T18:14:50.786752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:26:07.680601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287040+0000","last_change":"2023-07-07T18:14:45.819945+0000","last_active":"2023-07-07T18:14:51.287040+0000","last_peered":"2023-07-07T18:14:51.287040+0000","last_clean":"2023-07-07T18:14:51.287040+0000","last_became_active":"2023-07-07T18:14:45.819662+0000","last_became_peered":"2023-07-07T18:14:45.819662+0000","last_unstale":"2023-07-07T18:14:51.287040+0000","last_undegraded":"2023-07-07T18:14:51.287040+0000","last_fullsized":"2023-07-07T18:14:51.287040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:05:21.194016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288364+0000","last_change":"2023-07-07T18:14:46.253586+0000","last_active":"2023-07-07T18:14:51.288364+0000","last_peered":"2023-07-07T18:14:51.288364+0000","last_clean":"2023-07-07T18:14:51.288364+0000","last_became_active":"2023-07-07T18:14:46.250668+0000","last_became_peered":"2023-07-07T18:14:46.250668+0000","last_unstale":"2023-07-07T18:14:51.288364+0000","last_undegraded":"2023-07-07T18:14:51.288364+0000","last_fullsized":"2023-07-07T18:14:51.288364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:18:50.791186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695970+0000","last_change":"2023-07-07T18:14:50.278682+0000","last_active":"2023-07-07T18:14:50.695970+0000","last_peered":"2023-07-07T18:14:50.695970+0000","last_clean":"2023-07-07T18:14:50.695970+0000","last_became_active":"2023-07-07T18:14:50.278199+0000","last_became_peered":"2023-07-07T18:14:50.278199+0000","last_unstale":"2023-07-07T18:14:50.695970+0000","last_undegraded":"2023-07-07T18:14:50.695970+0000","last_fullsized":"2023-07-07T18:14:50.695970+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:29.387286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695323+0000","last_change":"2023-07-07T18:14:45.828517+0000","last_active":"2023-07-07T18:14:50.695323+0000","last_peered":"2023-07-07T18:14:50.695323+0000","last_clean":"2023-07-07T18:14:50.695323+0000","last_became_active":"2023-07-07T18:14:45.828221+0000","last_became_peered":"2023-07-07T18:14:45.828221+0000","last_unstale":"2023-07-07T18:14:50.695323+0000","last_undegraded":"2023-07-07T18:14:50.695323+0000","last_fullsized":"2023-07-07T18:14:50.695323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:55.691985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786013+0000","last_change":"2023-07-07T18:14:46.243955+0000","last_active":"2023-07-07T18:14:50.786013+0000","last_peered":"2023-07-07T18:14:50.786013+0000","last_clean":"2023-07-07T18:14:50.786013+0000","last_became_active":"2023-07-07T18:14:46.243697+0000","last_became_peered":"2023-07-07T18:14:46.243697+0000","last_unstale":"2023-07-07T18:14:50.786013+0000","last_undegraded":"2023-07-07T18:14:50.786013+0000","last_fullsized":"2023-07-07T18:14:50.786013+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286669+0000","last_change":"2023-07-07T18:14:50.283314+0000","last_active":"2023-07-07T18:14:51.286669+0000","last_peered":"2023-07-07T18:14:51.286669+0000","last_clean":"2023-07-07T18:14:51.286669+0000","last_became_active":"2023-07-07T18:14:50.282741+0000","last_became_peered":"2023-07-07T18:14:50.282741+0000","last_unstale":"2023-07-07T18:14:51.286669+0000","last_undegraded":"2023-07-07T18:14:51.286669+0000","last_fullsized":"2023-07-07T18:14:51.286669+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:24:24.468449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695371+0000","last_change":"2023-07-07T18:14:45.828552+0000","last_active":"2023-07-07T18:14:50.695371+0000","last_peered":"2023-07-07T18:14:50.695371+0000","last_clean":"2023-07-07T18:14:50.695371+0000","last_became_active":"2023-07-07T18:14:45.828251+0000","last_became_peered":"2023-07-07T18:14:45.828251+0000","last_unstale":"2023-07-07T18:14:50.695371+0000","last_undegraded":"2023-07-07T18:14:50.695371+0000","last_fullsized":"2023-07-07T18:14:50.695371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:05:04.291822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694453+0000","last_change":"2023-07-07T18:14:46.254474+0000","last_active":"2023-07-07T18:14:50.694453+0000","last_peered":"2023-07-07T18:14:50.694453+0000","last_clean":"2023-07-07T18:14:50.694453+0000","last_became_active":"2023-07-07T18:14:46.253792+0000","last_became_peered":"2023-07-07T18:14:46.253792+0000","last_unstale":"2023-07-07T18:14:50.694453+0000","last_undegraded":"2023-07-07T18:14:50.694453+0000","last_fullsized":"2023-07-07T18:14:50.694453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:32:22.705610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287527+0000","last_change":"2023-07-07T18:14:50.275935+0000","last_active":"2023-07-07T18:14:51.287527+0000","last_peered":"2023-07-07T18:14:51.287527+0000","last_clean":"2023-07-07T18:14:51.287527+0000","last_became_active":"2023-07-07T18:14:50.275504+0000","last_became_peered":"2023-07-07T18:14:50.275504+0000","last_unstale":"2023-07-07T18:14:51.287527+0000","last_undegraded":"2023-07-07T18:14:51.287527+0000","last_fullsized":"2023-07-07T18:14:51.287527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:46:53.498090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695560+0000","last_change":"2023-07-07T18:14:45.824161+0000","last_active":"2023-07-07T18:14:50.695560+0000","last_peered":"2023-07-07T18:14:50.695560+0000","last_clean":"2023-07-07T18:14:50.695560+0000","last_became_active":"2023-07-07T18:14:45.823845+0000","last_became_peered":"2023-07-07T18:14:45.823845+0000","last_unstale":"2023-07-07T18:14:50.695560+0000","last_undegraded":"2023-07-07T18:14:50.695560+0000","last_fullsized":"2023-07-07T18:14:50.695560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:01:56.238194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287041+0000","last_change":"2023-07-07T18:14:46.251483+0000","last_active":"2023-07-07T18:14:51.287041+0000","last_peered":"2023-07-07T18:14:51.287041+0000","last_clean":"2023-07-07T18:14:51.287041+0000","last_became_active":"2023-07-07T18:14:46.251186+0000","last_became_peered":"2023-07-07T18:14:46.251186+0000","last_unstale":"2023-07-07T18:14:51.287041+0000","last_undegraded":"2023-07-07T18:14:51.287041+0000","last_fullsized":"2023-07-07T18:14:51.287041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:49:31.365534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287561+0000","last_change":"2023-07-07T18:14:50.284553+0000","last_active":"2023-07-07T18:14:51.287561+0000","last_peered":"2023-07-07T18:14:51.287561+0000","last_clean":"2023-07-07T18:14:51.287561+0000","last_became_active":"2023-07-07T18:14:50.284133+0000","last_became_peered":"2023-07-07T18:14:50.284133+0000","last_unstale":"2023-07-07T18:14:51.287561+0000","last_undegraded":"2023-07-07T18:14:51.287561+0000","last_fullsized":"2023-07-07T18:14:51.287561+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:32:21.452429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786401+0000","last_change":"2023-07-07T18:14:45.825329+0000","last_active":"2023-07-07T18:14:50.786401+0000","last_peered":"2023-07-07T18:14:50.786401+0000","last_clean":"2023-07-07T18:14:50.786401+0000","last_became_active":"2023-07-07T18:14:45.824977+0000","last_became_peered":"2023-07-07T18:14:45.824977+0000","last_unstale":"2023-07-07T18:14:50.786401+0000","last_undegraded":"2023-07-07T18:14:50.786401+0000","last_fullsized":"2023-07-07T18:14:50.786401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:26.735034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769180+0000","last_change":"2023-07-07T18:14:46.253430+0000","last_active":"2023-07-07T18:14:50.769180+0000","last_peered":"2023-07-07T18:14:50.769180+0000","last_clean":"2023-07-07T18:14:50.769180+0000","last_became_active":"2023-07-07T18:14:46.252998+0000","last_became_peered":"2023-07-07T18:14:46.252998+0000","last_unstale":"2023-07-07T18:14:50.769180+0000","last_undegraded":"2023-07-07T18:14:50.769180+0000","last_fullsized":"2023-07-07T18:14:50.769180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:10:28.413855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287751+0000","last_change":"2023-07-07T18:14:50.281644+0000","last_active":"2023-07-07T18:14:51.287751+0000","last_peered":"2023-07-07T18:14:51.287751+0000","last_clean":"2023-07-07T18:14:51.287751+0000","last_became_active":"2023-07-07T18:14:50.281288+0000","last_became_peered":"2023-07-07T18:14:50.281288+0000","last_unstale":"2023-07-07T18:14:51.287751+0000","last_undegraded":"2023-07-07T18:14:51.287751+0000","last_fullsized":"2023-07-07T18:14:51.287751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:05:38.716449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286765+0000","last_change":"2023-07-07T18:14:45.825137+0000","last_active":"2023-07-07T18:14:51.286765+0000","last_peered":"2023-07-07T18:14:51.286765+0000","last_clean":"2023-07-07T18:14:51.286765+0000","last_became_active":"2023-07-07T18:14:45.824813+0000","last_became_peered":"2023-07-07T18:14:45.824813+0000","last_unstale":"2023-07-07T18:14:51.286765+0000","last_undegraded":"2023-07-07T18:14:51.286765+0000","last_fullsized":"2023-07-07T18:14:51.286765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:39:11.889878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695709+0000","last_change":"2023-07-07T18:14:46.261872+0000","last_active":"2023-07-07T18:14:50.695709+0000","last_peered":"2023-07-07T18:14:50.695709+0000","last_clean":"2023-07-07T18:14:50.695709+0000","last_became_active":"2023-07-07T18:14:46.261503+0000","last_became_peered":"2023-07-07T18:14:46.261503+0000","last_unstale":"2023-07-07T18:14:50.695709+0000","last_undegraded":"2023-07-07T18:14:50.695709+0000","last_fullsized":"2023-07-07T18:14:50.695709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:28:13.350106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693444+0000","last_change":"2023-07-07T18:14:50.282090+0000","last_active":"2023-07-07T18:14:50.693444+0000","last_peered":"2023-07-07T18:14:50.693444+0000","last_clean":"2023-07-07T18:14:50.693444+0000","last_became_active":"2023-07-07T18:14:50.281530+0000","last_became_peered":"2023-07-07T18:14:50.281530+0000","last_unstale":"2023-07-07T18:14:50.693444+0000","last_undegraded":"2023-07-07T18:14:50.693444+0000","last_fullsized":"2023-07-07T18:14:50.693444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:37:39.690527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287090+0000","last_change":"2023-07-07T18:14:45.827877+0000","last_active":"2023-07-07T18:14:51.287090+0000","last_peered":"2023-07-07T18:14:51.287090+0000","last_clean":"2023-07-07T18:14:51.287090+0000","last_became_active":"2023-07-07T18:14:45.827533+0000","last_became_peered":"2023-07-07T18:14:45.827533+0000","last_unstale":"2023-07-07T18:14:51.287090+0000","last_undegraded":"2023-07-07T18:14:51.287090+0000","last_fullsized":"2023-07-07T18:14:51.287090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:32:52.527564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696156+0000","last_change":"2023-07-07T18:14:46.256950+0000","last_active":"2023-07-07T18:14:50.696156+0000","last_peered":"2023-07-07T18:14:50.696156+0000","last_clean":"2023-07-07T18:14:50.696156+0000","last_became_active":"2023-07-07T18:14:46.254597+0000","last_became_peered":"2023-07-07T18:14:46.254597+0000","last_unstale":"2023-07-07T18:14:50.696156+0000","last_undegraded":"2023-07-07T18:14:50.696156+0000","last_fullsized":"2023-07-07T18:14:50.696156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:51:19.489510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786947+0000","last_change":"2023-07-07T18:14:50.275061+0000","last_active":"2023-07-07T18:14:50.786947+0000","last_peered":"2023-07-07T18:14:50.786947+0000","last_clean":"2023-07-07T18:14:50.786947+0000","last_became_active":"2023-07-07T18:14:50.274636+0000","last_became_peered":"2023-07-07T18:14:50.274636+0000","last_unstale":"2023-07-07T18:14:50.786947+0000","last_undegraded":"2023-07-07T18:14:50.786947+0000","last_fullsized":"2023-07-07T18:14:50.786947+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:17:32.136223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694160+0000","last_change":"2023-07-07T18:14:45.816489+0000","last_active":"2023-07-07T18:14:50.694160+0000","last_peered":"2023-07-07T18:14:50.694160+0000","last_clean":"2023-07-07T18:14:50.694160+0000","last_became_active":"2023-07-07T18:14:45.816126+0000","last_became_peered":"2023-07-07T18:14:45.816126+0000","last_unstale":"2023-07-07T18:14:50.694160+0000","last_undegraded":"2023-07-07T18:14:50.694160+0000","last_fullsized":"2023-07-07T18:14:50.694160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:19:43.348276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696412+0000","last_change":"2023-07-07T18:14:46.260154+0000","last_active":"2023-07-07T18:14:50.696412+0000","last_peered":"2023-07-07T18:14:50.696412+0000","last_clean":"2023-07-07T18:14:50.696412+0000","last_became_active":"2023-07-07T18:14:46.254390+0000","last_became_peered":"2023-07-07T18:14:46.254390+0000","last_unstale":"2023-07-07T18:14:50.696412+0000","last_undegraded":"2023-07-07T18:14:50.696412+0000","last_fullsized":"2023-07-07T18:14:50.696412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:39:54.707650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.696102+0000","last_change":"2023-07-07T18:14:50.275972+0000","last_active":"2023-07-07T18:14:50.696102+0000","last_peered":"2023-07-07T18:14:50.696102+0000","last_clean":"2023-07-07T18:14:50.696102+0000","last_became_active":"2023-07-07T18:14:50.275539+0000","last_became_peered":"2023-07-07T18:14:50.275539+0000","last_unstale":"2023-07-07T18:14:50.696102+0000","last_undegraded":"2023-07-07T18:14:50.696102+0000","last_fullsized":"2023-07-07T18:14:50.696102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:48:45.018589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287119+0000","last_change":"2023-07-07T18:14:45.825399+0000","last_active":"2023-07-07T18:14:51.287119+0000","last_peered":"2023-07-07T18:14:51.287119+0000","last_clean":"2023-07-07T18:14:51.287119+0000","last_became_active":"2023-07-07T18:14:45.825119+0000","last_became_peered":"2023-07-07T18:14:45.825119+0000","last_unstale":"2023-07-07T18:14:51.287119+0000","last_undegraded":"2023-07-07T18:14:51.287119+0000","last_fullsized":"2023-07-07T18:14:51.287119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:58:05.705920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693893+0000","last_change":"2023-07-07T18:14:46.240829+0000","last_active":"2023-07-07T18:14:50.693893+0000","last_peered":"2023-07-07T18:14:50.693893+0000","last_clean":"2023-07-07T18:14:50.693893+0000","last_became_active":"2023-07-07T18:14:46.239938+0000","last_became_peered":"2023-07-07T18:14:46.239938+0000","last_unstale":"2023-07-07T18:14:50.693893+0000","last_undegraded":"2023-07-07T18:14:50.693893+0000","last_fullsized":"2023-07-07T18:14:50.693893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:35.628378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768716+0000","last_change":"2023-07-07T18:14:50.274346+0000","last_active":"2023-07-07T18:14:50.768716+0000","last_peered":"2023-07-07T18:14:50.768716+0000","last_clean":"2023-07-07T18:14:50.768716+0000","last_became_active":"2023-07-07T18:14:50.271130+0000","last_became_peered":"2023-07-07T18:14:50.271130+0000","last_unstale":"2023-07-07T18:14:50.768716+0000","last_undegraded":"2023-07-07T18:14:50.768716+0000","last_fullsized":"2023-07-07T18:14:50.768716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:46:52.347771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693665+0000","last_change":"2023-07-07T18:14:41.010006+0000","last_active":"2023-07-07T18:14:50.693665+0000","last_peered":"2023-07-07T18:14:50.693665+0000","last_clean":"2023-07-07T18:14:50.693665+0000","last_became_active":"2023-07-07T18:14:41.009625+0000","last_became_peered":"2023-07-07T18:14:41.009625+0000","last_unstale":"2023-07-07T18:14:50.693665+0000","last_undegraded":"2023-07-07T18:14:50.693665+0000","last_fullsized":"2023-07-07T18:14:50.693665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:11.821985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786501+0000","last_change":"2023-07-07T18:14:45.825558+0000","last_active":"2023-07-07T18:14:50.786501+0000","last_peered":"2023-07-07T18:14:50.786501+0000","last_clean":"2023-07-07T18:14:50.786501+0000","last_became_active":"2023-07-07T18:14:45.824990+0000","last_became_peered":"2023-07-07T18:14:45.824990+0000","last_unstale":"2023-07-07T18:14:50.786501+0000","last_undegraded":"2023-07-07T18:14:50.786501+0000","last_fullsized":"2023-07-07T18:14:50.786501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:49:47.115748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693078+0000","last_change":"2023-07-07T18:14:46.236943+0000","last_active":"2023-07-07T18:14:50.693078+0000","last_peered":"2023-07-07T18:14:50.693078+0000","last_clean":"2023-07-07T18:14:50.693078+0000","last_became_active":"2023-07-07T18:14:46.236679+0000","last_became_peered":"2023-07-07T18:14:46.236679+0000","last_unstale":"2023-07-07T18:14:50.693078+0000","last_undegraded":"2023-07-07T18:14:50.693078+0000","last_fullsized":"2023-07-07T18:14:50.693078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:32:08.214196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768915+0000","last_change":"2023-07-07T18:14:50.274560+0000","last_active":"2023-07-07T18:14:50.768915+0000","last_peered":"2023-07-07T18:14:50.768915+0000","last_clean":"2023-07-07T18:14:50.768915+0000","last_became_active":"2023-07-07T18:14:50.273900+0000","last_became_peered":"2023-07-07T18:14:50.273900+0000","last_unstale":"2023-07-07T18:14:50.768915+0000","last_undegraded":"2023-07-07T18:14:50.768915+0000","last_fullsized":"2023-07-07T18:14:50.768915+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:06:21.422334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786290+0000","last_change":"2023-07-07T18:14:40.652460+0000","last_active":"2023-07-07T18:14:50.786290+0000","last_peered":"2023-07-07T18:14:50.786290+0000","last_clean":"2023-07-07T18:14:50.786290+0000","last_became_active":"2023-07-07T18:14:40.652046+0000","last_became_peered":"2023-07-07T18:14:40.652046+0000","last_unstale":"2023-07-07T18:14:50.786290+0000","last_undegraded":"2023-07-07T18:14:50.786290+0000","last_fullsized":"2023-07-07T18:14:50.786290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:29.793269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694562+0000","last_change":"2023-07-07T18:14:45.827286+0000","last_active":"2023-07-07T18:14:50.694562+0000","last_peered":"2023-07-07T18:14:50.694562+0000","last_clean":"2023-07-07T18:14:50.694562+0000","last_became_active":"2023-07-07T18:14:45.826913+0000","last_became_peered":"2023-07-07T18:14:45.826913+0000","last_unstale":"2023-07-07T18:14:50.694562+0000","last_undegraded":"2023-07-07T18:14:50.694562+0000","last_fullsized":"2023-07-07T18:14:50.694562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:36:09.401587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693546+0000","last_change":"2023-07-07T18:14:46.239120+0000","last_active":"2023-07-07T18:14:50.693546+0000","last_peered":"2023-07-07T18:14:50.693546+0000","last_clean":"2023-07-07T18:14:50.693546+0000","last_became_active":"2023-07-07T18:14:46.238876+0000","last_became_peered":"2023-07-07T18:14:46.238876+0000","last_unstale":"2023-07-07T18:14:50.693546+0000","last_undegraded":"2023-07-07T18:14:50.693546+0000","last_fullsized":"2023-07-07T18:14:50.693546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287928+0000","last_change":"2023-07-07T18:14:50.282994+0000","last_active":"2023-07-07T18:14:51.287928+0000","last_peered":"2023-07-07T18:14:51.287928+0000","last_clean":"2023-07-07T18:14:51.287928+0000","last_became_active":"2023-07-07T18:14:50.282569+0000","last_became_peered":"2023-07-07T18:14:50.282569+0000","last_unstale":"2023-07-07T18:14:51.287928+0000","last_undegraded":"2023-07-07T18:14:51.287928+0000","last_fullsized":"2023-07-07T18:14:51.287928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:00:27.527355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287831+0000","last_change":"2023-07-07T18:14:41.009938+0000","last_active":"2023-07-07T18:14:51.287831+0000","last_peered":"2023-07-07T18:14:51.287831+0000","last_clean":"2023-07-07T18:14:51.287831+0000","last_became_active":"2023-07-07T18:14:41.009637+0000","last_became_peered":"2023-07-07T18:14:41.009637+0000","last_unstale":"2023-07-07T18:14:51.287831+0000","last_undegraded":"2023-07-07T18:14:51.287831+0000","last_fullsized":"2023-07-07T18:14:51.287831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:47:01.369288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693129+0000","last_change":"2023-07-07T18:14:45.813731+0000","last_active":"2023-07-07T18:14:50.693129+0000","last_peered":"2023-07-07T18:14:50.693129+0000","last_clean":"2023-07-07T18:14:50.693129+0000","last_became_active":"2023-07-07T18:14:45.813444+0000","last_became_peered":"2023-07-07T18:14:45.813444+0000","last_unstale":"2023-07-07T18:14:50.693129+0000","last_undegraded":"2023-07-07T18:14:50.693129+0000","last_fullsized":"2023-07-07T18:14:50.693129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:04.776980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693755+0000","last_change":"2023-07-07T18:14:46.238296+0000","last_active":"2023-07-07T18:14:50.693755+0000","last_peered":"2023-07-07T18:14:50.693755+0000","last_clean":"2023-07-07T18:14:50.693755+0000","last_became_active":"2023-07-07T18:14:46.237650+0000","last_became_peered":"2023-07-07T18:14:46.237650+0000","last_unstale":"2023-07-07T18:14:50.693755+0000","last_undegraded":"2023-07-07T18:14:50.693755+0000","last_fullsized":"2023-07-07T18:14:50.693755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:20:35.950124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695160+0000","last_change":"2023-07-07T18:14:50.276840+0000","last_active":"2023-07-07T18:14:50.695160+0000","last_peered":"2023-07-07T18:14:50.695160+0000","last_clean":"2023-07-07T18:14:50.695160+0000","last_became_active":"2023-07-07T18:14:50.276444+0000","last_became_peered":"2023-07-07T18:14:50.276444+0000","last_unstale":"2023-07-07T18:14:50.695160+0000","last_undegraded":"2023-07-07T18:14:50.695160+0000","last_fullsized":"2023-07-07T18:14:50.695160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:26:07.867774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786425+0000","last_change":"2023-07-07T18:14:40.652887+0000","last_active":"2023-07-07T18:14:50.786425+0000","last_peered":"2023-07-07T18:14:50.786425+0000","last_clean":"2023-07-07T18:14:50.786425+0000","last_became_active":"2023-07-07T18:14:40.652550+0000","last_became_peered":"2023-07-07T18:14:40.652550+0000","last_unstale":"2023-07-07T18:14:50.786425+0000","last_undegraded":"2023-07-07T18:14:50.786425+0000","last_fullsized":"2023-07-07T18:14:50.786425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:18:29.471523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694978+0000","last_change":"2023-07-07T18:14:34.464008+0000","last_active":"2023-07-07T18:14:50.694978+0000","last_peered":"2023-07-07T18:14:50.694978+0000","last_clean":"2023-07-07T18:14:50.694978+0000","last_became_active":"2023-07-07T18:14:34.463018+0000","last_became_peered":"2023-07-07T18:14:34.463018+0000","last_unstale":"2023-07-07T18:14:50.694978+0000","last_undegraded":"2023-07-07T18:14:50.694978+0000","last_fullsized":"2023-07-07T18:14:50.694978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_clean_scrub_stamp":"2023-07-07T18:14:33.057285+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:10.029083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287082+0000","last_change":"2023-07-07T18:14:45.825928+0000","last_active":"2023-07-07T18:14:51.287082+0000","last_peered":"2023-07-07T18:14:51.287082+0000","last_clean":"2023-07-07T18:14:51.287082+0000","last_became_active":"2023-07-07T18:14:45.825599+0000","last_became_peered":"2023-07-07T18:14:45.825599+0000","last_unstale":"2023-07-07T18:14:51.287082+0000","last_undegraded":"2023-07-07T18:14:51.287082+0000","last_fullsized":"2023-07-07T18:14:51.287082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:04:44.156178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287267+0000","last_change":"2023-07-07T18:14:46.262476+0000","last_active":"2023-07-07T18:14:51.287267+0000","last_peered":"2023-07-07T18:14:51.287267+0000","last_clean":"2023-07-07T18:14:51.287267+0000","last_became_active":"2023-07-07T18:14:46.262165+0000","last_became_peered":"2023-07-07T18:14:46.262165+0000","last_unstale":"2023-07-07T18:14:51.287267+0000","last_undegraded":"2023-07-07T18:14:51.287267+0000","last_fullsized":"2023-07-07T18:14:51.287267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:21:36.267002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786724+0000","last_change":"2023-07-07T18:14:50.282211+0000","last_active":"2023-07-07T18:14:50.786724+0000","last_peered":"2023-07-07T18:14:50.786724+0000","last_clean":"2023-07-07T18:14:50.786724+0000","last_became_active":"2023-07-07T18:14:50.281448+0000","last_became_peered":"2023-07-07T18:14:50.281448+0000","last_unstale":"2023-07-07T18:14:50.786724+0000","last_undegraded":"2023-07-07T18:14:50.786724+0000","last_fullsized":"2023-07-07T18:14:50.786724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:17:53.884605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695381+0000","last_change":"2023-07-07T18:14:40.649525+0000","last_active":"2023-07-07T18:14:50.695381+0000","last_peered":"2023-07-07T18:14:50.695381+0000","last_clean":"2023-07-07T18:14:50.695381+0000","last_became_active":"2023-07-07T18:14:40.649168+0000","last_became_peered":"2023-07-07T18:14:40.649168+0000","last_unstale":"2023-07-07T18:14:50.695381+0000","last_undegraded":"2023-07-07T18:14:50.695381+0000","last_fullsized":"2023-07-07T18:14:50.695381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:04:39.008697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768373+0000","last_change":"2023-07-07T18:14:45.825496+0000","last_active":"2023-07-07T18:14:50.768373+0000","last_peered":"2023-07-07T18:14:50.768373+0000","last_clean":"2023-07-07T18:14:50.768373+0000","last_became_active":"2023-07-07T18:14:45.825173+0000","last_became_peered":"2023-07-07T18:14:45.825173+0000","last_unstale":"2023-07-07T18:14:50.768373+0000","last_undegraded":"2023-07-07T18:14:50.768373+0000","last_fullsized":"2023-07-07T18:14:50.768373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:32:07.204822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768857+0000","last_change":"2023-07-07T18:14:46.252633+0000","last_active":"2023-07-07T18:14:50.768857+0000","last_peered":"2023-07-07T18:14:50.768857+0000","last_clean":"2023-07-07T18:14:50.768857+0000","last_became_active":"2023-07-07T18:14:46.252199+0000","last_became_peered":"2023-07-07T18:14:46.252199+0000","last_unstale":"2023-07-07T18:14:50.768857+0000","last_undegraded":"2023-07-07T18:14:50.768857+0000","last_fullsized":"2023-07-07T18:14:50.768857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:44:26.717567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287489+0000","last_change":"2023-07-07T18:14:50.276895+0000","last_active":"2023-07-07T18:14:51.287489+0000","last_peered":"2023-07-07T18:14:51.287489+0000","last_clean":"2023-07-07T18:14:51.287489+0000","last_became_active":"2023-07-07T18:14:50.276507+0000","last_became_peered":"2023-07-07T18:14:50.276507+0000","last_unstale":"2023-07-07T18:14:51.287489+0000","last_undegraded":"2023-07-07T18:14:51.287489+0000","last_fullsized":"2023-07-07T18:14:51.287489+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:34:18.314525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695369+0000","last_change":"2023-07-07T18:14:41.009946+0000","last_active":"2023-07-07T18:14:50.695369+0000","last_peered":"2023-07-07T18:14:50.695369+0000","last_clean":"2023-07-07T18:14:50.695369+0000","last_became_active":"2023-07-07T18:14:41.009627+0000","last_became_peered":"2023-07-07T18:14:41.009627+0000","last_unstale":"2023-07-07T18:14:50.695369+0000","last_undegraded":"2023-07-07T18:14:50.695369+0000","last_fullsized":"2023-07-07T18:14:50.695369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:58:00.558439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693986+0000","last_change":"2023-07-07T18:14:45.814432+0000","last_active":"2023-07-07T18:14:50.693986+0000","last_peered":"2023-07-07T18:14:50.693986+0000","last_clean":"2023-07-07T18:14:50.693986+0000","last_became_active":"2023-07-07T18:14:45.814128+0000","last_became_peered":"2023-07-07T18:14:45.814128+0000","last_unstale":"2023-07-07T18:14:50.693986+0000","last_undegraded":"2023-07-07T18:14:50.693986+0000","last_fullsized":"2023-07-07T18:14:50.693986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:09.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769002+0000","last_change":"2023-07-07T18:14:46.253259+0000","last_active":"2023-07-07T18:14:50.769002+0000","last_peered":"2023-07-07T18:14:50.769002+0000","last_clean":"2023-07-07T18:14:50.769002+0000","last_became_active":"2023-07-07T18:14:46.252670+0000","last_became_peered":"2023-07-07T18:14:46.252670+0000","last_unstale":"2023-07-07T18:14:50.769002+0000","last_undegraded":"2023-07-07T18:14:50.769002+0000","last_fullsized":"2023-07-07T18:14:50.769002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:56.152988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695641+0000","last_change":"2023-07-07T18:14:50.279532+0000","last_active":"2023-07-07T18:14:50.695641+0000","last_peered":"2023-07-07T18:14:50.695641+0000","last_clean":"2023-07-07T18:14:50.695641+0000","last_became_active":"2023-07-07T18:14:50.279056+0000","last_became_peered":"2023-07-07T18:14:50.279056+0000","last_unstale":"2023-07-07T18:14:50.695641+0000","last_undegraded":"2023-07-07T18:14:50.695641+0000","last_fullsized":"2023-07-07T18:14:50.695641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:08:30.223728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288438+0000","last_change":"2023-07-07T18:14:45.825994+0000","last_active":"2023-07-07T18:14:51.288438+0000","last_peered":"2023-07-07T18:14:51.288438+0000","last_clean":"2023-07-07T18:14:51.288438+0000","last_became_active":"2023-07-07T18:14:45.825663+0000","last_became_peered":"2023-07-07T18:14:45.825663+0000","last_unstale":"2023-07-07T18:14:51.288438+0000","last_undegraded":"2023-07-07T18:14:51.288438+0000","last_fullsized":"2023-07-07T18:14:51.288438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:39:19.689182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693519+0000","last_change":"2023-07-07T18:14:40.651911+0000","last_active":"2023-07-07T18:14:50.693519+0000","last_peered":"2023-07-07T18:14:50.693519+0000","last_clean":"2023-07-07T18:14:50.693519+0000","last_became_active":"2023-07-07T18:14:40.651592+0000","last_became_peered":"2023-07-07T18:14:40.651592+0000","last_unstale":"2023-07-07T18:14:50.693519+0000","last_undegraded":"2023-07-07T18:14:50.693519+0000","last_fullsized":"2023-07-07T18:14:50.693519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:14:59.730163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286989+0000","last_change":"2023-07-07T18:14:46.251841+0000","last_active":"2023-07-07T18:14:51.286989+0000","last_peered":"2023-07-07T18:14:51.286989+0000","last_clean":"2023-07-07T18:14:51.286989+0000","last_became_active":"2023-07-07T18:14:46.251574+0000","last_became_peered":"2023-07-07T18:14:46.251574+0000","last_unstale":"2023-07-07T18:14:51.286989+0000","last_undegraded":"2023-07-07T18:14:51.286989+0000","last_fullsized":"2023-07-07T18:14:51.286989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:45:56.701359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286832+0000","last_change":"2023-07-07T18:14:50.280371+0000","last_active":"2023-07-07T18:14:51.286832+0000","last_peered":"2023-07-07T18:14:51.286832+0000","last_clean":"2023-07-07T18:14:51.286832+0000","last_became_active":"2023-07-07T18:14:50.279833+0000","last_became_peered":"2023-07-07T18:14:50.279833+0000","last_unstale":"2023-07-07T18:14:51.286832+0000","last_undegraded":"2023-07-07T18:14:51.286832+0000","last_fullsized":"2023-07-07T18:14:51.286832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:24.655938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287631+0000","last_change":"2023-07-07T18:14:40.653854+0000","last_active":"2023-07-07T18:14:51.287631+0000","last_peered":"2023-07-07T18:14:51.287631+0000","last_clean":"2023-07-07T18:14:51.287631+0000","last_became_active":"2023-07-07T18:14:40.653556+0000","last_became_peered":"2023-07-07T18:14:40.653556+0000","last_unstale":"2023-07-07T18:14:51.287631+0000","last_undegraded":"2023-07-07T18:14:51.287631+0000","last_fullsized":"2023-07-07T18:14:51.287631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:49:03.953888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:15:00.768001+0000","last_change":"2023-07-07T18:14:45.813532+0000","last_active":"2023-07-07T18:15:00.768001+0000","last_peered":"2023-07-07T18:15:00.768001+0000","last_clean":"2023-07-07T18:15:00.768001+0000","last_became_active":"2023-07-07T18:14:45.813237+0000","last_became_peered":"2023-07-07T18:14:45.813237+0000","last_unstale":"2023-07-07T18:15:00.768001+0000","last_undegraded":"2023-07-07T18:15:00.768001+0000","last_fullsized":"2023-07-07T18:15:00.768001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:29.191939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694299+0000","last_change":"2023-07-07T18:14:46.256921+0000","last_active":"2023-07-07T18:14:50.694299+0000","last_peered":"2023-07-07T18:14:50.694299+0000","last_clean":"2023-07-07T18:14:50.694299+0000","last_became_active":"2023-07-07T18:14:46.255057+0000","last_became_peered":"2023-07-07T18:14:46.255057+0000","last_unstale":"2023-07-07T18:14:50.694299+0000","last_undegraded":"2023-07-07T18:14:50.694299+0000","last_fullsized":"2023-07-07T18:14:50.694299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:01:33.602440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693740+0000","last_change":"2023-07-07T18:14:50.281352+0000","last_active":"2023-07-07T18:14:50.693740+0000","last_peered":"2023-07-07T18:14:50.693740+0000","last_clean":"2023-07-07T18:14:50.693740+0000","last_became_active":"2023-07-07T18:14:50.280740+0000","last_became_peered":"2023-07-07T18:14:50.280740+0000","last_unstale":"2023-07-07T18:14:50.693740+0000","last_undegraded":"2023-07-07T18:14:50.693740+0000","last_fullsized":"2023-07-07T18:14:50.693740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:49:33.644807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.768930+0000","last_change":"2023-07-07T18:14:45.828162+0000","last_active":"2023-07-07T18:14:50.768930+0000","last_peered":"2023-07-07T18:14:50.768930+0000","last_clean":"2023-07-07T18:14:50.768930+0000","last_became_active":"2023-07-07T18:14:45.827811+0000","last_became_peered":"2023-07-07T18:14:45.827811+0000","last_unstale":"2023-07-07T18:14:50.768930+0000","last_undegraded":"2023-07-07T18:14:50.768930+0000","last_fullsized":"2023-07-07T18:14:50.768930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:24.297526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287464+0000","last_change":"2023-07-07T18:14:46.246578+0000","last_active":"2023-07-07T18:14:51.287464+0000","last_peered":"2023-07-07T18:14:51.287464+0000","last_clean":"2023-07-07T18:14:51.287464+0000","last_became_active":"2023-07-07T18:14:46.246295+0000","last_became_peered":"2023-07-07T18:14:46.246295+0000","last_unstale":"2023-07-07T18:14:51.287464+0000","last_undegraded":"2023-07-07T18:14:51.287464+0000","last_fullsized":"2023-07-07T18:14:51.287464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:48:00.728010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695529+0000","last_change":"2023-07-07T18:14:50.272282+0000","last_active":"2023-07-07T18:14:50.695529+0000","last_peered":"2023-07-07T18:14:50.695529+0000","last_clean":"2023-07-07T18:14:50.695529+0000","last_became_active":"2023-07-07T18:14:50.271865+0000","last_became_peered":"2023-07-07T18:14:50.271865+0000","last_unstale":"2023-07-07T18:14:50.695529+0000","last_undegraded":"2023-07-07T18:14:50.695529+0000","last_fullsized":"2023-07-07T18:14:50.695529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:54:34.460479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786378+0000","last_change":"2023-07-07T18:14:45.827922+0000","last_active":"2023-07-07T18:14:50.786378+0000","last_peered":"2023-07-07T18:14:50.786378+0000","last_clean":"2023-07-07T18:14:50.786378+0000","last_became_active":"2023-07-07T18:14:45.827638+0000","last_became_peered":"2023-07-07T18:14:45.827638+0000","last_unstale":"2023-07-07T18:14:50.786378+0000","last_undegraded":"2023-07-07T18:14:50.786378+0000","last_fullsized":"2023-07-07T18:14:50.786378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:24.297526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694444+0000","last_change":"2023-07-07T18:14:46.261660+0000","last_active":"2023-07-07T18:14:50.694444+0000","last_peered":"2023-07-07T18:14:50.694444+0000","last_clean":"2023-07-07T18:14:50.694444+0000","last_became_active":"2023-07-07T18:14:46.260861+0000","last_became_peered":"2023-07-07T18:14:46.260861+0000","last_unstale":"2023-07-07T18:14:50.694444+0000","last_undegraded":"2023-07-07T18:14:50.694444+0000","last_fullsized":"2023-07-07T18:14:50.694444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:47:43.651762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786504+0000","last_change":"2023-07-07T18:14:50.281633+0000","last_active":"2023-07-07T18:14:50.786504+0000","last_peered":"2023-07-07T18:14:50.786504+0000","last_clean":"2023-07-07T18:14:50.786504+0000","last_became_active":"2023-07-07T18:14:50.280606+0000","last_became_peered":"2023-07-07T18:14:50.280606+0000","last_unstale":"2023-07-07T18:14:50.786504+0000","last_undegraded":"2023-07-07T18:14:50.786504+0000","last_fullsized":"2023-07-07T18:14:50.786504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:03:59.596483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.786476+0000","last_change":"2023-07-07T18:14:45.828754+0000","last_active":"2023-07-07T18:14:50.786476+0000","last_peered":"2023-07-07T18:14:50.786476+0000","last_clean":"2023-07-07T18:14:50.786476+0000","last_became_active":"2023-07-07T18:14:45.828425+0000","last_became_peered":"2023-07-07T18:14:45.828425+0000","last_unstale":"2023-07-07T18:14:50.786476+0000","last_undegraded":"2023-07-07T18:14:50.786476+0000","last_fullsized":"2023-07-07T18:14:50.786476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:05:09.127272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694287+0000","last_change":"2023-07-07T18:14:46.261672+0000","last_active":"2023-07-07T18:14:50.694287+0000","last_peered":"2023-07-07T18:14:50.694287+0000","last_clean":"2023-07-07T18:14:50.694287+0000","last_became_active":"2023-07-07T18:14:46.260782+0000","last_became_peered":"2023-07-07T18:14:46.260782+0000","last_unstale":"2023-07-07T18:14:50.694287+0000","last_undegraded":"2023-07-07T18:14:50.694287+0000","last_fullsized":"2023-07-07T18:14:50.694287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:51:02.683189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694186+0000","last_change":"2023-07-07T18:14:50.280851+0000","last_active":"2023-07-07T18:14:50.694186+0000","last_peered":"2023-07-07T18:14:50.694186+0000","last_clean":"2023-07-07T18:14:50.694186+0000","last_became_active":"2023-07-07T18:14:50.280316+0000","last_became_peered":"2023-07-07T18:14:50.280316+0000","last_unstale":"2023-07-07T18:14:50.694186+0000","last_undegraded":"2023-07-07T18:14:50.694186+0000","last_fullsized":"2023-07-07T18:14:50.694186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:28:18.418331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.288205+0000","last_change":"2023-07-07T18:14:45.827930+0000","last_active":"2023-07-07T18:14:51.288205+0000","last_peered":"2023-07-07T18:14:51.288205+0000","last_clean":"2023-07-07T18:14:51.288205+0000","last_became_active":"2023-07-07T18:14:45.827650+0000","last_became_peered":"2023-07-07T18:14:45.827650+0000","last_unstale":"2023-07-07T18:14:51.288205+0000","last_undegraded":"2023-07-07T18:14:51.288205+0000","last_fullsized":"2023-07-07T18:14:51.288205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:41:51.857434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287208+0000","last_change":"2023-07-07T18:14:46.238211+0000","last_active":"2023-07-07T18:14:51.287208+0000","last_peered":"2023-07-07T18:14:51.287208+0000","last_clean":"2023-07-07T18:14:51.287208+0000","last_became_active":"2023-07-07T18:14:46.237822+0000","last_became_peered":"2023-07-07T18:14:46.237822+0000","last_unstale":"2023-07-07T18:14:51.287208+0000","last_undegraded":"2023-07-07T18:14:51.287208+0000","last_fullsized":"2023-07-07T18:14:51.287208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:23:49.686417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693146+0000","last_change":"2023-07-07T18:14:50.279713+0000","last_active":"2023-07-07T18:14:50.693146+0000","last_peered":"2023-07-07T18:14:50.693146+0000","last_clean":"2023-07-07T18:14:50.693146+0000","last_became_active":"2023-07-07T18:14:50.278898+0000","last_became_peered":"2023-07-07T18:14:50.278898+0000","last_unstale":"2023-07-07T18:14:50.693146+0000","last_undegraded":"2023-07-07T18:14:50.693146+0000","last_fullsized":"2023-07-07T18:14:50.693146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:49.239942+0000","last_clean_scrub_stamp":"2023-07-07T18:14:49.239942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:41:35.250768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.769299+0000","last_change":"2023-07-07T18:14:45.820079+0000","last_active":"2023-07-07T18:14:50.769299+0000","last_peered":"2023-07-07T18:14:50.769299+0000","last_clean":"2023-07-07T18:14:50.769299+0000","last_became_active":"2023-07-07T18:14:45.819405+0000","last_became_peered":"2023-07-07T18:14:45.819405+0000","last_unstale":"2023-07-07T18:14:50.769299+0000","last_undegraded":"2023-07-07T18:14:50.769299+0000","last_fullsized":"2023-07-07T18:14:50.769299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:44.787073+0000","last_clean_scrub_stamp":"2023-07-07T18:14:44.787073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:50:57.504435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.695320+0000","last_change":"2023-07-07T18:14:46.256641+0000","last_active":"2023-07-07T18:14:50.695320+0000","last_peered":"2023-07-07T18:14:50.695320+0000","last_clean":"2023-07-07T18:14:50.695320+0000","last_became_active":"2023-07-07T18:14:46.253883+0000","last_became_peered":"2023-07-07T18:14:46.253883+0000","last_unstale":"2023-07-07T18:14:50.695320+0000","last_undegraded":"2023-07-07T18:14:50.695320+0000","last_fullsized":"2023-07-07T18:14:50.695320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:00:41.025452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287193+0000","last_change":"2023-07-07T18:14:46.253192+0000","last_active":"2023-07-07T18:14:51.287193+0000","last_peered":"2023-07-07T18:14:51.287193+0000","last_clean":"2023-07-07T18:14:51.287193+0000","last_became_active":"2023-07-07T18:14:46.250853+0000","last_became_peered":"2023-07-07T18:14:46.250853+0000","last_unstale":"2023-07-07T18:14:51.287193+0000","last_undegraded":"2023-07-07T18:14:51.287193+0000","last_fullsized":"2023-07-07T18:14:51.287193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:29:26.486548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.287484+0000","last_change":"2023-07-07T18:14:46.238908+0000","last_active":"2023-07-07T18:14:51.287484+0000","last_peered":"2023-07-07T18:14:51.287484+0000","last_clean":"2023-07-07T18:14:51.287484+0000","last_became_active":"2023-07-07T18:14:46.238441+0000","last_became_peered":"2023-07-07T18:14:46.238441+0000","last_unstale":"2023-07-07T18:14:51.287484+0000","last_undegraded":"2023-07-07T18:14:51.287484+0000","last_fullsized":"2023-07-07T18:14:51.287484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:03:21.014607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.694640+0000","last_change":"2023-07-07T18:14:46.256362+0000","last_active":"2023-07-07T18:14:50.694640+0000","last_peered":"2023-07-07T18:14:50.694640+0000","last_clean":"2023-07-07T18:14:50.694640+0000","last_became_active":"2023-07-07T18:14:46.254215+0000","last_became_peered":"2023-07-07T18:14:46.254215+0000","last_unstale":"2023-07-07T18:14:50.694640+0000","last_undegraded":"2023-07-07T18:14:50.694640+0000","last_fullsized":"2023-07-07T18:14:50.694640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:24:51.783149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:51.286797+0000","last_change":"2023-07-07T18:14:46.254566+0000","last_active":"2023-07-07T18:14:51.286797+0000","last_peered":"2023-07-07T18:14:51.286797+0000","last_clean":"2023-07-07T18:14:51.286797+0000","last_became_active":"2023-07-07T18:14:46.250615+0000","last_became_peered":"2023-07-07T18:14:46.250615+0000","last_unstale":"2023-07-07T18:14:51.286797+0000","last_undegraded":"2023-07-07T18:14:51.286797+0000","last_fullsized":"2023-07-07T18:14:51.286797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:26:04.424280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-07-07T18:14:50.693785+0000","last_change":"2023-07-07T18:14:46.245808+0000","last_active":"2023-07-07T18:14:50.693785+0000","last_peered":"2023-07-07T18:14:50.693785+0000","last_clean":"2023-07-07T18:14:50.693785+0000","last_became_active":"2023-07-07T18:14:46.245489+0000","last_became_peered":"2023-07-07T18:14:46.245489+0000","last_unstale":"2023-07-07T18:14:50.693785+0000","last_undegraded":"2023-07-07T18:14:50.693785+0000","last_fullsized":"2023-07-07T18:14:50.693785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:45.796447+0000","last_clean_scrub_stamp":"2023-07-07T18:14:45.796447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:05:25.306900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509453,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":933888,"data_stored":721743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542156,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":905216,"data_stored":717646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":127365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8380000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":315392,"data_stored":127455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":131215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":128017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T18:15:16.020 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-07T18:15:16.020 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-07T18:15:16.020 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-07T18:15:16.021 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-07T18:15:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.174+0000 7f99215ab700 1 Processor -- start 2023-07-07T18:15:16.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.174+0000 7f99215ab700 1 -- start start 2023-07-07T18:15:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.175+0000 7f99215ab700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f991c160a50 0x7f991c1674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.175+0000 7f99215ab700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c160e70 con 0x7f991c0cd830 2023-07-07T18:15:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.175+0000 7f99215ab700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c1610a0 con 0x7f991c15c570 2023-07-07T18:15:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.175+0000 7f99215ab700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f991c15d670 con 0x7f991c160a50 2023-07-07T18:15:16.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.175+0000 7f991a7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f991c0cd830 0x7f991c160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54888/0 (socket says 172.21.15.12:54888) 2023-07-07T18:15:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.175+0000 7f991a7fc700 1 -- 172.21.15.12:0/3344639455 learned_addr learned my addr 172.21.15.12:0/3344639455 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.175+0000 7f991b7fe700 1 --2- 172.21.15.12:0/3344639455 >> v2:172.21.15.160:3300/0 conn(0x7f991c160a50 0x7f991c1674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.175+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615164874 0 0) 0x7f991c160e70 con 0x7f991c0cd830 2023-07-07T18:15:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.175+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99040035b0 con 0x7f991c0cd830 2023-07-07T18:15:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2721022907 0 0) 0x7f99040035b0 con 0x7f991c0cd830 2023-07-07T18:15:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 >> v2:172.21.15.160:3300/0 conn(0x7f991c160a50 msgr2=0x7f991c1674d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:16.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 --2- 172.21.15.12:0/3344639455 >> v2:172.21.15.160:3300/0 conn(0x7f991c160a50 0x7f991c1674d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 >> v1:172.21.15.160:6789/0 conn(0x7f991c15c570 legacy=0x7f991c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c15da90 con 0x7f991c0cd830 2023-07-07T18:15:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f990c001670 con 0x7f991c0cd830 2023-07-07T18:15:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 >> v1:172.21.15.12:6789/0 conn(0x7f991c0cd830 legacy=0x7f991c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9904003a00 0x7f9904003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f9904004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9904005200 0x7f990400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c15d670 con 0x7f9904004850 2023-07-07T18:15:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990400c080 con 0x7f9904005200 2023-07-07T18:15:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990400c240 con 0x7f9904003a00 2023-07-07T18:15:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991a7fc700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f9904004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991affd700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9904003a00 0x7f9904003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991b7fe700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9904005200 0x7f990400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991a7fc700 1 -- 172.21.15.12:0/3344639455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9904003a00 msgr2=0x7f9904003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991a7fc700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9904003a00 0x7f9904003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991a7fc700 1 -- 172.21.15.12:0/3344639455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9904005200 msgr2=0x7f990400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991a7fc700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9904005200 0x7f990400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991a7fc700 1 -- 172.21.15.12:0/3344639455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040035b0 con 0x7f9904004850 2023-07-07T18:15:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991b7fe700 1 -- 172.21.15.12:0/3344639455 reap_dead start 2023-07-07T18:15:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f991a7fc700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f9904004cc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f990c00c2a0 tx=0x7f9904005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a24e2080e541cd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c007c10 con 0x7f9904004850 2023-07-07T18:15:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c00cd80 con 0x7f9904004850 2023-07-07T18:15:16.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.176+0000 7f9919ffb700 1 -- 172.21.15.12:0/3344639455 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c005ba0 con 0x7f9904004850 2023-07-07T18:15:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.177+0000 7f99215ab700 1 -- 172.21.15.12:0/3344639455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 msgr2=0x7f9904004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.177+0000 7f99215ab700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f9904004cc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f990c00c2a0 tx=0x7f9904005880 comp rx=0 tx=0).stop 2023-07-07T18:15:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.177+0000 7f99215ab700 1 -- 172.21.15.12:0/3344639455 shutdown_connections 2023-07-07T18:15:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.177+0000 7f99215ab700 1 --2- 172.21.15.12:0/3344639455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f9904004cc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.177+0000 7f99215ab700 1 -- 172.21.15.12:0/3344639455 >> 172.21.15.12:0/3344639455 conn(0x7f991c071620 msgr2=0x7f991c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.177+0000 7f99215ab700 1 -- 172.21.15.12:0/3344639455 shutdown_connections 2023-07-07T18:15:16.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.177+0000 7f99215ab700 1 -- 172.21.15.12:0/3344639455 wait complete. 2023-07-07T18:15:16.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.178+0000 7f99215ab700 1 Processor -- start 2023-07-07T18:15:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.178+0000 7f99215ab700 1 -- start start 2023-07-07T18:15:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f99215ab700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f991c156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f99215ab700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991c0b8450 0x7f991c0c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f99215ab700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f991c0c6d40 0x7f991c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f99215ab700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0cb090 con 0x7f9904004850 2023-07-07T18:15:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f99215ab700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0cb370 con 0x7f991c0b8450 2023-07-07T18:15:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f99215ab700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0cb650 con 0x7f991c0c6d40 2023-07-07T18:15:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f991c156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f991c156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57700/0 (socket says 172.21.15.12:57700) 2023-07-07T18:15:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991affd700 1 -- 172.21.15.12:0/1826912900 learned_addr learned my addr 172.21.15.12:0/1826912900 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991a7fc700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991c0b8450 0x7f991c0c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991b7fe700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f991c0c6d40 0x7f991c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991affd700 1 -- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f991c0c6d40 msgr2=0x7f991c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991affd700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f991c0c6d40 0x7f991c0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991affd700 1 -- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991c0b8450 msgr2=0x7f991c0c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991affd700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991c0b8450 0x7f991c0c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991affd700 1 -- 172.21.15.12:0/1826912900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0cb930 con 0x7f9904004850 2023-07-07T18:15:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.179+0000 7f991b7fe700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f991c0c6d40 0x7f991c0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.180+0000 7f991affd700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f991c156cf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f991000e4d0 tx=0x7f991000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.180+0000 7f99037fe700 1 -- 172.21.15.12:0/1826912900 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100052e0 con 0x7f9904004850 2023-07-07T18:15:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.180+0000 7f99037fe700 1 -- 172.21.15.12:0/1826912900 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910005440 con 0x7f9904004850 2023-07-07T18:15:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.180+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c0cbc10 con 0x7f9904004850 2023-07-07T18:15:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.180+0000 7f99037fe700 1 -- 172.21.15.12:0/1826912900 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100038a0 con 0x7f9904004850 2023-07-07T18:15:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.180+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c0cc670 con 0x7f9904004850 2023-07-07T18:15:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.181+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c0cbf80 con 0x7f9904004850 2023-07-07T18:15:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.181+0000 7f99037fe700 1 -- 172.21.15.12:0/1826912900 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9910003a00 con 0x7f9904004850 2023-07-07T18:15:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.181+0000 7f99037fe700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f990806ace0 0x7f990806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.182+0000 7f99037fe700 1 -- 172.21.15.12:0/1826912900 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9910088d70 con 0x7f9904004850 2023-07-07T18:15:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.182+0000 7f991a7fc700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f990806ace0 0x7f990806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.182+0000 7f991a7fc700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f990806ace0 0x7f990806d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f990c001930 tx=0x7f990c007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:16.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.186+0000 7f99037fe700 1 -- 172.21.15.12:0/1826912900 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9910053c70 con 0x7f9904004850 2023-07-07T18:15:16.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.430+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f991c0cc860 con 0x7f9904004850 2023-07-07T18:15:16.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.431+0000 7f99037fe700 1 -- 172.21.15.12:0/1826912900 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9910019040 con 0x7f9904004850 2023-07-07T18:15:16.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:16.434 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-07T18:15:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f990806ace0 msgr2=0x7f990806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f990806ace0 0x7f990806d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f990c001930 tx=0x7f990c007000 comp rx=0 tx=0).stop 2023-07-07T18:15:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 msgr2=0x7f991c156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f991c156cf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f991000e4d0 tx=0x7f991000e890 comp rx=0 tx=0).stop 2023-07-07T18:15:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 shutdown_connections 2023-07-07T18:15:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f990806ace0 0x7f990806d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f991c0c6d40 0x7f991c0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9904004850 0x7f991c156cf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 --2- 172.21.15.12:0/1826912900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991c0b8450 0x7f991c0c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 >> 172.21.15.12:0/1826912900 conn(0x7f991c071620 msgr2=0x7f991c0d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 shutdown_connections 2023-07-07T18:15:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.433+0000 7f99215ab700 1 -- 172.21.15.12:0/1826912900 wait complete. 2023-07-07T18:15:16.447 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-07T18:15:16.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:16.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.570+0000 7f79835dd700 1 Processor -- start 2023-07-07T18:15:16.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.570+0000 7f79835dd700 1 -- start start 2023-07-07T18:15:16.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f79835dd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f797c0ae6c0 0x7f797c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f79835dd700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c0af090 con 0x7f797c0cddd0 2023-07-07T18:15:16.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f79835dd700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c15d6a0 con 0x7f797c0aec10 2023-07-07T18:15:16.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f79835dd700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c0cdc80 con 0x7f797c0ae6c0 2023-07-07T18:15:16.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f7980b78700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f797c0ae6c0 0x7f797c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f7981379700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f797c0cddd0 0x7f797c0ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54906/0 (socket says 172.21.15.12:54906) 2023-07-07T18:15:16.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f7981379700 1 -- 172.21.15.12:0/2357526278 learned_addr learned my addr 172.21.15.12:0/2357526278 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:16.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f7980b78700 1 -- 172.21.15.12:0/2357526278 >> v1:172.21.15.160:6789/0 conn(0x7f797c0aec10 legacy=0x7f797c0714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:16.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f7980b78700 1 -- 172.21.15.12:0/2357526278 >> v1:172.21.15.12:6789/0 conn(0x7f797c0cddd0 legacy=0x7f797c0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.571+0000 7f7973fff700 1 -- 172.21.15.12:0/2357526278 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305403734 0 0) 0x7f797c0af090 con 0x7f797c0cddd0 2023-07-07T18:15:16.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f7980b78700 1 -- 172.21.15.12:0/2357526278 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c159700 con 0x7f797c0ae6c0 2023-07-07T18:15:16.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f7980b78700 1 --2- 172.21.15.12:0/2357526278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 0x7f797c15a1e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7978009840 tx=0x7f7978009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f855a56b9c6b213 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:16.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f7973fff700 1 -- 172.21.15.12:0/2357526278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978011830 con 0x7f797c0ae6c0 2023-07-07T18:15:16.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f7973fff700 1 -- 172.21.15.12:0/2357526278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7978011990 con 0x7f797c0ae6c0 2023-07-07T18:15:16.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f7973fff700 1 -- 172.21.15.12:0/2357526278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978011d20 con 0x7f797c0ae6c0 2023-07-07T18:15:16.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f79835dd700 1 -- 172.21.15.12:0/2357526278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 msgr2=0x7f797c15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f79835dd700 1 --2- 172.21.15.12:0/2357526278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 0x7f797c15a1e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7978009840 tx=0x7f7978009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:16.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f79835dd700 1 -- 172.21.15.12:0/2357526278 shutdown_connections 2023-07-07T18:15:16.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f79835dd700 1 --2- 172.21.15.12:0/2357526278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 0x7f797c15a1e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.572+0000 7f79835dd700 1 -- 172.21.15.12:0/2357526278 >> 172.21.15.12:0/2357526278 conn(0x7f797c06d4a0 msgr2=0x7f797c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:16.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.573+0000 7f79835dd700 1 -- 172.21.15.12:0/2357526278 shutdown_connections 2023-07-07T18:15:16.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.573+0000 7f79835dd700 1 -- 172.21.15.12:0/2357526278 wait complete. 2023-07-07T18:15:16.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.574+0000 7f79835dd700 1 Processor -- start 2023-07-07T18:15:16.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.574+0000 7f79835dd700 1 -- start start 2023-07-07T18:15:16.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.574+0000 7f79835dd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 0x7f797c0adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.574+0000 7f79835dd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f797c0aec10 0x7f797c1f4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.574+0000 7f79835dd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c0cddd0 0x7f797c15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f79835dd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0cb5a0 con 0x7f797c0ae6c0 2023-07-07T18:15:16.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f79835dd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0c6890 con 0x7f797c0cddd0 2023-07-07T18:15:16.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f79835dd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0ae490 con 0x7f797c0aec10 2023-07-07T18:15:16.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981379700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 0x7f797c0adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981379700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 0x7f797c0adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57714/0 (socket says 172.21.15.12:57714) 2023-07-07T18:15:16.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981379700 1 -- 172.21.15.12:0/3301471876 learned_addr learned my addr 172.21.15.12:0/3301471876 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:16.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7980b78700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f797c0aec10 0x7f797c1f4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981b7a700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c0cddd0 0x7f797c15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981379700 1 -- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f797c0aec10 msgr2=0x7f797c1f4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981379700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f797c0aec10 0x7f797c1f4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981379700 1 -- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c0cddd0 msgr2=0x7f797c15bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981379700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c0cddd0 0x7f797c15bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981379700 1 -- 172.21.15.12:0/3301471876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79780094a0 con 0x7f797c0ae6c0 2023-07-07T18:15:16.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7981379700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 0x7f797c0adf50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c520 tx=0x7f796c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:16.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7971ffb700 1 -- 172.21.15.12:0/3301471876 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c004c80 con 0x7f797c0ae6c0 2023-07-07T18:15:16.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7971ffb700 1 -- 172.21.15.12:0/3301471876 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c004e00 con 0x7f797c0ae6c0 2023-07-07T18:15:16.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c0ca640 con 0x7f797c0ae6c0 2023-07-07T18:15:16.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.575+0000 7f7971ffb700 1 -- 172.21.15.12:0/3301471876 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c007310 con 0x7f797c0ae6c0 2023-07-07T18:15:16.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.576+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c0cac00 con 0x7f797c0ae6c0 2023-07-07T18:15:16.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.576+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c0cb6e0 con 0x7f797c0ae6c0 2023-07-07T18:15:16.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.577+0000 7f7971ffb700 1 -- 172.21.15.12:0/3301471876 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f796c007470 con 0x7f797c0ae6c0 2023-07-07T18:15:16.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.577+0000 7f7971ffb700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f796006ace0 0x7f796006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.577+0000 7f7971ffb700 1 -- 172.21.15.12:0/3301471876 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f796c0892d0 con 0x7f797c0ae6c0 2023-07-07T18:15:16.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.578+0000 7f7980b78700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f796006ace0 0x7f796006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.578+0000 7f7980b78700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f796006ace0 0x7f796006d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f79780090b0 tx=0x7f797801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:16.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.582+0000 7f7971ffb700 1 -- 172.21.15.12:0/3301471876 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f797c0cb6e0 con 0x7f797c0ae6c0 2023-07-07T18:15:16.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.784+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f797c0cb6e0 con 0x7f797c0ae6c0 2023-07-07T18:15:16.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.785+0000 7f7971ffb700 1 -- 172.21.15.12:0/3301471876 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7f797c0cb6e0 con 0x7f797c0ae6c0 2023-07-07T18:15:16.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:16.788 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:16.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f796006ace0 msgr2=0x7f796006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f796006ace0 0x7f796006d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f79780090b0 tx=0x7f797801c040 comp rx=0 tx=0).stop 2023-07-07T18:15:16.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 msgr2=0x7f797c0adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 0x7f797c0adf50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c520 tx=0x7f796c00c830 comp rx=0 tx=0).stop 2023-07-07T18:15:16.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 shutdown_connections 2023-07-07T18:15:16.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f796006ace0 0x7f796006d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c0cddd0 0x7f797c15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f797c0ae6c0 0x7f797c0adf50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 --2- 172.21.15.12:0/3301471876 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f797c0aec10 0x7f797c1f4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 >> 172.21.15.12:0/3301471876 conn(0x7f797c06d4a0 msgr2=0x7f797c0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:16.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 shutdown_connections 2023-07-07T18:15:16.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.788+0000 7f79835dd700 1 -- 172.21.15.12:0/3301471876 wait complete. 2023-07-07T18:15:16.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:16.803 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.928+0000 7fcffce67700 1 Processor -- start 2023-07-07T18:15:16.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.928+0000 7fcffce67700 1 -- start start 2023-07-07T18:15:16.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.929+0000 7fcffce67700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcff815fc60 0x7fcff806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.929+0000 7fcffce67700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcff806e970 0x7fcff80ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.929+0000 7fcffce67700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff80ce620 con 0x7fcff80aecc0 2023-07-07T18:15:16.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.929+0000 7fcffce67700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff8160580 con 0x7fcff815fc60 2023-07-07T18:15:16.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.929+0000 7fcffce67700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff8160860 con 0x7fcff806e970 2023-07-07T18:15:16.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.929+0000 7fcff659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcff815fc60 0x7fcff806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.929+0000 7fcff659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcff815fc60 0x7fcff806a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57722/0 (socket says 172.21.15.12:57722) 2023-07-07T18:15:16.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.929+0000 7fcff659c700 1 -- 172.21.15.12:0/634895457 learned_addr learned my addr 172.21.15.12:0/634895457 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:16.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.929+0000 7fcff6d9d700 1 --2- 172.21.15.12:0/634895457 >> v2:172.21.15.160:3300/0 conn(0x7fcff806e970 0x7fcff80ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcff659c700 1 -- 172.21.15.12:0/634895457 >> v2:172.21.15.160:3300/0 conn(0x7fcff806e970 msgr2=0x7fcff80ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcff659c700 1 --2- 172.21.15.12:0/634895457 >> v2:172.21.15.160:3300/0 conn(0x7fcff806e970 0x7fcff80ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcff659c700 1 -- 172.21.15.12:0/634895457 >> v1:172.21.15.160:6789/0 conn(0x7fcff80aecc0 legacy=0x7fcff806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcff659c700 1 -- 172.21.15.12:0/634895457 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff8160b40 con 0x7fcff815fc60 2023-07-07T18:15:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcff659c700 1 --2- 172.21.15.12:0/634895457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 0x7fcff806a900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcff806c030 tx=0x7fcfec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc2af3779f1d5c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcff559a700 1 -- 172.21.15.12:0/634895457 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec005e30 con 0x7fcff815fc60 2023-07-07T18:15:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcff559a700 1 -- 172.21.15.12:0/634895457 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec004030 con 0x7fcff815fc60 2023-07-07T18:15:16.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcff559a700 1 -- 172.21.15.12:0/634895457 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0043e0 con 0x7fcff815fc60 2023-07-07T18:15:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcffce67700 1 -- 172.21.15.12:0/634895457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 msgr2=0x7fcff806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.930+0000 7fcffce67700 1 --2- 172.21.15.12:0/634895457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 0x7fcff806a900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcff806c030 tx=0x7fcfec009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.931+0000 7fcffce67700 1 -- 172.21.15.12:0/634895457 shutdown_connections 2023-07-07T18:15:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.931+0000 7fcffce67700 1 --2- 172.21.15.12:0/634895457 >> v2:172.21.15.160:3300/0 conn(0x7fcff806e970 0x7fcff80ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.931+0000 7fcffce67700 1 --2- 172.21.15.12:0/634895457 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 0x7fcff806a900 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.931+0000 7fcffce67700 1 -- 172.21.15.12:0/634895457 >> 172.21.15.12:0/634895457 conn(0x7fcff806b920 msgr2=0x7fcff80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:16.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.931+0000 7fcffce67700 1 -- 172.21.15.12:0/634895457 shutdown_connections 2023-07-07T18:15:16.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.931+0000 7fcffce67700 1 -- 172.21.15.12:0/634895457 wait complete. 2023-07-07T18:15:16.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.932+0000 7fcffce67700 1 Processor -- start 2023-07-07T18:15:16.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.932+0000 7fcffce67700 1 -- start start 2023-07-07T18:15:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcffce67700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcff806e970 0x7fcff80c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcffce67700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff80aecc0 0x7fcff80b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcffce67700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 0x7fcff815d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcffce67700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80b3a80 con 0x7fcff815fc60 2023-07-07T18:15:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcffce67700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80b3d60 con 0x7fcff80aecc0 2023-07-07T18:15:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcffce67700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80b4040 con 0x7fcff806e970 2023-07-07T18:15:16.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 0x7fcff815d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 0x7fcff815d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57732/0 (socket says 172.21.15.12:57732) 2023-07-07T18:15:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff6d9d700 1 -- 172.21.15.12:0/1649639728 learned_addr learned my addr 172.21.15.12:0/1649639728 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff659c700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcff806e970 0x7fcff80c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff5d9b700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff80aecc0 0x7fcff80b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff6d9d700 1 -- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcff806e970 msgr2=0x7fcff80c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff6d9d700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcff806e970 0x7fcff80c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff6d9d700 1 -- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff80aecc0 msgr2=0x7fcff80b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff6d9d700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff80aecc0 0x7fcff80b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff6d9d700 1 -- 172.21.15.12:0/1649639728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec009500 con 0x7fcff815fc60 2023-07-07T18:15:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcff6d9d700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 0x7fcff815d180 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcff000efc0 tx=0x7fcff000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcfe6ffd700 1 -- 172.21.15.12:0/1649639728 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000cd40 con 0x7fcff815fc60 2023-07-07T18:15:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcfe6ffd700 1 -- 172.21.15.12:0/1649639728 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff000f040 con 0x7fcff815fc60 2023-07-07T18:15:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff80b4320 con 0x7fcff815fc60 2023-07-07T18:15:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.933+0000 7fcfe6ffd700 1 -- 172.21.15.12:0/1649639728 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff00146c0 con 0x7fcff815fc60 2023-07-07T18:15:16.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.934+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff80b3750 con 0x7fcff815fc60 2023-07-07T18:15:16.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.934+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff804ea20 con 0x7fcff815fc60 2023-07-07T18:15:16.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.935+0000 7fcfe6ffd700 1 -- 172.21.15.12:0/1649639728 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcff0014820 con 0x7fcff815fc60 2023-07-07T18:15:16.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.935+0000 7fcfe6ffd700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcfd806ace0 0x7fcfd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:16.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.935+0000 7fcfe6ffd700 1 -- 172.21.15.12:0/1649639728 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcff008a350 con 0x7fcff815fc60 2023-07-07T18:15:16.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.936+0000 7fcff659c700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcfd806ace0 0x7fcfd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:16.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.936+0000 7fcff659c700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcfd806ace0 0x7fcfd806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009c10 tx=0x7fcfec008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:16.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:16.940+0000 7fcfe6ffd700 1 -- 172.21.15.12:0/1649639728 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcff0058c30 con 0x7fcff815fc60 2023-07-07T18:15:17.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.136+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcff80b5990 con 0x7fcff815fc60 2023-07-07T18:15:17.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.136+0000 7fcfe6ffd700 1 -- 172.21.15.12:0/1649639728 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcff000cea0 con 0x7fcff815fc60 2023-07-07T18:15:17.139 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:17.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcfd806ace0 msgr2=0x7fcfd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcfd806ace0 0x7fcfd806d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009c10 tx=0x7fcfec008070 comp rx=0 tx=0).stop 2023-07-07T18:15:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 msgr2=0x7fcff815d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 0x7fcff815d180 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcff000efc0 tx=0x7fcff000c3a0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 shutdown_connections 2023-07-07T18:15:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcfd806ace0 0x7fcfd806d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcff815fc60 0x7fcff815d180 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcff806e970 0x7fcff80c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 --2- 172.21.15.12:0/1649639728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff80aecc0 0x7fcff80b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 >> 172.21.15.12:0/1649639728 conn(0x7fcff806b920 msgr2=0x7fcff815e790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:17.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 shutdown_connections 2023-07-07T18:15:17.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.138+0000 7fcffce67700 1 -- 172.21.15.12:0/1649639728 wait complete. 2023-07-07T18:15:17.154 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:17.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.280+0000 7fea720b8700 1 Processor -- start 2023-07-07T18:15:17.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.280+0000 7fea720b8700 1 -- start start 2023-07-07T18:15:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea720b8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fea6c15fc60 0x7fea6c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea720b8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c06e970 0x7fea6c0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea720b8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0ce620 con 0x7fea6c0aecc0 2023-07-07T18:15:17.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea720b8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6c160580 con 0x7fea6c15fc60 2023-07-07T18:15:17.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea720b8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c160860 con 0x7fea6c06e970 2023-07-07T18:15:17.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea6affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fea6c0aecc0 0x7fea6c06e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54936/0 (socket says 172.21.15.12:54936) 2023-07-07T18:15:17.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea6affd700 1 -- 172.21.15.12:0/1588124984 learned_addr learned my addr 172.21.15.12:0/1588124984 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:17.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea6b7fe700 1 --2- 172.21.15.12:0/1588124984 >> v2:172.21.15.160:3300/0 conn(0x7fea6c15fc60 0x7fea6c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea6bfff700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c06e970 0x7fea6c0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 460869898 0 0) 0x7fea6c0ce620 con 0x7fea6c0aecc0 2023-07-07T18:15:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.281+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea540035b0 con 0x7fea6c0aecc0 2023-07-07T18:15:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1407160357 0 0) 0x7fea540035b0 con 0x7fea6c0aecc0 2023-07-07T18:15:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c06e970 msgr2=0x7fea6c0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c06e970 0x7fea6c0ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 >> v2:172.21.15.160:3300/0 conn(0x7fea6c15fc60 msgr2=0x7fea6c06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 --2- 172.21.15.12:0/1588124984 >> v2:172.21.15.160:3300/0 conn(0x7fea6c15fc60 0x7fea6c06a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c160b40 con 0x7fea6c0aecc0 2023-07-07T18:15:17.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fea60001670 con 0x7fea6c0aecc0 2023-07-07T18:15:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 >> v1:172.21.15.12:6789/0 conn(0x7fea6c0aecc0 legacy=0x7fea6c06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c06e970 0x7fea54003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea54003f80 0x7fea54004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea54004d90 0x7fea54005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c160580 con 0x7fea54004d90 2023-07-07T18:15:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c160860 con 0x7fea54003f80 2023-07-07T18:15:17.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5400ba10 con 0x7fea6c06e970 2023-07-07T18:15:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6bfff700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea54004d90 0x7fea54005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6b7fe700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c06e970 0x7fea54003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6affd700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea54003f80 0x7fea54004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6bfff700 1 -- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c06e970 msgr2=0x7fea54003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6bfff700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c06e970 0x7fea54003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6bfff700 1 -- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea54003f80 msgr2=0x7fea54004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:17.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6bfff700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea54003f80 0x7fea54004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6bfff700 1 -- 172.21.15.12:0/1588124984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea540035b0 con 0x7fea54004d90 2023-07-07T18:15:17.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.282+0000 7fea6bfff700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea54004d90 0x7fea54005200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fea64009f90 tx=0x7fea54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7224475f9171da server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:17.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400ebd0 con 0x7fea54004d90 2023-07-07T18:15:17.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6400f040 con 0x7fea54004d90 2023-07-07T18:15:17.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea6a7fc700 1 -- 172.21.15.12:0/1588124984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64014480 con 0x7fea54004d90 2023-07-07T18:15:17.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea720b8700 1 -- 172.21.15.12:0/1588124984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea54004d90 msgr2=0x7fea54005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea720b8700 1 --2- 172.21.15.12:0/1588124984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea54004d90 0x7fea54005200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fea64009f90 tx=0x7fea54005880 comp rx=0 tx=0).stop 2023-07-07T18:15:17.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea6bfff700 1 -- 172.21.15.12:0/1588124984 reap_dead start 2023-07-07T18:15:17.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea720b8700 1 -- 172.21.15.12:0/1588124984 shutdown_connections 2023-07-07T18:15:17.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea720b8700 1 -- 172.21.15.12:0/1588124984 >> 172.21.15.12:0/1588124984 conn(0x7fea6c06b920 msgr2=0x7fea6c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:17.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea720b8700 1 -- 172.21.15.12:0/1588124984 shutdown_connections 2023-07-07T18:15:17.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.283+0000 7fea720b8700 1 -- 172.21.15.12:0/1588124984 wait complete. 2023-07-07T18:15:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.284+0000 7fea720b8700 1 Processor -- start 2023-07-07T18:15:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.285+0000 7fea720b8700 1 -- start start 2023-07-07T18:15:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.285+0000 7fea720b8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6c149440 0x7fea6c0c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.285+0000 7fea720b8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea6c0b2840 0x7fea6c0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.285+0000 7fea720b8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c0c96a0 0x7fea6c0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.285+0000 7fea720b8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0c5020 con 0x7fea6c0b2840 2023-07-07T18:15:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.285+0000 7fea720b8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0c52c0 con 0x7fea6c149440 2023-07-07T18:15:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.285+0000 7fea720b8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0c55a0 con 0x7fea6c0c96a0 2023-07-07T18:15:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea6c0b2840 0x7fea6c0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea6c0b2840 0x7fea6c0c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57750/0 (socket says 172.21.15.12:57750) 2023-07-07T18:15:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6affd700 1 -- 172.21.15.12:0/4197226782 learned_addr learned my addr 172.21.15.12:0/4197226782 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6bfff700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c0c96a0 0x7fea6c0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6b7fe700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6c149440 0x7fea6c0c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6affd700 1 -- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c0c96a0 msgr2=0x7fea6c0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6affd700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c0c96a0 0x7fea6c0b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6affd700 1 -- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6c149440 msgr2=0x7fea6c0c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6affd700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6c149440 0x7fea6c0c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6affd700 1 -- 172.21.15.12:0/4197226782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c0c5880 con 0x7fea6c0b2840 2023-07-07T18:15:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea6affd700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea6c0b2840 0x7fea6c0c9160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea600048d0 tx=0x7fea60007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:17.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea53fff700 1 -- 172.21.15.12:0/4197226782 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6000f620 con 0x7fea6c0b2840 2023-07-07T18:15:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea53fff700 1 -- 172.21.15.12:0/4197226782 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6000f780 con 0x7fea6c0b2840 2023-07-07T18:15:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c15afc0 con 0x7fea6c0b2840 2023-07-07T18:15:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea53fff700 1 -- 172.21.15.12:0/4197226782 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6000fb30 con 0x7fea6c0b2840 2023-07-07T18:15:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.286+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c0b2d00 con 0x7fea6c0b2840 2023-07-07T18:15:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.287+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c04ea20 con 0x7fea6c0b2840 2023-07-07T18:15:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.288+0000 7fea53fff700 1 -- 172.21.15.12:0/4197226782 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea6000fc90 con 0x7fea6c0b2840 2023-07-07T18:15:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.288+0000 7fea53fff700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fea5806ace0 0x7fea5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.288+0000 7fea53fff700 1 -- 172.21.15.12:0/4197226782 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fea60089740 con 0x7fea6c0b2840 2023-07-07T18:15:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.288+0000 7fea6b7fe700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fea5806ace0 0x7fea5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.289+0000 7fea6b7fe700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fea5806ace0 0x7fea5806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009cc0 tx=0x7fea5c0091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:17.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.293+0000 7fea53fff700 1 -- 172.21.15.12:0/4197226782 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fea60054500 con 0x7fea6c0b2840 2023-07-07T18:15:17.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.491+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea6c0b5990 con 0x7fea6c0b2840 2023-07-07T18:15:17.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.491+0000 7fea53fff700 1 -- 172.21.15.12:0/4197226782 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea60057b20 con 0x7fea6c0b2840 2023-07-07T18:15:17.493 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:17.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fea5806ace0 msgr2=0x7fea5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fea5806ace0 0x7fea5806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009cc0 tx=0x7fea5c0091c0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea6c0b2840 msgr2=0x7fea6c0c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea6c0b2840 0x7fea6c0c9160 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fea600048d0 tx=0x7fea60007570 comp rx=0 tx=0).stop 2023-07-07T18:15:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 shutdown_connections 2023-07-07T18:15:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fea5806ace0 0x7fea5806d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea6c0c96a0 0x7fea6c0b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6c149440 0x7fea6c0c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 --2- 172.21.15.12:0/4197226782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea6c0b2840 0x7fea6c0c9160 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.493+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 >> 172.21.15.12:0/4197226782 conn(0x7fea6c06b920 msgr2=0x7fea6c0cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.494+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 shutdown_connections 2023-07-07T18:15:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.494+0000 7fea720b8700 1 -- 172.21.15.12:0/4197226782 wait complete. 2023-07-07T18:15:17.508 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.634+0000 7ff4e00d1700 1 Processor -- start 2023-07-07T18:15:17.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.634+0000 7ff4e00d1700 1 -- start start 2023-07-07T18:15:17.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4e00d1700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4d80cd330 0x7ff4d8070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4e00d1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff4d80afc40 0x7ff4d815dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4e00d1700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d80caf70 con 0x7ff4d815a330 2023-07-07T18:15:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4e00d1700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d80cb210 con 0x7ff4d80cd330 2023-07-07T18:15:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4e00d1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d80ccc20 con 0x7ff4d80afc40 2023-07-07T18:15:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dde6d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4d80cd330 0x7ff4d8070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dde6d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4d80cd330 0x7ff4d8070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57756/0 (socket says 172.21.15.12:57756) 2023-07-07T18:15:17.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dde6d700 1 -- 172.21.15.12:0/2010724125 learned_addr learned my addr 172.21.15.12:0/2010724125 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:17.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dd66c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff4d815a330 0x7ff4d80cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54954/0 (socket says 172.21.15.12:54954) 2023-07-07T18:15:17.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4de66e700 1 --2- 172.21.15.12:0/2010724125 >> v2:172.21.15.160:3300/0 conn(0x7ff4d80afc40 0x7ff4d815dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dde6d700 1 -- 172.21.15.12:0/2010724125 >> v2:172.21.15.160:3300/0 conn(0x7ff4d80afc40 msgr2=0x7ff4d815dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:17.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dde6d700 1 --2- 172.21.15.12:0/2010724125 >> v2:172.21.15.160:3300/0 conn(0x7ff4d80afc40 0x7ff4d815dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dde6d700 1 -- 172.21.15.12:0/2010724125 >> v1:172.21.15.12:6789/0 conn(0x7ff4d815a330 legacy=0x7ff4d80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dde6d700 1 -- 172.21.15.12:0/2010724125 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d80ccf00 con 0x7ff4d80cd330 2023-07-07T18:15:17.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dce6b700 1 -- 172.21.15.12:0/2010724125 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760777300 0 0) 0x7ff4d80caf70 con 0x7ff4d815a330 2023-07-07T18:15:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.635+0000 7ff4dde6d700 1 --2- 172.21.15.12:0/2010724125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80cd330 0x7ff4d8070980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80c43d0 tx=0x7ff4d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4376674b1716887a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4dce6b700 1 -- 172.21.15.12:0/2010724125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4011830 con 0x7ff4d80cd330 2023-07-07T18:15:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4dce6b700 1 -- 172.21.15.12:0/2010724125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d4011990 con 0x7ff4d80cd330 2023-07-07T18:15:17.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4dce6b700 1 -- 172.21.15.12:0/2010724125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4011d20 con 0x7ff4d80cd330 2023-07-07T18:15:17.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4e00d1700 1 -- 172.21.15.12:0/2010724125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80cd330 msgr2=0x7ff4d8070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4e00d1700 1 --2- 172.21.15.12:0/2010724125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80cd330 0x7ff4d8070980 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80c43d0 tx=0x7ff4d4009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4e00d1700 1 -- 172.21.15.12:0/2010724125 shutdown_connections 2023-07-07T18:15:17.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4e00d1700 1 --2- 172.21.15.12:0/2010724125 >> v2:172.21.15.160:3300/0 conn(0x7ff4d80afc40 0x7ff4d815dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4e00d1700 1 --2- 172.21.15.12:0/2010724125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80cd330 0x7ff4d8070980 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4e00d1700 1 -- 172.21.15.12:0/2010724125 >> 172.21.15.12:0/2010724125 conn(0x7ff4d806e5c0 msgr2=0x7ff4d806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:17.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4e00d1700 1 -- 172.21.15.12:0/2010724125 shutdown_connections 2023-07-07T18:15:17.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.636+0000 7ff4e00d1700 1 -- 172.21.15.12:0/2010724125 wait complete. 2023-07-07T18:15:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.637+0000 7ff4e00d1700 1 Processor -- start 2023-07-07T18:15:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.637+0000 7ff4e00d1700 1 -- start start 2023-07-07T18:15:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.638+0000 7ff4e00d1700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80afc40 0x7ff4d81500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.638+0000 7ff4e00d1700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4d80cd330 0x7ff4d80b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.638+0000 7ff4e00d1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4d815a330 0x7ff4d80b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.638+0000 7ff4e00d1700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81e5d90 con 0x7ff4d80afc40 2023-07-07T18:15:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.638+0000 7ff4e00d1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d8150610 con 0x7ff4d815a330 2023-07-07T18:15:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.638+0000 7ff4e00d1700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d815d610 con 0x7ff4d80cd330 2023-07-07T18:15:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.638+0000 7ff4dde6d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80afc40 0x7ff4d81500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.638+0000 7ff4dde6d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80afc40 0x7ff4d81500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57762/0 (socket says 172.21.15.12:57762) 2023-07-07T18:15:17.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.638+0000 7ff4dde6d700 1 -- 172.21.15.12:0/3779352283 learned_addr learned my addr 172.21.15.12:0/3779352283 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:17.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4de66e700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4d815a330 0x7ff4d80b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4dd66c700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4d80cd330 0x7ff4d80b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4dde6d700 1 -- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4d80cd330 msgr2=0x7ff4d80b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4dde6d700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4d80cd330 0x7ff4d80b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4dde6d700 1 -- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4d815a330 msgr2=0x7ff4d80b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4dde6d700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4d815a330 0x7ff4d80b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4dde6d700 1 -- 172.21.15.12:0/3779352283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d4009550 con 0x7ff4d80afc40 2023-07-07T18:15:17.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4de66e700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4d815a330 0x7ff4d80b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:17.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4dde6d700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80afc40 0x7ff4d81500d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009fd0 tx=0x7ff4d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:17.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4ce7fc700 1 -- 172.21.15.12:0/3779352283 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40044f0 con 0x7ff4d80afc40 2023-07-07T18:15:17.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4ce7fc700 1 -- 172.21.15.12:0/3779352283 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d401f070 con 0x7ff4d80afc40 2023-07-07T18:15:17.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4ce7fc700 1 -- 172.21.15.12:0/3779352283 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40038e0 con 0x7ff4d80afc40 2023-07-07T18:15:17.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d815d330 con 0x7ff4d80afc40 2023-07-07T18:15:17.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.639+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d81e59b0 con 0x7ff4d80afc40 2023-07-07T18:15:17.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.640+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d81e5ed0 con 0x7ff4d80afc40 2023-07-07T18:15:17.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.640+0000 7ff4ce7fc700 1 -- 172.21.15.12:0/3779352283 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4d4021030 con 0x7ff4d80afc40 2023-07-07T18:15:17.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.641+0000 7ff4ce7fc700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4bc06ace0 0x7ff4bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.641+0000 7ff4ce7fc700 1 -- 172.21.15.12:0/3779352283 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff4d408aa30 con 0x7ff4d80afc40 2023-07-07T18:15:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.641+0000 7ff4dd66c700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4bc06ace0 0x7ff4bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.642+0000 7ff4dd66c700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4bc06ace0 0x7ff4bc06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80706f0 tx=0x7ff4c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.646+0000 7ff4ce7fc700 1 -- 172.21.15.12:0/3779352283 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff4d4055880 con 0x7ff4d80afc40 2023-07-07T18:15:17.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.847+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4d815a750 con 0x7ff4d80afc40 2023-07-07T18:15:17.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.848+0000 7ff4ce7fc700 1 -- 172.21.15.12:0/3779352283 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4d4058ea0 con 0x7ff4d80afc40 2023-07-07T18:15:17.850 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:17.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.849+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4bc06ace0 msgr2=0x7ff4bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4bc06ace0 0x7ff4bc06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff4d80706f0 tx=0x7ff4c8009040 comp rx=0 tx=0).stop 2023-07-07T18:15:17.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80afc40 msgr2=0x7ff4d81500d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80afc40 0x7ff4d81500d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009fd0 tx=0x7ff4d4004750 comp rx=0 tx=0).stop 2023-07-07T18:15:17.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 shutdown_connections 2023-07-07T18:15:17.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4bc06ace0 0x7ff4bc06d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4d815a330 0x7ff4d80b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4d80afc40 0x7ff4d81500d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 --2- 172.21.15.12:0/3779352283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4d80cd330 0x7ff4d80b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 >> 172.21.15.12:0/3779352283 conn(0x7ff4d806e5c0 msgr2=0x7ff4d80b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:17.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 shutdown_connections 2023-07-07T18:15:17.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.850+0000 7ff4e00d1700 1 -- 172.21.15.12:0/3779352283 wait complete. 2023-07-07T18:15:17.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.989+0000 7f317516c700 1 Processor -- start 2023-07-07T18:15:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.989+0000 7f317516c700 1 -- start start 2023-07-07T18:15:17.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.990+0000 7f317516c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f31700b23a0 0x7f317006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.990+0000 7f317516c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 0x7f31700b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.990+0000 7f317516c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317015c720 con 0x7f317015fe40 2023-07-07T18:15:17.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.990+0000 7f317516c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317015d820 con 0x7f31700b23a0 2023-07-07T18:15:17.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.990+0000 7f317516c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31700d03a0 con 0x7f317015d2d0 2023-07-07T18:15:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316ed9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f31700b23a0 0x7f317006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316e59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 0x7f31700b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316ed9d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f31700b23a0 0x7f317006cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53376/0 (socket says 172.21.15.12:53376) 2023-07-07T18:15:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316ed9d700 1 -- 172.21.15.12:0/3252014799 learned_addr learned my addr 172.21.15.12:0/3252014799 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316e59c700 1 -- 172.21.15.12:0/3252014799 >> v2:172.21.15.160:3300/0 conn(0x7f31700b23a0 msgr2=0x7f317006cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316e59c700 1 --2- 172.21.15.12:0/3252014799 >> v2:172.21.15.160:3300/0 conn(0x7f31700b23a0 0x7f317006cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316e59c700 1 -- 172.21.15.12:0/3252014799 >> v1:172.21.15.160:6789/0 conn(0x7f317015fe40 legacy=0x7f31701602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316e59c700 1 -- 172.21.15.12:0/3252014799 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700b2cb0 con 0x7f317015d2d0 2023-07-07T18:15:17.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316ed9d700 1 --2- 172.21.15.12:0/3252014799 >> v2:172.21.15.160:3300/0 conn(0x7f31700b23a0 0x7f317006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:17.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316e59c700 1 --2- 172.21.15.12:0/3252014799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 0x7f31700b2770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3160009840 tx=0x7f3160009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa3915b76a9fe957 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:17.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316dd9b700 1 -- 172.21.15.12:0/3252014799 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160011830 con 0x7f317015d2d0 2023-07-07T18:15:17.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316dd9b700 1 -- 172.21.15.12:0/3252014799 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160011990 con 0x7f317015d2d0 2023-07-07T18:15:17.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.991+0000 7f316dd9b700 1 -- 172.21.15.12:0/3252014799 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160011d20 con 0x7f317015d2d0 2023-07-07T18:15:17.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.992+0000 7f317516c700 1 -- 172.21.15.12:0/3252014799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 msgr2=0x7f31700b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:17.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.992+0000 7f317516c700 1 --2- 172.21.15.12:0/3252014799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 0x7f31700b2770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3160009840 tx=0x7f3160009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:17.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.992+0000 7f317516c700 1 -- 172.21.15.12:0/3252014799 shutdown_connections 2023-07-07T18:15:17.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.992+0000 7f317516c700 1 --2- 172.21.15.12:0/3252014799 >> v2:172.21.15.160:3300/0 conn(0x7f31700b23a0 0x7f317006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.992+0000 7f317516c700 1 --2- 172.21.15.12:0/3252014799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 0x7f31700b2770 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:17.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.992+0000 7f317516c700 1 -- 172.21.15.12:0/3252014799 >> 172.21.15.12:0/3252014799 conn(0x7f317006e5c0 msgr2=0x7f317006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:17.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.992+0000 7f317516c700 1 -- 172.21.15.12:0/3252014799 shutdown_connections 2023-07-07T18:15:17.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.992+0000 7f317516c700 1 -- 172.21.15.12:0/3252014799 wait complete. 2023-07-07T18:15:17.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.994+0000 7f317516c700 1 Processor -- start 2023-07-07T18:15:17.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.994+0000 7f317516c700 1 -- start start 2023-07-07T18:15:17.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f317516c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31700b23a0 0x7f3170150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f317516c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 0x7f31700b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:17.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f317516c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f317015fe40 0x7f31701509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f317516c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3170159f80 con 0x7f317015fe40 2023-07-07T18:15:18.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f317516c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31700b4d60 con 0x7f31700b23a0 2023-07-07T18:15:18.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f317516c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31700b5040 con 0x7f317015d2d0 2023-07-07T18:15:18.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f316f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f317015fe40 0x7f31701509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f316f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f317015fe40 0x7f31701509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57780/0 (socket says 172.21.15.12:57780) 2023-07-07T18:15:18.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f316f59e700 1 -- 172.21.15.12:0/4214318496 learned_addr learned my addr 172.21.15.12:0/4214318496 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:18.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f316e59c700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 0x7f31700b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.995+0000 7f316ed9d700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31700b23a0 0x7f3170150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f316f59e700 1 -- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 msgr2=0x7f31700b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f316f59e700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 0x7f31700b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f316f59e700 1 -- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31700b23a0 msgr2=0x7f3170150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f316f59e700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31700b23a0 0x7f3170150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f316f59e700 1 -- 172.21.15.12:0/4214318496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3158009550 con 0x7f317015fe40 2023-07-07T18:15:18.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f316f59e700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f317015fe40 0x7f31701509e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f316800cc50 tx=0x7f316800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:18.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f31677fe700 1 -- 172.21.15.12:0/4214318496 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168003c00 con 0x7f317015fe40 2023-07-07T18:15:18.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f31677fe700 1 -- 172.21.15.12:0/4214318496 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3168003d60 con 0x7f317015fe40 2023-07-07T18:15:18.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f31677fe700 1 -- 172.21.15.12:0/4214318496 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316800aab0 con 0x7f317015fe40 2023-07-07T18:15:18.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31600094a0 con 0x7f317015fe40 2023-07-07T18:15:18.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.996+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31700b59b0 con 0x7f317015fe40 2023-07-07T18:15:18.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.997+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31700669a0 con 0x7f317015fe40 2023-07-07T18:15:18.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.997+0000 7f31677fe700 1 -- 172.21.15.12:0/4214318496 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f316800ac10 con 0x7f317015fe40 2023-07-07T18:15:18.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.998+0000 7f31677fe700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f315006ace0 0x7f315006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.998+0000 7f31677fe700 1 -- 172.21.15.12:0/4214318496 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3168089610 con 0x7f317015fe40 2023-07-07T18:15:18.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.998+0000 7f316ed9d700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f315006ace0 0x7f315006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:17.999+0000 7f316ed9d700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f315006ace0 0x7f315006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31700b4b30 tx=0x7f31580092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:18.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.002+0000 7f31677fe700 1 -- 172.21.15.12:0/4214318496 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3168054350 con 0x7f317015fe40 2023-07-07T18:15:18.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.197+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f317015ced0 con 0x7f317015fe40 2023-07-07T18:15:18.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.197+0000 7f31677fe700 1 -- 172.21.15.12:0/4214318496 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3168057970 con 0x7f317015fe40 2023-07-07T18:15:18.200 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:18.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f315006ace0 msgr2=0x7f315006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f315006ace0 0x7f315006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f31700b4b30 tx=0x7f31580092c0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f317015fe40 msgr2=0x7f31701509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f317015fe40 0x7f31701509e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f316800cc50 tx=0x7f316800cf60 comp rx=0 tx=0).stop 2023-07-07T18:15:18.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 shutdown_connections 2023-07-07T18:15:18.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f315006ace0 0x7f315006d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f317015fe40 0x7f31701509e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31700b23a0 0x7f3170150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 --2- 172.21.15.12:0/4214318496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f317015d2d0 0x7f31700b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.199+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 >> 172.21.15.12:0/4214318496 conn(0x7f317006e5c0 msgr2=0x7f31700cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:18.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.200+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 shutdown_connections 2023-07-07T18:15:18.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.200+0000 7f317516c700 1 -- 172.21.15.12:0/4214318496 wait complete. 2023-07-07T18:15:18.213 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:18.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.342+0000 7f6902863700 1 Processor -- start 2023-07-07T18:15:18.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.342+0000 7f6902863700 1 -- start start 2023-07-07T18:15:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6902863700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f68fc0cd330 0x7f68fc070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6902863700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0afc40 0x7f68fc15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6902863700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc0caf70 con 0x7f68fc15a330 2023-07-07T18:15:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6902863700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc0cb210 con 0x7f68fc0cd330 2023-07-07T18:15:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6902863700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0ccc20 con 0x7f68fc0afc40 2023-07-07T18:15:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f68fbfff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f68fc0cd330 0x7f68fc070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6900e00700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0afc40 0x7f68fc15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f68fb7fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f68fc15a330 0x7f68fc0cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:48224/0 (socket says 172.21.15.12:48224) 2023-07-07T18:15:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f68fb7fe700 1 -- 172.21.15.12:0/3834823533 learned_addr learned my addr 172.21.15.12:0/3834823533 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f68fbfff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f68fc0cd330 0x7f68fc070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53390/0 (socket says 172.21.15.12:53390) 2023-07-07T18:15:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6900e00700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0afc40 0x7f68fc15dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:46878/0 (socket says 172.21.15.12:46878) 2023-07-07T18:15:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6900e00700 1 -- 172.21.15.12:0/3834823533 >> v2:172.21.15.160:3300/0 conn(0x7f68fc0cd330 msgr2=0x7f68fc070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6900e00700 1 --2- 172.21.15.12:0/3834823533 >> v2:172.21.15.160:3300/0 conn(0x7f68fc0cd330 0x7f68fc070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6900e00700 1 -- 172.21.15.12:0/3834823533 >> v1:172.21.15.160:6789/0 conn(0x7f68fc15a330 legacy=0x7f68fc0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f6900e00700 1 -- 172.21.15.12:0/3834823533 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0ccf00 con 0x7f68fc0afc40 2023-07-07T18:15:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f68faffd700 1 -- 172.21.15.12:0/3834823533 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844808005 0 0) 0x7f68fc0caf70 con 0x7f68fc15a330 2023-07-07T18:15:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.343+0000 7f68fbfff700 1 --2- 172.21.15.12:0/3834823533 >> v2:172.21.15.160:3300/0 conn(0x7f68fc0cd330 0x7f68fc070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f6900e00700 1 --2- 172.21.15.12:0/3834823533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0afc40 0x7f68fc15dc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009d90 tx=0x7f68f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ee7ee607e08a786 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f68faffd700 1 -- 172.21.15.12:0/3834823533 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400e070 con 0x7f68fc0afc40 2023-07-07T18:15:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f68faffd700 1 -- 172.21.15.12:0/3834823533 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f400bb20 con 0x7f68fc0afc40 2023-07-07T18:15:18.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f68faffd700 1 -- 172.21.15.12:0/3834823533 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4012430 con 0x7f68fc0afc40 2023-07-07T18:15:18.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f6902863700 1 -- 172.21.15.12:0/3834823533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0afc40 msgr2=0x7f68fc15dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f6902863700 1 --2- 172.21.15.12:0/3834823533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0afc40 0x7f68fc15dc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009d90 tx=0x7f68f400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f6902863700 1 -- 172.21.15.12:0/3834823533 shutdown_connections 2023-07-07T18:15:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f6902863700 1 --2- 172.21.15.12:0/3834823533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0afc40 0x7f68fc15dc50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f6902863700 1 --2- 172.21.15.12:0/3834823533 >> v2:172.21.15.160:3300/0 conn(0x7f68fc0cd330 0x7f68fc070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f6902863700 1 -- 172.21.15.12:0/3834823533 >> 172.21.15.12:0/3834823533 conn(0x7f68fc06e5c0 msgr2=0x7f68fc06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:18.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f6902863700 1 -- 172.21.15.12:0/3834823533 shutdown_connections 2023-07-07T18:15:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.344+0000 7f6902863700 1 -- 172.21.15.12:0/3834823533 wait complete. 2023-07-07T18:15:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.346+0000 7f6902863700 1 Processor -- start 2023-07-07T18:15:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.346+0000 7f6902863700 1 -- start start 2023-07-07T18:15:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.346+0000 7f6902863700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc0afc40 0x7f68fc156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.346+0000 7f6902863700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0cd330 0x7f68fc0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.346+0000 7f6902863700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68fc15a330 0x7f68fc14abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f6902863700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15be20 con 0x7f68fc0afc40 2023-07-07T18:15:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f6902863700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0c8ca0 con 0x7f68fc15a330 2023-07-07T18:15:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f6902863700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15d660 con 0x7f68fc0cd330 2023-07-07T18:15:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc0afc40 0x7f68fc156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fb7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0cd330 0x7f68fc0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc0afc40 0x7f68fc156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57790/0 (socket says 172.21.15.12:57790) 2023-07-07T18:15:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fbfff700 1 -- 172.21.15.12:0/2413504230 learned_addr learned my addr 172.21.15.12:0/2413504230 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:18.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f6900e00700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68fc15a330 0x7f68fc14abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fbfff700 1 -- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0cd330 msgr2=0x7f68fc0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fbfff700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0cd330 0x7f68fc0b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fbfff700 1 -- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68fc15a330 msgr2=0x7f68fc14abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fbfff700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68fc15a330 0x7f68fc14abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fbfff700 1 -- 172.21.15.12:0/2413504230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec0094a0 con 0x7f68fc0afc40 2023-07-07T18:15:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68fbfff700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc0afc40 0x7f68fc156330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00ebe0 tx=0x7f68ec00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68f8ff9700 1 -- 172.21.15.12:0/2413504230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00c850 con 0x7f68fc0afc40 2023-07-07T18:15:18.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68f8ff9700 1 -- 172.21.15.12:0/2413504230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec00c9b0 con 0x7f68fc0afc40 2023-07-07T18:15:18.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f68f8ff9700 1 -- 172.21.15.12:0/2413504230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec00cd40 con 0x7f68fc0afc40 2023-07-07T18:15:18.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f4009a70 con 0x7f68fc0afc40 2023-07-07T18:15:18.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.347+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc0c9470 con 0x7f68fc0afc40 2023-07-07T18:15:18.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.348+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc0c8fc0 con 0x7f68fc0afc40 2023-07-07T18:15:18.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.349+0000 7f68f8ff9700 1 -- 172.21.15.12:0/2413504230 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f68ec013470 con 0x7f68fc0afc40 2023-07-07T18:15:18.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.349+0000 7f68f8ff9700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f68e806ad10 0x7f68e806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.349+0000 7f68f8ff9700 1 -- 172.21.15.12:0/2413504230 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f68ec089770 con 0x7f68fc0afc40 2023-07-07T18:15:18.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.350+0000 7f68fb7fe700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f68e806ad10 0x7f68e806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.350+0000 7f68fb7fe700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f68e806ad10 0x7f68e806d1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68fc159880 tx=0x7f68f0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:18.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.354+0000 7f68f8ff9700 1 -- 172.21.15.12:0/2413504230 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68ec0545c0 con 0x7f68fc0afc40 2023-07-07T18:15:18.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.550+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f68fc04ea20 con 0x7f68fc0afc40 2023-07-07T18:15:18.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.551+0000 7f68f8ff9700 1 -- 172.21.15.12:0/2413504230 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f68ec00cea0 con 0x7f68fc0afc40 2023-07-07T18:15:18.553 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.552+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f68e806ad10 msgr2=0x7f68e806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.552+0000 7f6902863700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f68e806ad10 0x7f68e806d1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f68fc159880 tx=0x7f68f0007de0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.552+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc0afc40 msgr2=0x7f68fc156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.552+0000 7f6902863700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc0afc40 0x7f68fc156330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00ebe0 tx=0x7f68ec00eef0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.552+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 shutdown_connections 2023-07-07T18:15:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.552+0000 7f6902863700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f68e806ad10 0x7f68e806d1c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.553+0000 7f6902863700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68fc15a330 0x7f68fc14abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.553+0000 7f6902863700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68fc0afc40 0x7f68fc156330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.553+0000 7f6902863700 1 --2- 172.21.15.12:0/2413504230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68fc0cd330 0x7f68fc0b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.553+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 >> 172.21.15.12:0/2413504230 conn(0x7f68fc06e5c0 msgr2=0x7f68fc0ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.553+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 shutdown_connections 2023-07-07T18:15:18.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.553+0000 7f6902863700 1 -- 172.21.15.12:0/2413504230 wait complete. 2023-07-07T18:15:18.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:15:18.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.689+0000 7fac0f352700 1 Processor -- start 2023-07-07T18:15:18.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.689+0000 7fac0f352700 1 -- start start 2023-07-07T18:15:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.690+0000 7fac0f352700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0815c570 0x7fac080cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.690+0000 7fac0f352700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fac08160a50 0x7fac080d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.690+0000 7fac0f352700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac081610a0 con 0x7fac080cd660 2023-07-07T18:15:18.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.690+0000 7fac0f352700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0815d670 con 0x7fac08160a50 2023-07-07T18:15:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.690+0000 7fac0f352700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac08160eb0 con 0x7fac0815c570 2023-07-07T18:15:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.690+0000 7fac0c8ed700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fac080cd660 0x7fac08160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54998/0 (socket says 172.21.15.12:54998) 2023-07-07T18:15:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.690+0000 7fac0c8ed700 1 -- 172.21.15.12:0/1194797675 learned_addr learned my addr 172.21.15.12:0/1194797675 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fac0d8ef700 1 --2- 172.21.15.12:0/1194797675 >> v2:172.21.15.160:3300/0 conn(0x7fac08160a50 0x7fac080d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fac0d0ee700 1 --2- 172.21.15.12:0/1194797675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0815c570 0x7fac080cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fabfffff700 1 -- 172.21.15.12:0/1194797675 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314486576 0 0) 0x7fac081610a0 con 0x7fac080cd660 2023-07-07T18:15:18.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fabfffff700 1 -- 172.21.15.12:0/1194797675 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf40035b0 con 0x7fac080cd660 2023-07-07T18:15:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fac0d0ee700 1 -- 172.21.15.12:0/1194797675 >> v2:172.21.15.160:3300/0 conn(0x7fac08160a50 msgr2=0x7fac080d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fabfffff700 1 -- 172.21.15.12:0/1194797675 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851653135 0 0) 0x7fabf40035b0 con 0x7fac080cd660 2023-07-07T18:15:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fac0d0ee700 1 --2- 172.21.15.12:0/1194797675 >> v2:172.21.15.160:3300/0 conn(0x7fac08160a50 0x7fac080d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fac0d0ee700 1 -- 172.21.15.12:0/1194797675 >> v1:172.21.15.12:6789/0 conn(0x7fac080cd660 legacy=0x7fac08160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fac0d0ee700 1 -- 172.21.15.12:0/1194797675 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0815da90 con 0x7fac0815c570 2023-07-07T18:15:18.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fac0d8ef700 1 --2- 172.21.15.12:0/1194797675 >> v2:172.21.15.160:3300/0 conn(0x7fac08160a50 0x7fac080d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:18.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fac0d0ee700 1 --2- 172.21.15.12:0/1194797675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0815c570 0x7fac080cd120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fac00009840 tx=0x7fac00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c099d6ee658a3ae server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:18.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fabfffff700 1 -- 172.21.15.12:0/1194797675 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8001670 con 0x7fac0815c570 2023-07-07T18:15:18.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fabfffff700 1 -- 172.21.15.12:0/1194797675 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00004030 con 0x7fac0815c570 2023-07-07T18:15:18.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.691+0000 7fabfffff700 1 -- 172.21.15.12:0/1194797675 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac000043c0 con 0x7fac0815c570 2023-07-07T18:15:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.692+0000 7fac0f352700 1 -- 172.21.15.12:0/1194797675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0815c570 msgr2=0x7fac080cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.692+0000 7fac0f352700 1 --2- 172.21.15.12:0/1194797675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0815c570 0x7fac080cd120 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fac00009840 tx=0x7fac00009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.692+0000 7fac0f352700 1 -- 172.21.15.12:0/1194797675 shutdown_connections 2023-07-07T18:15:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.692+0000 7fac0f352700 1 --2- 172.21.15.12:0/1194797675 >> v2:172.21.15.160:3300/0 conn(0x7fac08160a50 0x7fac080d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.692+0000 7fac0f352700 1 --2- 172.21.15.12:0/1194797675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0815c570 0x7fac080cd120 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.692+0000 7fac0f352700 1 -- 172.21.15.12:0/1194797675 >> 172.21.15.12:0/1194797675 conn(0x7fac08071620 msgr2=0x7fac080719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.692+0000 7fac0f352700 1 -- 172.21.15.12:0/1194797675 shutdown_connections 2023-07-07T18:15:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.692+0000 7fac0f352700 1 -- 172.21.15.12:0/1194797675 wait complete. 2023-07-07T18:15:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.693+0000 7fac0f352700 1 Processor -- start 2023-07-07T18:15:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.693+0000 7fac0f352700 1 -- start start 2023-07-07T18:15:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0f352700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080cd660 0x7fac080ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0f352700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac0815c570 0x7fac080b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0f352700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac08160a50 0x7fac081f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0f352700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08150880 con 0x7fac0815c570 2023-07-07T18:15:18.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0f352700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac081fa290 con 0x7fac080cd660 2023-07-07T18:15:18.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0f352700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac081fa4c0 con 0x7fac08160a50 2023-07-07T18:15:18.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0c8ed700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac0815c570 0x7fac080b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0c8ed700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac0815c570 0x7fac080b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57806/0 (socket says 172.21.15.12:57806) 2023-07-07T18:15:18.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0c8ed700 1 -- 172.21.15.12:0/1952998154 learned_addr learned my addr 172.21.15.12:0/1952998154 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:18.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0d0ee700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080cd660 0x7fac080ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0d8ef700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac08160a50 0x7fac081f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0c8ed700 1 -- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac08160a50 msgr2=0x7fac081f9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0c8ed700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac08160a50 0x7fac081f9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0c8ed700 1 -- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080cd660 msgr2=0x7fac080ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0c8ed700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080cd660 0x7fac080ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0c8ed700 1 -- 172.21.15.12:0/1952998154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac04009a70 con 0x7fac0815c570 2023-07-07T18:15:18.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.694+0000 7fac0c8ed700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac0815c570 0x7fac080b5c30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c780 tx=0x7fabf800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:18.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.695+0000 7fabfdffb700 1 -- 172.21.15.12:0/1952998154 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8004c80 con 0x7fac0815c570 2023-07-07T18:15:18.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.695+0000 7fabfdffb700 1 -- 172.21.15.12:0/1952998154 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8004de0 con 0x7fac0815c570 2023-07-07T18:15:18.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.695+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac000094a0 con 0x7fac0815c570 2023-07-07T18:15:18.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.695+0000 7fabfdffb700 1 -- 172.21.15.12:0/1952998154 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf80072f0 con 0x7fac0815c570 2023-07-07T18:15:18.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.695+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac081faa80 con 0x7fac0815c570 2023-07-07T18:15:18.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.696+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac081faca0 con 0x7fac0815c570 2023-07-07T18:15:18.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.696+0000 7fabfdffb700 1 -- 172.21.15.12:0/1952998154 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabf8007450 con 0x7fac0815c570 2023-07-07T18:15:18.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.696+0000 7fabfdffb700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fabec06ace0 0x7fabec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:18.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.697+0000 7fabfdffb700 1 -- 172.21.15.12:0/1952998154 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fabf8088d90 con 0x7fac0815c570 2023-07-07T18:15:18.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.697+0000 7fac0d0ee700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fabec06ace0 0x7fabec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:18.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.697+0000 7fac0d0ee700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fabec06ace0 0x7fabec06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac0000a010 tx=0x7fac00008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:18.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.701+0000 7fabfdffb700 1 -- 172.21.15.12:0/1952998154 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fabf8053b50 con 0x7fac0815c570 2023-07-07T18:15:18.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.943+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac08073910 con 0x7fac0815c570 2023-07-07T18:15:18.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.943+0000 7fabfdffb700 1 -- 172.21.15.12:0/1952998154 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fabf8018090 con 0x7fac0815c570 2023-07-07T18:15:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:18.946 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:15:09.693432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-07T18:15:18.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fabec06ace0 msgr2=0x7fabec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fabec06ace0 0x7fabec06d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac0000a010 tx=0x7fac00008030 comp rx=0 tx=0).stop 2023-07-07T18:15:18.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac0815c570 msgr2=0x7fac080b5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:18.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac0815c570 0x7fac080b5c30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c780 tx=0x7fabf800cb40 comp rx=0 tx=0).stop 2023-07-07T18:15:18.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 shutdown_connections 2023-07-07T18:15:18.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fabec06ace0 0x7fabec06d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac08160a50 0x7fac081f9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080cd660 0x7fac080ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 --2- 172.21.15.12:0/1952998154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac0815c570 0x7fac080b5c30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:18.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.945+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 >> 172.21.15.12:0/1952998154 conn(0x7fac08071620 msgr2=0x7fac080cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:18.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.946+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 shutdown_connections 2023-07-07T18:15:18.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:18.946+0000 7fac0f352700 1 -- 172.21.15.12:0/1952998154 wait complete. 2023-07-07T18:15:18.951 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2023-07-07T18:15:18.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:19.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.082+0000 7fa0b193e700 1 Processor -- start 2023-07-07T18:15:19.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.082+0000 7fa0b193e700 1 -- start start 2023-07-07T18:15:19.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0b193e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0ac15c570 0x7fa0ac0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0b193e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 0x7fa0ac0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0b193e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ac1610a0 con 0x7fa0ac0cd660 2023-07-07T18:15:19.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0b193e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ac15d670 con 0x7fa0ac15c570 2023-07-07T18:15:19.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0b193e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac160eb0 con 0x7fa0ac160a50 2023-07-07T18:15:19.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0aaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0ac15c570 0x7fa0ac0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0aaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa0ac15c570 0x7fa0ac0cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57812/0 (socket says 172.21.15.12:57812) 2023-07-07T18:15:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0aaffd700 1 -- 172.21.15.12:0/2473239810 learned_addr learned my addr 172.21.15.12:0/2473239810 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0ab7fe700 1 --2- 172.21.15.12:0/2473239810 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 0x7fa0ac0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0aaffd700 1 -- 172.21.15.12:0/2473239810 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 msgr2=0x7fa0ac0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0aaffd700 1 --2- 172.21.15.12:0/2473239810 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 0x7fa0ac0d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0aaffd700 1 -- 172.21.15.12:0/2473239810 >> v1:172.21.15.160:6789/0 conn(0x7fa0ac0cd660 legacy=0x7fa0ac160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0aaffd700 1 -- 172.21.15.12:0/2473239810 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac15da90 con 0x7fa0ac15c570 2023-07-07T18:15:19.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0ab7fe700 1 --2- 172.21.15.12:0/2473239810 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 0x7fa0ac0d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0aaffd700 1 --2- 172.21.15.12:0/2473239810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac15c570 0x7fa0ac0cd120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009920 tx=0x7fa0a0009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1171fe1a5ffb56b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0a9ffb700 1 -- 172.21.15.12:0/2473239810 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0004230 con 0x7fa0ac15c570 2023-07-07T18:15:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.083+0000 7fa0a9ffb700 1 -- 172.21.15.12:0/2473239810 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a0004390 con 0x7fa0ac15c570 2023-07-07T18:15:19.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.084+0000 7fa0a9ffb700 1 -- 172.21.15.12:0/2473239810 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0009e70 con 0x7fa0ac15c570 2023-07-07T18:15:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.084+0000 7fa0b193e700 1 -- 172.21.15.12:0/2473239810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac15c570 msgr2=0x7fa0ac0cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.084+0000 7fa0b193e700 1 --2- 172.21.15.12:0/2473239810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac15c570 0x7fa0ac0cd120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009920 tx=0x7fa0a0009c30 comp rx=0 tx=0).stop 2023-07-07T18:15:19.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.084+0000 7fa0b193e700 1 -- 172.21.15.12:0/2473239810 shutdown_connections 2023-07-07T18:15:19.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.084+0000 7fa0b193e700 1 --2- 172.21.15.12:0/2473239810 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 0x7fa0ac0d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.084+0000 7fa0b193e700 1 --2- 172.21.15.12:0/2473239810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac15c570 0x7fa0ac0cd120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.084+0000 7fa0b193e700 1 -- 172.21.15.12:0/2473239810 >> 172.21.15.12:0/2473239810 conn(0x7fa0ac071620 msgr2=0x7fa0ac0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:19.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.084+0000 7fa0b193e700 1 -- 172.21.15.12:0/2473239810 shutdown_connections 2023-07-07T18:15:19.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.084+0000 7fa0b193e700 1 -- 172.21.15.12:0/2473239810 wait complete. 2023-07-07T18:15:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.086+0000 7fa0b193e700 1 Processor -- start 2023-07-07T18:15:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.086+0000 7fa0b193e700 1 -- start start 2023-07-07T18:15:19.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0b193e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac0cd660 0x7fa0ac0b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0b193e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0ac15c570 0x7fa0ac0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0b193e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 0x7fa0ac0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0b193e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0c7930 con 0x7fa0ac0cd660 2023-07-07T18:15:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0b193e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0c7c10 con 0x7fa0ac15c570 2023-07-07T18:15:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0b193e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0c7ef0 con 0x7fa0ac160a50 2023-07-07T18:15:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac0cd660 0x7fa0ac0b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac0cd660 0x7fa0ac0b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57818/0 (socket says 172.21.15.12:57818) 2023-07-07T18:15:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aaffd700 1 -- 172.21.15.12:0/2028469129 learned_addr learned my addr 172.21.15.12:0/2028469129 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0ab7fe700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 0x7fa0ac0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aa7fc700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0ac15c570 0x7fa0ac0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aaffd700 1 -- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 msgr2=0x7fa0ac0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aaffd700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 0x7fa0ac0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aaffd700 1 -- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0ac15c570 msgr2=0x7fa0ac0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aaffd700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0ac15c570 0x7fa0ac0cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aaffd700 1 -- 172.21.15.12:0/2028469129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0009550 con 0x7fa0ac0cd660 2023-07-07T18:15:19.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.087+0000 7fa0aaffd700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac0cd660 0x7fa0ac0b5b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009fd0 tx=0x7fa0a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:19.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.088+0000 7fa093fff700 1 -- 172.21.15.12:0/2028469129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000bc20 con 0x7fa0ac0cd660 2023-07-07T18:15:19.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.088+0000 7fa093fff700 1 -- 172.21.15.12:0/2028469129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a001f070 con 0x7fa0ac0cd660 2023-07-07T18:15:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.088+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac0c81d0 con 0x7fa0ac0cd660 2023-07-07T18:15:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.088+0000 7fa093fff700 1 -- 172.21.15.12:0/2028469129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00036a0 con 0x7fa0ac0cd660 2023-07-07T18:15:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.088+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac150970 con 0x7fa0ac0cd660 2023-07-07T18:15:19.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.089+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0ac0c68e0 con 0x7fa0ac0cd660 2023-07-07T18:15:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.089+0000 7fa093fff700 1 -- 172.21.15.12:0/2028469129 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0a0021030 con 0x7fa0ac0cd660 2023-07-07T18:15:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.090+0000 7fa093fff700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa09806ace0 0x7fa09806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.090+0000 7fa093fff700 1 -- 172.21.15.12:0/2028469129 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa0a008aca0 con 0x7fa0ac0cd660 2023-07-07T18:15:19.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.090+0000 7fa0aa7fc700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa09806ace0 0x7fa09806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.090+0000 7fa0aa7fc700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa09806ace0 0x7fa09806d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0b4c00 tx=0x7fa09c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.094+0000 7fa093fff700 1 -- 172.21.15.12:0/2028469129 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa0ac0c68e0 con 0x7fa0ac0cd660 2023-07-07T18:15:19.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.292+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0ac0c68e0 con 0x7fa0ac0cd660 2023-07-07T18:15:19.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.293+0000 7fa093fff700 1 -- 172.21.15.12:0/2028469129 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fa0ac0c68e0 con 0x7fa0ac0cd660 2023-07-07T18:15:19.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:19.296 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:19.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.295+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa09806ace0 msgr2=0x7fa09806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.295+0000 7fa0b193e700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa09806ace0 0x7fa09806d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac0b4c00 tx=0x7fa09c007ec0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.295+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac0cd660 msgr2=0x7fa0ac0b5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.295+0000 7fa0b193e700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac0cd660 0x7fa0ac0b5b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009fd0 tx=0x7fa0a0004750 comp rx=0 tx=0).stop 2023-07-07T18:15:19.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.296+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 shutdown_connections 2023-07-07T18:15:19.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.296+0000 7fa0b193e700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa09806ace0 0x7fa09806d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.296+0000 7fa0b193e700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa0ac160a50 0x7fa0ac0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.296+0000 7fa0b193e700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0ac0cd660 0x7fa0ac0b5b40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.296+0000 7fa0b193e700 1 --2- 172.21.15.12:0/2028469129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa0ac15c570 0x7fa0ac0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.296+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 >> 172.21.15.12:0/2028469129 conn(0x7fa0ac071620 msgr2=0x7fa0ac15ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:19.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.296+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 shutdown_connections 2023-07-07T18:15:19.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.296+0000 7fa0b193e700 1 -- 172.21.15.12:0/2028469129 wait complete. 2023-07-07T18:15:19.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:19.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.438+0000 7fb90b981700 1 Processor -- start 2023-07-07T18:15:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.438+0000 7fb90b981700 1 -- start start 2023-07-07T18:15:19.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.439+0000 7fb90b981700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb90415a330 0x7fb904070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.439+0000 7fb90b981700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9040afc40 0x7fb90415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.439+0000 7fb90b981700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9040caf70 con 0x7fb9040cd330 2023-07-07T18:15:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.439+0000 7fb90b981700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9040cb210 con 0x7fb9040afc40 2023-07-07T18:15:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.439+0000 7fb90b981700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040ccc20 con 0x7fb90415a330 2023-07-07T18:15:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.439+0000 7fb909f1e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9040afc40 0x7fb90415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.439+0000 7fb909f1e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9040afc40 0x7fb90415dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57830/0 (socket says 172.21.15.12:57830) 2023-07-07T18:15:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.439+0000 7fb909f1e700 1 -- 172.21.15.12:0/3073446134 learned_addr learned my addr 172.21.15.12:0/3073446134 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb908f1c700 1 --2- 172.21.15.12:0/3073446134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb90415a330 0x7fb904070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb909f1e700 1 -- 172.21.15.12:0/3073446134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb90415a330 msgr2=0x7fb904070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb909f1e700 1 --2- 172.21.15.12:0/3073446134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb90415a330 0x7fb904070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb909f1e700 1 -- 172.21.15.12:0/3073446134 >> v1:172.21.15.160:6789/0 conn(0x7fb9040cd330 legacy=0x7fb9040cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb909f1e700 1 -- 172.21.15.12:0/3073446134 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9040ccf00 con 0x7fb9040afc40 2023-07-07T18:15:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb909f1e700 1 --2- 172.21.15.12:0/3073446134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 0x7fb90415dc50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009e50 tx=0x7fb8fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555265d453ee8b0b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb8fbfff700 1 -- 172.21.15.12:0/3073446134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00e070 con 0x7fb9040afc40 2023-07-07T18:15:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb8fbfff700 1 -- 172.21.15.12:0/3073446134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc003a20 con 0x7fb9040afc40 2023-07-07T18:15:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb8fbfff700 1 -- 172.21.15.12:0/3073446134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc003dd0 con 0x7fb9040afc40 2023-07-07T18:15:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb90b981700 1 -- 172.21.15.12:0/3073446134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 msgr2=0x7fb90415dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.440+0000 7fb90b981700 1 --2- 172.21.15.12:0/3073446134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 0x7fb90415dc50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009e50 tx=0x7fb8fc00b330 comp rx=0 tx=0).stop 2023-07-07T18:15:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.441+0000 7fb90b981700 1 -- 172.21.15.12:0/3073446134 shutdown_connections 2023-07-07T18:15:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.441+0000 7fb90b981700 1 --2- 172.21.15.12:0/3073446134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 0x7fb90415dc50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.441+0000 7fb90b981700 1 --2- 172.21.15.12:0/3073446134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb90415a330 0x7fb904070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.441+0000 7fb90b981700 1 -- 172.21.15.12:0/3073446134 >> 172.21.15.12:0/3073446134 conn(0x7fb90406e5c0 msgr2=0x7fb90406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.441+0000 7fb90b981700 1 -- 172.21.15.12:0/3073446134 shutdown_connections 2023-07-07T18:15:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.441+0000 7fb90b981700 1 -- 172.21.15.12:0/3073446134 wait complete. 2023-07-07T18:15:19.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.442+0000 7fb90b981700 1 Processor -- start 2023-07-07T18:15:19.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.442+0000 7fb90b981700 1 -- start start 2023-07-07T18:15:19.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90b981700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 0x7fb90406cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90b981700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9040cd330 0x7fb9040c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90b981700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb90415a330 0x7fb90415c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90b981700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040c6df0 con 0x7fb9040afc40 2023-07-07T18:15:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90b981700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040c5d50 con 0x7fb90415a330 2023-07-07T18:15:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90b981700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9040c6030 con 0x7fb9040cd330 2023-07-07T18:15:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90971d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 0x7fb90406cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90971d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 0x7fb90406cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57832/0 (socket says 172.21.15.12:57832) 2023-07-07T18:15:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90971d700 1 -- 172.21.15.12:0/612691462 learned_addr learned my addr 172.21.15.12:0/612691462 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb908f1c700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9040cd330 0x7fb9040c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb909f1e700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb90415a330 0x7fb90415c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90971d700 1 -- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9040cd330 msgr2=0x7fb9040c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90971d700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9040cd330 0x7fb9040c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90971d700 1 -- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb90415a330 msgr2=0x7fb90415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90971d700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb90415a330 0x7fb90415c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90971d700 1 -- 172.21.15.12:0/612691462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc009b30 con 0x7fb9040afc40 2023-07-07T18:15:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb908f1c700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9040cd330 0x7fb9040c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb909f1e700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb90415a330 0x7fb90415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90971d700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 0x7fb90406cc90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400c4d0 tx=0x7fb8f400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb8f9ffb700 1 -- 172.21.15.12:0/612691462 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4011790 con 0x7fb9040afc40 2023-07-07T18:15:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb8f9ffb700 1 -- 172.21.15.12:0/612691462 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f40118f0 con 0x7fb9040afc40 2023-07-07T18:15:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9040c6310 con 0x7fb9040afc40 2023-07-07T18:15:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.443+0000 7fb8f9ffb700 1 -- 172.21.15.12:0/612691462 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4011ca0 con 0x7fb9040afc40 2023-07-07T18:15:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.444+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9040c68d0 con 0x7fb9040afc40 2023-07-07T18:15:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.445+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90404ea20 con 0x7fb9040afc40 2023-07-07T18:15:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.445+0000 7fb8f9ffb700 1 -- 172.21.15.12:0/612691462 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8f401c460 con 0x7fb9040afc40 2023-07-07T18:15:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.445+0000 7fb8f9ffb700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8e806ace0 0x7fb8e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.446+0000 7fb8f9ffb700 1 -- 172.21.15.12:0/612691462 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb8f4089590 con 0x7fb9040afc40 2023-07-07T18:15:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.446+0000 7fb908f1c700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8e806ace0 0x7fb8e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.446+0000 7fb908f1c700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8e806ace0 0x7fb8e806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb9040d0660 tx=0x7fb900008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.450+0000 7fb8f9ffb700 1 -- 172.21.15.12:0/612691462 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8f40543e0 con 0x7fb9040afc40 2023-07-07T18:15:19.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.646+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9040cdbf0 con 0x7fb9040afc40 2023-07-07T18:15:19.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.647+0000 7fb8f9ffb700 1 -- 172.21.15.12:0/612691462 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8f4057a00 con 0x7fb9040afc40 2023-07-07T18:15:19.650 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:19.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8e806ace0 msgr2=0x7fb8e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8e806ace0 0x7fb8e806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb9040d0660 tx=0x7fb900008040 comp rx=0 tx=0).stop 2023-07-07T18:15:19.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 msgr2=0x7fb90406cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 0x7fb90406cc90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400c4d0 tx=0x7fb8f400c890 comp rx=0 tx=0).stop 2023-07-07T18:15:19.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 shutdown_connections 2023-07-07T18:15:19.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8e806ace0 0x7fb8e806d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb90415a330 0x7fb90415c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9040afc40 0x7fb90406cc90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 --2- 172.21.15.12:0/612691462 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9040cd330 0x7fb9040c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 >> 172.21.15.12:0/612691462 conn(0x7fb90406e5c0 msgr2=0x7fb9040b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:19.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 shutdown_connections 2023-07-07T18:15:19.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.649+0000 7fb90b981700 1 -- 172.21.15.12:0/612691462 wait complete. 2023-07-07T18:15:19.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.791+0000 7fb5b37fe700 1 Processor -- start 2023-07-07T18:15:19.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.791+0000 7fb5b37fe700 1 -- start start 2023-07-07T18:15:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.792+0000 7fb5b37fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb5ac15d2d0 0x7fb5ac06cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.792+0000 7fb5b37fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac15c720 con 0x7fb5ac06b000 2023-07-07T18:15:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.792+0000 7fb5b37fe700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac0d03a0 con 0x7fb5ac0b23a0 2023-07-07T18:15:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.792+0000 7fb5b37fe700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac15d820 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.792+0000 7fb5b1d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb5ac06b000 0x7fb5ac06b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55042/0 (socket says 172.21.15.12:55042) 2023-07-07T18:15:19.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.792+0000 7fb5b1d9b700 1 -- 172.21.15.12:0/861004230 learned_addr learned my addr 172.21.15.12:0/861004230 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.792+0000 7fb5b0d99700 1 --2- 172.21.15.12:0/861004230 >> v2:172.21.15.160:3300/0 conn(0x7fb5ac15d2d0 0x7fb5ac06cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.792+0000 7fb5a3fff700 1 -- 172.21.15.12:0/861004230 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227876192 0 0) 0x7fb5a4001490 con 0x7fb5ac06b000 2023-07-07T18:15:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.792+0000 7fb5a3fff700 1 -- 172.21.15.12:0/861004230 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5980035b0 con 0x7fb5ac06b000 2023-07-07T18:15:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.793+0000 7fb5b0d99700 1 -- 172.21.15.12:0/861004230 >> v1:172.21.15.160:6789/0 conn(0x7fb5ac0b23a0 legacy=0x7fb5ac0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.793+0000 7fb5a3fff700 1 -- 172.21.15.12:0/861004230 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79341295 0 0) 0x7fb5ac0d03a0 con 0x7fb5ac0b23a0 2023-07-07T18:15:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.793+0000 7fb5b0d99700 1 -- 172.21.15.12:0/861004230 >> v1:172.21.15.12:6789/0 conn(0x7fb5ac06b000 legacy=0x7fb5ac06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.793+0000 7fb5b0d99700 1 -- 172.21.15.12:0/861004230 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac0ce690 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.793+0000 7fb5b0d99700 1 --2- 172.21.15.12:0/861004230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac06cc60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009840 tx=0x7fb5a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d75a77ce0b7878ef server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.793+0000 7fb5a3fff700 1 -- 172.21.15.12:0/861004230 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8011830 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.793+0000 7fb5a3fff700 1 -- 172.21.15.12:0/861004230 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a8011990 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.793+0000 7fb5a3fff700 1 -- 172.21.15.12:0/861004230 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8011d20 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.794+0000 7fb5b37fe700 1 -- 172.21.15.12:0/861004230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ac15d2d0 msgr2=0x7fb5ac06cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.794+0000 7fb5b37fe700 1 --2- 172.21.15.12:0/861004230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac06cc60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009840 tx=0x7fb5a8009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:19.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.794+0000 7fb5b37fe700 1 -- 172.21.15.12:0/861004230 shutdown_connections 2023-07-07T18:15:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.794+0000 7fb5b37fe700 1 --2- 172.21.15.12:0/861004230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac06cc60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.794+0000 7fb5b37fe700 1 -- 172.21.15.12:0/861004230 >> 172.21.15.12:0/861004230 conn(0x7fb5ac06e5c0 msgr2=0x7fb5ac06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.794+0000 7fb5b37fe700 1 -- 172.21.15.12:0/861004230 shutdown_connections 2023-07-07T18:15:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.794+0000 7fb5b37fe700 1 -- 172.21.15.12:0/861004230 wait complete. 2023-07-07T18:15:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.795+0000 7fb5b37fe700 1 Processor -- start 2023-07-07T18:15:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.795+0000 7fb5b37fe700 1 -- start start 2023-07-07T18:15:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ac06b000 0x7fb5ac0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b37fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ac0b23a0 0x7fb5ac1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b37fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1f3910 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b37fe700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1f3bf0 con 0x7fb5ac06b000 2023-07-07T18:15:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b37fe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1f3ed0 con 0x7fb5ac0b23a0 2023-07-07T18:15:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1f2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57850/0 (socket says 172.21.15.12:57850) 2023-07-07T18:15:19.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b1d9b700 1 -- 172.21.15.12:0/3956545105 learned_addr learned my addr 172.21.15.12:0/3956545105 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b159a700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ac06b000 0x7fb5ac0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b0d99700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ac0b23a0 0x7fb5ac1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b1d9b700 1 -- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ac0b23a0 msgr2=0x7fb5ac1f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b1d9b700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ac0b23a0 0x7fb5ac1f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b1d9b700 1 -- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ac06b000 msgr2=0x7fb5ac0b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b1d9b700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ac06b000 0x7fb5ac0b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b1d9b700 1 -- 172.21.15.12:0/3956545105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a80094a0 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b1d9b700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1f2ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400cae0 tx=0x7fb5a400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5a1ffb700 1 -- 172.21.15.12:0/3956545105 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a400aa80 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5a1ffb700 1 -- 172.21.15.12:0/3956545105 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a400abe0 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.796+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac1f41b0 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.797+0000 7fb5a1ffb700 1 -- 172.21.15.12:0/3956545105 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4012400 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.797+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac0b1770 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.798+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac04ea20 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.798+0000 7fb5a1ffb700 1 -- 172.21.15.12:0/3956545105 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb5a401b3b0 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.798+0000 7fb5a1ffb700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb59006ace0 0x7fb59006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.798+0000 7fb5a1ffb700 1 -- 172.21.15.12:0/3956545105 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5a4089330 con 0x7fb5ac15d2d0 2023-07-07T18:15:19.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.799+0000 7fb5b159a700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb59006ace0 0x7fb59006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:19.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.799+0000 7fb5b159a700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb59006ace0 0x7fb59006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb59c000f60 tx=0x7fb59c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:19.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.803+0000 7fb5a1ffb700 1 -- 172.21.15.12:0/3956545105 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb5a40540f0 con 0x7fb5ac15d2d0 2023-07-07T18:15:20.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.999+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb5ac15c700 con 0x7fb5ac15d2d0 2023-07-07T18:15:20.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:19.999+0000 7fb5a1ffb700 1 -- 172.21.15.12:0/3956545105 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb5a4001b70 con 0x7fb5ac15d2d0 2023-07-07T18:15:20.002 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:20.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb59006ace0 msgr2=0x7fb59006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb59006ace0 0x7fb59006d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb59c000f60 tx=0x7fb59c009040 comp rx=0 tx=0).stop 2023-07-07T18:15:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5ac15d2d0 msgr2=0x7fb5ac1f2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1f2ec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400cae0 tx=0x7fb5a400cea0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 shutdown_connections 2023-07-07T18:15:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb59006ace0 0x7fb59006d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5ac15d2d0 0x7fb5ac1f2ec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5ac06b000 0x7fb5ac0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 --2- 172.21.15.12:0/3956545105 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5ac0b23a0 0x7fb5ac1f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.001+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 >> 172.21.15.12:0/3956545105 conn(0x7fb5ac06e5c0 msgr2=0x7fb5ac15edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:20.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.002+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 shutdown_connections 2023-07-07T18:15:20.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.002+0000 7fb5b37fe700 1 -- 172.21.15.12:0/3956545105 wait complete. 2023-07-07T18:15:20.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:20.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.141+0000 7fb4c08b9700 1 Processor -- start 2023-07-07T18:15:20.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.141+0000 7fb4c08b9700 1 -- start start 2023-07-07T18:15:20.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4c08b9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb4bc070dc0 0x7fb4bc071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4c08b9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4bc0cb560 0x7fb4bc15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4c08b9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc0cac60 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4c08b9700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc15dca0 con 0x7fb4bc0cb560 2023-07-07T18:15:20.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4c08b9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc0cb9e0 con 0x7fb4bc070dc0 2023-07-07T18:15:20.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4bad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4bc0cb560 0x7fb4bc15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4bad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4bc0cb560 0x7fb4bc15cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57858/0 (socket says 172.21.15.12:57858) 2023-07-07T18:15:20.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4bad9d700 1 -- 172.21.15.12:0/2852662867 learned_addr learned my addr 172.21.15.12:0/2852662867 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:20.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4b9d9b700 1 --1- 172.21.15.12:0/2852662867 >> v1:172.21.15.12:6789/0 conn(0x7fb4bc0cb0f0 0x7fb4bc069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55052/0 (socket says 172.21.15.12:55052) 2023-07-07T18:15:20.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4ba59c700 1 --2- 172.21.15.12:0/2852662867 >> v2:172.21.15.160:3300/0 conn(0x7fb4bc070dc0 0x7fb4bc071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4bad9d700 1 -- 172.21.15.12:0/2852662867 >> v2:172.21.15.160:3300/0 conn(0x7fb4bc070dc0 msgr2=0x7fb4bc071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:20.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4bad9d700 1 --2- 172.21.15.12:0/2852662867 >> v2:172.21.15.160:3300/0 conn(0x7fb4bc070dc0 0x7fb4bc071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4bad9d700 1 -- 172.21.15.12:0/2852662867 >> v1:172.21.15.12:6789/0 conn(0x7fb4bc0cb0f0 legacy=0x7fb4bc069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4bad9d700 1 -- 172.21.15.12:0/2852662867 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc0ca370 con 0x7fb4bc0cb560 2023-07-07T18:15:20.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4b959a700 1 -- 172.21.15.12:0/2852662867 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337944121 0 0) 0x7fb4bc0cac60 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.142+0000 7fb4bad9d700 1 --2- 172.21.15.12:0/2852662867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb560 0x7fb4bc15cc90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0cbbf0 tx=0x7fb4b400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de8a92493cfe890 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:20.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4b959a700 1 -- 172.21.15.12:0/2852662867 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4010070 con 0x7fb4bc0cb560 2023-07-07T18:15:20.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4b959a700 1 -- 172.21.15.12:0/2852662867 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b400dce0 con 0x7fb4bc0cb560 2023-07-07T18:15:20.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4b959a700 1 -- 172.21.15.12:0/2852662867 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b400b310 con 0x7fb4bc0cb560 2023-07-07T18:15:20.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4c08b9700 1 -- 172.21.15.12:0/2852662867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb560 msgr2=0x7fb4bc15cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4c08b9700 1 --2- 172.21.15.12:0/2852662867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb560 0x7fb4bc15cc90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0cbbf0 tx=0x7fb4b400d430 comp rx=0 tx=0).stop 2023-07-07T18:15:20.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4c08b9700 1 -- 172.21.15.12:0/2852662867 shutdown_connections 2023-07-07T18:15:20.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4c08b9700 1 --2- 172.21.15.12:0/2852662867 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb560 0x7fb4bc15cc90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4c08b9700 1 --2- 172.21.15.12:0/2852662867 >> v2:172.21.15.160:3300/0 conn(0x7fb4bc070dc0 0x7fb4bc071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4c08b9700 1 -- 172.21.15.12:0/2852662867 >> 172.21.15.12:0/2852662867 conn(0x7fb4bc0b1990 msgr2=0x7fb4bc0cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:20.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4c08b9700 1 -- 172.21.15.12:0/2852662867 shutdown_connections 2023-07-07T18:15:20.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.143+0000 7fb4c08b9700 1 -- 172.21.15.12:0/2852662867 wait complete. 2023-07-07T18:15:20.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.145+0000 7fb4c08b9700 1 Processor -- start 2023-07-07T18:15:20.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.145+0000 7fb4c08b9700 1 -- start start 2023-07-07T18:15:20.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.145+0000 7fb4c08b9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4bc070dc0 0x7fb4bc1f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.145+0000 7fb4c08b9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb0f0 0x7fb4bc0ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.145+0000 7fb4c08b9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0cb560 0x7fb4bc0b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.145+0000 7fb4c08b9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc1f58a0 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.145+0000 7fb4c08b9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0ac240 con 0x7fb4bc0cb560 2023-07-07T18:15:20.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.145+0000 7fb4c08b9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc0ac520 con 0x7fb4bc070dc0 2023-07-07T18:15:20.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb0f0 0x7fb4bc0ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb0f0 0x7fb4bc0ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57862/0 (socket says 172.21.15.12:57862) 2023-07-07T18:15:20.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4b9d9b700 1 -- 172.21.15.12:0/477023939 learned_addr learned my addr 172.21.15.12:0/477023939 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:20.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4ba59c700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4bc070dc0 0x7fb4bc1f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4bad9d700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0cb560 0x7fb4bc0b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4b9d9b700 1 -- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4bc070dc0 msgr2=0x7fb4bc1f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4b9d9b700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4bc070dc0 0x7fb4bc1f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4b9d9b700 1 -- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0cb560 msgr2=0x7fb4bc0b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4b9d9b700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0cb560 0x7fb4bc0b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4b9d9b700 1 -- 172.21.15.12:0/477023939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b400bd40 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4b9d9b700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb0f0 0x7fb4bc0ab8d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00011e0 tx=0x7fb4b000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:20.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4aaffd700 1 -- 172.21.15.12:0/477023939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0004c80 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4aaffd700 1 -- 172.21.15.12:0/477023939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b0004e00 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc0ac800 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4aaffd700 1 -- 172.21.15.12:0/477023939 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0007310 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.146+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc0acdc0 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.147+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4bc0acfb0 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.148+0000 7fb4aaffd700 1 -- 172.21.15.12:0/477023939 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4b0007470 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.148+0000 7fb4aaffd700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb49c06ace0 0x7fb49c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.148+0000 7fb4aaffd700 1 -- 172.21.15.12:0/477023939 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb4b00894c0 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.149+0000 7fb4ba59c700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb49c06ace0 0x7fb49c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.149+0000 7fb4ba59c700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb49c06ace0 0x7fb49c06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009b40 tx=0x7fb4ac009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.153+0000 7fb4aaffd700 1 -- 172.21.15.12:0/477023939 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb4b00541e0 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.353+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4bc04ea20 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.353+0000 7fb4aaffd700 1 -- 172.21.15.12:0/477023939 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4b0057800 con 0x7fb4bc0cb0f0 2023-07-07T18:15:20.356 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:20.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb49c06ace0 msgr2=0x7fb49c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb49c06ace0 0x7fb49c06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009b40 tx=0x7fb4ac009210 comp rx=0 tx=0).stop 2023-07-07T18:15:20.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb0f0 msgr2=0x7fb4bc0ab8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb0f0 0x7fb4bc0ab8d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00011e0 tx=0x7fb4b000ca30 comp rx=0 tx=0).stop 2023-07-07T18:15:20.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 shutdown_connections 2023-07-07T18:15:20.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb49c06ace0 0x7fb49c06d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0cb560 0x7fb4bc0b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4bc070dc0 0x7fb4bc1f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 --2- 172.21.15.12:0/477023939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4bc0cb0f0 0x7fb4bc0ab8d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 >> 172.21.15.12:0/477023939 conn(0x7fb4bc0b1990 msgr2=0x7fb4bc0b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:20.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 shutdown_connections 2023-07-07T18:15:20.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.355+0000 7fb4c08b9700 1 -- 172.21.15.12:0/477023939 wait complete. 2023-07-07T18:15:20.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:20.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.497+0000 7fde144a8700 1 Processor -- start 2023-07-07T18:15:20.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.497+0000 7fde144a8700 1 -- start start 2023-07-07T18:15:20.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde144a8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde0c070dc0 0x7fde0c071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde144a8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fde0c0cb560 0x7fde0c15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde144a8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c0cac60 con 0x7fde0c0cb0f0 2023-07-07T18:15:20.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde144a8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c15dca0 con 0x7fde0c070dc0 2023-07-07T18:15:20.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde144a8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0cb9e0 con 0x7fde0c0cb560 2023-07-07T18:15:20.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde12244700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde0c070dc0 0x7fde0c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde11a43700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fde0c0cb0f0 0x7fde0c069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55066/0 (socket says 172.21.15.12:55066) 2023-07-07T18:15:20.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde11a43700 1 -- 172.21.15.12:0/1978840796 learned_addr learned my addr 172.21.15.12:0/1978840796 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:20.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde12a45700 1 --2- 172.21.15.12:0/1978840796 >> v2:172.21.15.160:3300/0 conn(0x7fde0c0cb560 0x7fde0c15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde12244700 1 -- 172.21.15.12:0/1978840796 >> v2:172.21.15.160:3300/0 conn(0x7fde0c0cb560 msgr2=0x7fde0c15cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:20.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde12244700 1 --2- 172.21.15.12:0/1978840796 >> v2:172.21.15.160:3300/0 conn(0x7fde0c0cb560 0x7fde0c15cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde12244700 1 -- 172.21.15.12:0/1978840796 >> v1:172.21.15.12:6789/0 conn(0x7fde0c0cb0f0 legacy=0x7fde0c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde12244700 1 -- 172.21.15.12:0/1978840796 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0ca370 con 0x7fde0c070dc0 2023-07-07T18:15:20.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde12a45700 1 --2- 172.21.15.12:0/1978840796 >> v2:172.21.15.160:3300/0 conn(0x7fde0c0cb560 0x7fde0c15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:20.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde11242700 1 -- 172.21.15.12:0/1978840796 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163097433 0 0) 0x7fde0c0cac60 con 0x7fde0c0cb0f0 2023-07-07T18:15:20.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde12244700 1 --2- 172.21.15.12:0/1978840796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c070dc0 0x7fde0c071190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0ce8e0 tx=0x7fde08009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b182ad522e79d2f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:20.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde11242700 1 -- 172.21.15.12:0/1978840796 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08011830 con 0x7fde0c070dc0 2023-07-07T18:15:20.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde11242700 1 -- 172.21.15.12:0/1978840796 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde08011990 con 0x7fde0c070dc0 2023-07-07T18:15:20.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.498+0000 7fde11242700 1 -- 172.21.15.12:0/1978840796 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08011d20 con 0x7fde0c070dc0 2023-07-07T18:15:20.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.499+0000 7fde144a8700 1 -- 172.21.15.12:0/1978840796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c070dc0 msgr2=0x7fde0c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.499+0000 7fde144a8700 1 --2- 172.21.15.12:0/1978840796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c070dc0 0x7fde0c071190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0ce8e0 tx=0x7fde08009b20 comp rx=0 tx=0).stop 2023-07-07T18:15:20.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.499+0000 7fde144a8700 1 -- 172.21.15.12:0/1978840796 shutdown_connections 2023-07-07T18:15:20.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.499+0000 7fde144a8700 1 --2- 172.21.15.12:0/1978840796 >> v2:172.21.15.160:3300/0 conn(0x7fde0c0cb560 0x7fde0c15cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.499+0000 7fde144a8700 1 --2- 172.21.15.12:0/1978840796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c070dc0 0x7fde0c071190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.499+0000 7fde144a8700 1 -- 172.21.15.12:0/1978840796 >> 172.21.15.12:0/1978840796 conn(0x7fde0c0b1990 msgr2=0x7fde0c0cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:20.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.499+0000 7fde144a8700 1 -- 172.21.15.12:0/1978840796 shutdown_connections 2023-07-07T18:15:20.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.499+0000 7fde144a8700 1 -- 172.21.15.12:0/1978840796 wait complete. 2023-07-07T18:15:20.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.500+0000 7fde144a8700 1 Processor -- start 2023-07-07T18:15:20.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.500+0000 7fde144a8700 1 -- start start 2023-07-07T18:15:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde144a8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde0c070dc0 0x7fde0c1eff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde144a8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde0c0cb0f0 0x7fde0c153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde144a8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c0cb560 0x7fde0c0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde144a8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0c6ad0 con 0x7fde0c0cb560 2023-07-07T18:15:20.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde144a8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c1f0480 con 0x7fde0c0cb0f0 2023-07-07T18:15:20.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde144a8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c154110 con 0x7fde0c070dc0 2023-07-07T18:15:20.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12a45700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c0cb560 0x7fde0c0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12a45700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c0cb560 0x7fde0c0c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57876/0 (socket says 172.21.15.12:57876) 2023-07-07T18:15:20.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12a45700 1 -- 172.21.15.12:0/1981262990 learned_addr learned my addr 172.21.15.12:0/1981262990 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:20.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12244700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde0c070dc0 0x7fde0c1eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde11a43700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde0c0cb0f0 0x7fde0c153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12a45700 1 -- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde0c070dc0 msgr2=0x7fde0c1eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12a45700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde0c070dc0 0x7fde0c1eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12a45700 1 -- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde0c0cb0f0 msgr2=0x7fde0c153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12a45700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde0c0cb0f0 0x7fde0c153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12a45700 1 -- 172.21.15.12:0/1981262990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080094a0 con 0x7fde0c0cb560 2023-07-07T18:15:20.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde12244700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde0c070dc0 0x7fde0c1eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:20.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.501+0000 7fde11a43700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde0c0cb0f0 0x7fde0c153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:20.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.502+0000 7fde12a45700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c0cb560 0x7fde0c0c84a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fde04009fa0 tx=0x7fde0400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:20.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.502+0000 7fde02ffd700 1 -- 172.21.15.12:0/1981262990 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04003a20 con 0x7fde0c0cb560 2023-07-07T18:15:20.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.502+0000 7fde02ffd700 1 -- 172.21.15.12:0/1981262990 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0400f040 con 0x7fde0c0cb560 2023-07-07T18:15:20.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.502+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c0c8ef0 con 0x7fde0c0cb560 2023-07-07T18:15:20.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.502+0000 7fde02ffd700 1 -- 172.21.15.12:0/1981262990 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04003de0 con 0x7fde0c0cb560 2023-07-07T18:15:20.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.502+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c0c66f0 con 0x7fde0c0cb560 2023-07-07T18:15:20.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.503+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c0c6270 con 0x7fde0c0cb560 2023-07-07T18:15:20.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.503+0000 7fde02ffd700 1 -- 172.21.15.12:0/1981262990 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde04004030 con 0x7fde0c0cb560 2023-07-07T18:15:20.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.504+0000 7fde02ffd700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fddf006ace0 0x7fddf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.504+0000 7fde02ffd700 1 -- 172.21.15.12:0/1981262990 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde040899b0 con 0x7fde0c0cb560 2023-07-07T18:15:20.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.504+0000 7fde12244700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fddf006ace0 0x7fddf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.504+0000 7fde12244700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fddf006ace0 0x7fddf006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fde0c1589f0 tx=0x7fde08008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:20.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.508+0000 7fde02ffd700 1 -- 172.21.15.12:0/1981262990 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fde0c0c6270 con 0x7fde0c0cb560 2023-07-07T18:15:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.704+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde0c0c6c10 con 0x7fde0c0cb560 2023-07-07T18:15:20.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.704+0000 7fde02ffd700 1 -- 172.21.15.12:0/1981262990 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde0c0c6c10 con 0x7fde0c0cb560 2023-07-07T18:15:20.707 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fddf006ace0 msgr2=0x7fddf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fddf006ace0 0x7fddf006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fde0c1589f0 tx=0x7fde08008030 comp rx=0 tx=0).stop 2023-07-07T18:15:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c0cb560 msgr2=0x7fde0c0c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c0cb560 0x7fde0c0c84a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fde04009fa0 tx=0x7fde0400d460 comp rx=0 tx=0).stop 2023-07-07T18:15:20.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 shutdown_connections 2023-07-07T18:15:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fddf006ace0 0x7fddf006d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde0c0cb560 0x7fde0c0c84a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde0c070dc0 0x7fde0c1eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 --2- 172.21.15.12:0/1981262990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde0c0cb0f0 0x7fde0c153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 >> 172.21.15.12:0/1981262990 conn(0x7fde0c0b1990 msgr2=0x7fde0c0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 shutdown_connections 2023-07-07T18:15:20.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.707+0000 7fde144a8700 1 -- 172.21.15.12:0/1981262990 wait complete. 2023-07-07T18:15:20.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:20.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.847+0000 7f78636d2700 1 Processor -- start 2023-07-07T18:15:20.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.847+0000 7f78636d2700 1 -- start start 2023-07-07T18:15:20.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f78636d2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c15d2d0 0x7f785c06cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f78636d2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c15c720 con 0x7f785c06b000 2023-07-07T18:15:20.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f78636d2700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c0d03a0 con 0x7f785c0b23a0 2023-07-07T18:15:20.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f78636d2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c15d820 con 0x7f785c15d2d0 2023-07-07T18:15:20.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7861c6f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f785c06b000 0x7f785c06b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55082/0 (socket says 172.21.15.12:55082) 2023-07-07T18:15:20.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7861c6f700 1 -- 172.21.15.12:0/4189760 learned_addr learned my addr 172.21.15.12:0/4189760 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:20.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7860c6d700 1 --2- 172.21.15.12:0/4189760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c15d2d0 0x7f785c06cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7853fff700 1 -- 172.21.15.12:0/4189760 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111664998 0 0) 0x7f7854001490 con 0x7f785c06b000 2023-07-07T18:15:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7853fff700 1 -- 172.21.15.12:0/4189760 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78480035b0 con 0x7f785c06b000 2023-07-07T18:15:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7853fff700 1 -- 172.21.15.12:0/4189760 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286098483 0 0) 0x7f785c0d03a0 con 0x7f785c0b23a0 2023-07-07T18:15:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7853fff700 1 -- 172.21.15.12:0/4189760 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7854001490 con 0x7f785c0b23a0 2023-07-07T18:15:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7860c6d700 1 -- 172.21.15.12:0/4189760 >> v1:172.21.15.160:6789/0 conn(0x7f785c0b23a0 legacy=0x7f785c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7860c6d700 1 -- 172.21.15.12:0/4189760 >> v1:172.21.15.12:6789/0 conn(0x7f785c06b000 legacy=0x7f785c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.848+0000 7f7860c6d700 1 -- 172.21.15.12:0/4189760 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0ce690 con 0x7f785c15d2d0 2023-07-07T18:15:20.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f7860c6d700 1 --2- 172.21.15.12:0/4189760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c15d2d0 0x7f785c06cc60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f784c009870 tx=0x7f784c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9804953dc9b44566 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:20.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f7853fff700 1 -- 172.21.15.12:0/4189760 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c011830 con 0x7f785c15d2d0 2023-07-07T18:15:20.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f7853fff700 1 -- 172.21.15.12:0/4189760 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c011990 con 0x7f785c15d2d0 2023-07-07T18:15:20.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f7853fff700 1 -- 172.21.15.12:0/4189760 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c011d00 con 0x7f785c15d2d0 2023-07-07T18:15:20.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f78636d2700 1 -- 172.21.15.12:0/4189760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c15d2d0 msgr2=0x7f785c06cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f78636d2700 1 --2- 172.21.15.12:0/4189760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c15d2d0 0x7f785c06cc60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f784c009870 tx=0x7f784c009b80 comp rx=0 tx=0).stop 2023-07-07T18:15:20.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f78636d2700 1 -- 172.21.15.12:0/4189760 shutdown_connections 2023-07-07T18:15:20.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f78636d2700 1 --2- 172.21.15.12:0/4189760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c15d2d0 0x7f785c06cc60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f78636d2700 1 -- 172.21.15.12:0/4189760 >> 172.21.15.12:0/4189760 conn(0x7f785c06e5c0 msgr2=0x7f785c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:20.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f78636d2700 1 -- 172.21.15.12:0/4189760 shutdown_connections 2023-07-07T18:15:20.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.849+0000 7f78636d2700 1 -- 172.21.15.12:0/4189760 wait complete. 2023-07-07T18:15:20.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.851+0000 7f78636d2700 1 Processor -- start 2023-07-07T18:15:20.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.851+0000 7f78636d2700 1 -- start start 2023-07-07T18:15:20.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f78636d2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c06b000 0x7f785c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f78636d2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785c0b23a0 0x7f785c0aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f78636d2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f785c15d2d0 0x7f785c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f78636d2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0af940 con 0x7f785c15d2d0 2023-07-07T18:15:20.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f78636d2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0aed30 con 0x7f785c0b23a0 2023-07-07T18:15:20.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f78636d2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0af010 con 0x7f785c06b000 2023-07-07T18:15:20.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7861c6f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f785c15d2d0 0x7f785c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7861c6f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f785c15d2d0 0x7f785c0b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57890/0 (socket says 172.21.15.12:57890) 2023-07-07T18:15:20.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7861c6f700 1 -- 172.21.15.12:0/2478780180 learned_addr learned my addr 172.21.15.12:0/2478780180 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:20.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f786146e700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c06b000 0x7f785c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7860c6d700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785c0b23a0 0x7f785c0aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7861c6f700 1 -- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c06b000 msgr2=0x7f785c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7861c6f700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c06b000 0x7f785c158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7861c6f700 1 -- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785c0b23a0 msgr2=0x7f785c0aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7861c6f700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785c0b23a0 0x7f785c0aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7861c6f700 1 -- 172.21.15.12:0/2478780180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c0094a0 con 0x7f785c15d2d0 2023-07-07T18:15:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7861c6f700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f785c15d2d0 0x7f785c0b3750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7854001f30 tx=0x7f785400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.852+0000 7f7851ffb700 1 -- 172.21.15.12:0/2478780180 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400ab70 con 0x7f785c15d2d0 2023-07-07T18:15:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.853+0000 7f7851ffb700 1 -- 172.21.15.12:0/2478780180 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785400acd0 con 0x7f785c15d2d0 2023-07-07T18:15:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.853+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0af2f0 con 0x7f785c15d2d0 2023-07-07T18:15:20.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.853+0000 7f7851ffb700 1 -- 172.21.15.12:0/2478780180 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854012620 con 0x7f785c15d2d0 2023-07-07T18:15:20.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.853+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c159300 con 0x7f785c15d2d0 2023-07-07T18:15:20.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.854+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c1594f0 con 0x7f785c15d2d0 2023-07-07T18:15:20.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.854+0000 7f7851ffb700 1 -- 172.21.15.12:0/2478780180 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f785401b3b0 con 0x7f785c15d2d0 2023-07-07T18:15:20.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.855+0000 7f7851ffb700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f784006ace0 0x7f784006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:20.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.855+0000 7f7851ffb700 1 -- 172.21.15.12:0/2478780180 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f78540893e0 con 0x7f785c15d2d0 2023-07-07T18:15:20.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.855+0000 7f786146e700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f784006ace0 0x7f784006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:20.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.855+0000 7f786146e700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f784006ace0 0x7f784006d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7858001830 tx=0x7f7858009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:20.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:20.859+0000 7f7851ffb700 1 -- 172.21.15.12:0/2478780180 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f78540541a0 con 0x7f785c15d2d0 2023-07-07T18:15:21.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.059+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f785c15c720 con 0x7f785c15d2d0 2023-07-07T18:15:21.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.059+0000 7f7851ffb700 1 -- 172.21.15.12:0/2478780180 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f785c15c720 con 0x7f785c15d2d0 2023-07-07T18:15:21.061 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:21.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f784006ace0 msgr2=0x7f784006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f784006ace0 0x7f784006d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7858001830 tx=0x7f7858009040 comp rx=0 tx=0).stop 2023-07-07T18:15:21.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f785c15d2d0 msgr2=0x7f785c0b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f785c15d2d0 0x7f785c0b3750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7854001f30 tx=0x7f785400a060 comp rx=0 tx=0).stop 2023-07-07T18:15:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 shutdown_connections 2023-07-07T18:15:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f784006ace0 0x7f784006d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f785c15d2d0 0x7f785c0b3750 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785c06b000 0x7f785c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 --2- 172.21.15.12:0/2478780180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785c0b23a0 0x7f785c0aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 >> 172.21.15.12:0/2478780180 conn(0x7f785c06e5c0 msgr2=0x7f785c15a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 shutdown_connections 2023-07-07T18:15:21.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.061+0000 7f78636d2700 1 -- 172.21.15.12:0/2478780180 wait complete. 2023-07-07T18:15:21.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:15:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.198+0000 7f45c5301700 1 Processor -- start 2023-07-07T18:15:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.198+0000 7f45c5301700 1 -- start start 2023-07-07T18:15:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45c5301700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f45c00caf00 0x7f45c015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45c5301700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015b130 0x7f45c00ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45c5301700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c00d1210 con 0x7f45c015a820 2023-07-07T18:15:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45c5301700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c015b570 con 0x7f45c00caf00 2023-07-07T18:15:21.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45c5301700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0154a80 con 0x7f45c015b130 2023-07-07T18:15:21.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45beffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f45c015a820 0x7f45c00d0b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55092/0 (socket says 172.21.15.12:55092) 2023-07-07T18:15:21.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45beffd700 1 -- 172.21.15.12:0/3041789258 learned_addr learned my addr 172.21.15.12:0/3041789258 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:21.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45be7fc700 1 --2- 172.21.15.12:0/3041789258 >> v2:172.21.15.160:3300/0 conn(0x7f45c00caf00 0x7f45c015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45bf7fe700 1 --2- 172.21.15.12:0/3041789258 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015b130 0x7f45c00ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45bdffb700 1 -- 172.21.15.12:0/3041789258 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905813709 0 0) 0x7f45c00d1210 con 0x7f45c015a820 2023-07-07T18:15:21.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45bdffb700 1 -- 172.21.15.12:0/3041789258 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a80035b0 con 0x7f45c015a820 2023-07-07T18:15:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45be7fc700 1 -- 172.21.15.12:0/3041789258 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015b130 msgr2=0x7f45c00ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45bdffb700 1 -- 172.21.15.12:0/3041789258 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3647174111 0 0) 0x7f45a80035b0 con 0x7f45c015a820 2023-07-07T18:15:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45be7fc700 1 --2- 172.21.15.12:0/3041789258 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015b130 0x7f45c00ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45be7fc700 1 -- 172.21.15.12:0/3041789258 >> v1:172.21.15.12:6789/0 conn(0x7f45c015a820 legacy=0x7f45c00d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.199+0000 7f45be7fc700 1 -- 172.21.15.12:0/3041789258 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c00cb380 con 0x7f45c00caf00 2023-07-07T18:15:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45be7fc700 1 --2- 172.21.15.12:0/3041789258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c00caf00 0x7f45c015abf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009840 tx=0x7f45b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2198134e880f0bb server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:21.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45bdffb700 1 -- 172.21.15.12:0/3041789258 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0001670 con 0x7f45c00caf00 2023-07-07T18:15:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45bdffb700 1 -- 172.21.15.12:0/3041789258 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b4004030 con 0x7f45c00caf00 2023-07-07T18:15:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45bdffb700 1 -- 172.21.15.12:0/3041789258 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b40043c0 con 0x7f45c00caf00 2023-07-07T18:15:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45c5301700 1 -- 172.21.15.12:0/3041789258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c00caf00 msgr2=0x7f45c015abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45c5301700 1 --2- 172.21.15.12:0/3041789258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c00caf00 0x7f45c015abf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009840 tx=0x7f45b4009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45c5301700 1 -- 172.21.15.12:0/3041789258 shutdown_connections 2023-07-07T18:15:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45c5301700 1 --2- 172.21.15.12:0/3041789258 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015b130 0x7f45c00ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45c5301700 1 --2- 172.21.15.12:0/3041789258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c00caf00 0x7f45c015abf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45c5301700 1 -- 172.21.15.12:0/3041789258 >> 172.21.15.12:0/3041789258 conn(0x7f45c006e530 msgr2=0x7f45c006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45c5301700 1 -- 172.21.15.12:0/3041789258 shutdown_connections 2023-07-07T18:15:21.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.200+0000 7f45c5301700 1 -- 172.21.15.12:0/3041789258 wait complete. 2023-07-07T18:15:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45c5301700 1 Processor -- start 2023-07-07T18:15:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45c5301700 1 -- start start 2023-07-07T18:15:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45c5301700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00caf00 0x7f45c0146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45c5301700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015a820 0x7f45c0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45c5301700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c015b130 0x7f45c0159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45c5301700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00c5490 con 0x7f45c00caf00 2023-07-07T18:15:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45c5301700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00c5770 con 0x7f45c015b130 2023-07-07T18:15:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45c5301700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00c5a50 con 0x7f45c015a820 2023-07-07T18:15:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45beffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00caf00 0x7f45c0146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45beffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00caf00 0x7f45c0146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57900/0 (socket says 172.21.15.12:57900) 2023-07-07T18:15:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.202+0000 7f45beffd700 1 -- 172.21.15.12:0/110045215 learned_addr learned my addr 172.21.15.12:0/110045215 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45bf7fe700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c015b130 0x7f45c0159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45be7fc700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015a820 0x7f45c0158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45beffd700 1 -- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015a820 msgr2=0x7f45c0158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45beffd700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015a820 0x7f45c0158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45beffd700 1 -- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c015b130 msgr2=0x7f45c0159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45beffd700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c015b130 0x7f45c0159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45beffd700 1 -- 172.21.15.12:0/110045215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b40094a0 con 0x7f45c00caf00 2023-07-07T18:15:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45bf7fe700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c015b130 0x7f45c0159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45be7fc700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015a820 0x7f45c0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:21.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45beffd700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00caf00 0x7f45c0146c40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f45b000c780 tx=0x7f45b000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:21.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45a77fe700 1 -- 172.21.15.12:0/110045215 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0004c80 con 0x7f45c00caf00 2023-07-07T18:15:21.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45a77fe700 1 -- 172.21.15.12:0/110045215 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0004de0 con 0x7f45c00caf00 2023-07-07T18:15:21.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45a77fe700 1 -- 172.21.15.12:0/110045215 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b00072f0 con 0x7f45c00caf00 2023-07-07T18:15:21.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c00c5d30 con 0x7f45c00caf00 2023-07-07T18:15:21.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.203+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c01f2a60 con 0x7f45c00caf00 2023-07-07T18:15:21.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.204+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c00c5f20 con 0x7f45c00caf00 2023-07-07T18:15:21.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.204+0000 7f45a77fe700 1 -- 172.21.15.12:0/110045215 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45b0007450 con 0x7f45c00caf00 2023-07-07T18:15:21.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.205+0000 7f45a77fe700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f45ac06ace0 0x7f45ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.205+0000 7f45a77fe700 1 -- 172.21.15.12:0/110045215 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f45b00889e0 con 0x7f45c00caf00 2023-07-07T18:15:21.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.205+0000 7f45be7fc700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f45ac06ace0 0x7f45ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.206+0000 7f45be7fc700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f45ac06ace0 0x7f45ac06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f45b40090b0 tx=0x7f45b4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:21.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.209+0000 7f45a77fe700 1 -- 172.21.15.12:0/110045215 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45b0053720 con 0x7f45c00caf00 2023-07-07T18:15:21.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.452+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45c00c55d0 con 0x7f45c00caf00 2023-07-07T18:15:21.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.452+0000 7f45a77fe700 1 -- 172.21.15.12:0/110045215 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f45c00c55d0 con 0x7f45c00caf00 2023-07-07T18:15:21.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:21.455 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:15:09.693432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-07T18:15:21.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f45ac06ace0 msgr2=0x7f45ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f45ac06ace0 0x7f45ac06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f45b40090b0 tx=0x7f45b4008030 comp rx=0 tx=0).stop 2023-07-07T18:15:21.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00caf00 msgr2=0x7f45c0146c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00caf00 0x7f45c0146c40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f45b000c780 tx=0x7f45b000cb40 comp rx=0 tx=0).stop 2023-07-07T18:15:21.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 shutdown_connections 2023-07-07T18:15:21.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f45ac06ace0 0x7f45ac06d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45c015b130 0x7f45c0159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45c00caf00 0x7f45c0146c40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 --2- 172.21.15.12:0/110045215 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45c015a820 0x7f45c0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 >> 172.21.15.12:0/110045215 conn(0x7f45c006e530 msgr2=0x7f45c00b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:21.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 shutdown_connections 2023-07-07T18:15:21.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.454+0000 7f45c5301700 1 -- 172.21.15.12:0/110045215 wait complete. 2023-07-07T18:15:21.458 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2023-07-07T18:15:21.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:21.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.591+0000 7fbe40b19700 1 Processor -- start 2023-07-07T18:15:21.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.591+0000 7fbe40b19700 1 -- start start 2023-07-07T18:15:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe40b19700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0cddd0 0x7fbe3c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe40b19700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fbe3c0ae6c0 0x7fbe3c0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe40b19700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe3c0ce1a0 0x7fbe3c0714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe40b19700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3c0cdc80 con 0x7fbe3c0ce1a0 2023-07-07T18:15:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe40b19700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3c15d6a0 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe40b19700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c159700 con 0x7fbe3c0cddd0 2023-07-07T18:15:21.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe3ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe3c0ce1a0 0x7fbe3c0714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe3ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe3c0ce1a0 0x7fbe3c0714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57912/0 (socket says 172.21.15.12:57912) 2023-07-07T18:15:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe3ad9d700 1 -- 172.21.15.12:0/1740748104 learned_addr learned my addr 172.21.15.12:0/1740748104 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe39d9b700 1 --2- 172.21.15.12:0/1740748104 >> v2:172.21.15.160:3300/0 conn(0x7fbe3c0ae6c0 0x7fbe3c0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe3a59c700 1 --2- 172.21.15.12:0/1740748104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0cddd0 0x7fbe3c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe3ad9d700 1 -- 172.21.15.12:0/1740748104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0cddd0 msgr2=0x7fbe3c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe3ad9d700 1 --2- 172.21.15.12:0/1740748104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0cddd0 0x7fbe3c15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe3ad9d700 1 -- 172.21.15.12:0/1740748104 >> v2:172.21.15.160:3300/0 conn(0x7fbe3c0ae6c0 msgr2=0x7fbe3c0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe3ad9d700 1 --2- 172.21.15.12:0/1740748104 >> v2:172.21.15.160:3300/0 conn(0x7fbe3c0ae6c0 0x7fbe3c0aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.592+0000 7fbe3ad9d700 1 -- 172.21.15.12:0/1740748104 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c1599e0 con 0x7fbe3c0ce1a0 2023-07-07T18:15:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe3ad9d700 1 --2- 172.21.15.12:0/1740748104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ce1a0 0x7fbe3c0714a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c06e9b0 tx=0x7fbe3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5a8aa7db21d66a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe3959a700 1 -- 172.21.15.12:0/1740748104 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400e070 con 0x7fbe3c0ce1a0 2023-07-07T18:15:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe3959a700 1 -- 172.21.15.12:0/1740748104 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3400b9c0 con 0x7fbe3c0ce1a0 2023-07-07T18:15:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe3959a700 1 -- 172.21.15.12:0/1740748104 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400bd70 con 0x7fbe3c0ce1a0 2023-07-07T18:15:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe40b19700 1 -- 172.21.15.12:0/1740748104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ce1a0 msgr2=0x7fbe3c0714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe40b19700 1 --2- 172.21.15.12:0/1740748104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ce1a0 0x7fbe3c0714a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c06e9b0 tx=0x7fbe3400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe40b19700 1 -- 172.21.15.12:0/1740748104 shutdown_connections 2023-07-07T18:15:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe40b19700 1 --2- 172.21.15.12:0/1740748104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0cddd0 0x7fbe3c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe40b19700 1 --2- 172.21.15.12:0/1740748104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ce1a0 0x7fbe3c0714a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe40b19700 1 --2- 172.21.15.12:0/1740748104 >> v2:172.21.15.160:3300/0 conn(0x7fbe3c0ae6c0 0x7fbe3c0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe40b19700 1 -- 172.21.15.12:0/1740748104 >> 172.21.15.12:0/1740748104 conn(0x7fbe3c06d4a0 msgr2=0x7fbe3c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.593+0000 7fbe40b19700 1 -- 172.21.15.12:0/1740748104 shutdown_connections 2023-07-07T18:15:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.594+0000 7fbe40b19700 1 -- 172.21.15.12:0/1740748104 wait complete. 2023-07-07T18:15:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.595+0000 7fbe40b19700 1 Processor -- start 2023-07-07T18:15:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.595+0000 7fbe40b19700 1 -- start start 2023-07-07T18:15:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe40b19700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ae6c0 0x7fbe3c0ade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe40b19700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe3c0cddd0 0x7fbe3c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe40b19700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0ce1a0 0x7fbe3c154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe40b19700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c0ae3c0 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe40b19700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c15af60 con 0x7fbe3c0cddd0 2023-07-07T18:15:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe40b19700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3c15b240 con 0x7fbe3c0ce1a0 2023-07-07T18:15:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ae6c0 0x7fbe3c0ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ae6c0 0x7fbe3c0ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57914/0 (socket says 172.21.15.12:57914) 2023-07-07T18:15:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3a59c700 1 -- 172.21.15.12:0/3866006856 learned_addr learned my addr 172.21.15.12:0/3866006856 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe39d9b700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe3c0cddd0 0x7fbe3c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3ad9d700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0ce1a0 0x7fbe3c154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3a59c700 1 -- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0ce1a0 msgr2=0x7fbe3c154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3a59c700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0ce1a0 0x7fbe3c154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3a59c700 1 -- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe3c0cddd0 msgr2=0x7fbe3c153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3a59c700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe3c0cddd0 0x7fbe3c153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3a59c700 1 -- 172.21.15.12:0/3866006856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe34009b30 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe3a59c700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ae6c0 0x7fbe3c0ade80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c7f0 tx=0x7fbe2400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.596+0000 7fbe32ffd700 1 -- 172.21.15.12:0/3866006856 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24004220 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.597+0000 7fbe32ffd700 1 -- 172.21.15.12:0/3866006856 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe24004380 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.597+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3c15b520 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.597+0000 7fbe32ffd700 1 -- 172.21.15.12:0/3866006856 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240036a0 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.597+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3c15bae0 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.597+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe3c06f120 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.598+0000 7fbe32ffd700 1 -- 172.21.15.12:0/3866006856 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe24003800 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.598+0000 7fbe32ffd700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe1c06ad10 0x7fbe1c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.598+0000 7fbe32ffd700 1 -- 172.21.15.12:0/3866006856 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe24089270 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.599+0000 7fbe39d9b700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe1c06ad10 0x7fbe1c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.599+0000 7fbe39d9b700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe1c06ad10 0x7fbe1c06d1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c1f5520 tx=0x7fbe2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.603+0000 7fbe32ffd700 1 -- 172.21.15.12:0/3866006856 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbe24053f00 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.804+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe3c073910 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.805+0000 7fbe32ffd700 1 -- 172.21.15.12:0/3866006856 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20120 (secure 0 0 0) 0x7fbe2401e090 con 0x7fbe3c0ae6c0 2023-07-07T18:15:21.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:21.808 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":29,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:14:50.685578+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:21.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe1c06ad10 msgr2=0x7fbe1c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe1c06ad10 0x7fbe1c06d1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c1f5520 tx=0x7fbe2c008040 comp rx=0 tx=0).stop 2023-07-07T18:15:21.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ae6c0 msgr2=0x7fbe3c0ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ae6c0 0x7fbe3c0ade80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c7f0 tx=0x7fbe2400cb00 comp rx=0 tx=0).stop 2023-07-07T18:15:21.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 shutdown_connections 2023-07-07T18:15:21.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe1c06ad10 0x7fbe1c06d1c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe3c0ce1a0 0x7fbe3c154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe3c0ae6c0 0x7fbe3c0ade80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 --2- 172.21.15.12:0/3866006856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe3c0cddd0 0x7fbe3c153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 >> 172.21.15.12:0/3866006856 conn(0x7fbe3c06d4a0 msgr2=0x7fbe3c0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:21.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 shutdown_connections 2023-07-07T18:15:21.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.807+0000 7fbe40b19700 1 -- 172.21.15.12:0/3866006856 wait complete. 2023-07-07T18:15:21.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:15:21.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.944+0000 7fa5eb953700 1 Processor -- start 2023-07-07T18:15:21.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.944+0000 7fa5eb953700 1 -- start start 2023-07-07T18:15:21.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5eb953700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e4156880 0x7fa5e4069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5eb953700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa5e40aed30 0x7fa5e4160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5eb953700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5e40cc1d0 0x7fa5e40cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5eb953700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40ccb90 con 0x7fa5e40cc1d0 2023-07-07T18:15:21.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5eb953700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40cee80 con 0x7fa5e40aed30 2023-07-07T18:15:21.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5eb953700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40cf100 con 0x7fa5e4156880 2023-07-07T18:15:21.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5e9ef0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5e40cc1d0 0x7fa5e40cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5e9ef0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5e40cc1d0 0x7fa5e40cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57926/0 (socket says 172.21.15.12:57926) 2023-07-07T18:15:21.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5e9ef0700 1 -- 172.21.15.12:0/3676040772 learned_addr learned my addr 172.21.15.12:0/3676040772 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:21.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5e96ef700 1 --2- 172.21.15.12:0/3676040772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e4156880 0x7fa5e4069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.945+0000 7fa5e8eee700 1 --2- 172.21.15.12:0/3676040772 >> v2:172.21.15.160:3300/0 conn(0x7fa5e40aed30 0x7fa5e4160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5e9ef0700 1 -- 172.21.15.12:0/3676040772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e4156880 msgr2=0x7fa5e4069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:21.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5e9ef0700 1 --2- 172.21.15.12:0/3676040772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e4156880 0x7fa5e4069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5e9ef0700 1 -- 172.21.15.12:0/3676040772 >> v2:172.21.15.160:3300/0 conn(0x7fa5e40aed30 msgr2=0x7fa5e4160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:21.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5e9ef0700 1 --2- 172.21.15.12:0/3676040772 >> v2:172.21.15.160:3300/0 conn(0x7fa5e40aed30 0x7fa5e4160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5e9ef0700 1 -- 172.21.15.12:0/3676040772 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40cf3e0 con 0x7fa5e40cc1d0 2023-07-07T18:15:21.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5e9ef0700 1 --2- 172.21.15.12:0/3676040772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40cc1d0 0x7fa5e40cc650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa5e406ea00 tx=0x7fa5dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93285c6d30f8e0ff server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:21.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5dbfff700 1 -- 172.21.15.12:0/3676040772 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00e070 con 0x7fa5e40cc1d0 2023-07-07T18:15:21.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5dbfff700 1 -- 172.21.15.12:0/3676040772 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00b9c0 con 0x7fa5e40cc1d0 2023-07-07T18:15:21.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5dbfff700 1 -- 172.21.15.12:0/3676040772 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00bd70 con 0x7fa5e40cc1d0 2023-07-07T18:15:21.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5eb953700 1 -- 172.21.15.12:0/3676040772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40cc1d0 msgr2=0x7fa5e40cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3676040772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40cc1d0 0x7fa5e40cc650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa5e406ea00 tx=0x7fa5dc00b330 comp rx=0 tx=0).stop 2023-07-07T18:15:21.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5eb953700 1 -- 172.21.15.12:0/3676040772 shutdown_connections 2023-07-07T18:15:21.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3676040772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e4156880 0x7fa5e4069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3676040772 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40cc1d0 0x7fa5e40cc650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3676040772 >> v2:172.21.15.160:3300/0 conn(0x7fa5e40aed30 0x7fa5e4160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.946+0000 7fa5eb953700 1 -- 172.21.15.12:0/3676040772 >> 172.21.15.12:0/3676040772 conn(0x7fa5e406d4a0 msgr2=0x7fa5e406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:21.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.947+0000 7fa5eb953700 1 -- 172.21.15.12:0/3676040772 shutdown_connections 2023-07-07T18:15:21.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.947+0000 7fa5eb953700 1 -- 172.21.15.12:0/3676040772 wait complete. 2023-07-07T18:15:21.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.948+0000 7fa5eb953700 1 Processor -- start 2023-07-07T18:15:21.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.948+0000 7fa5eb953700 1 -- start start 2023-07-07T18:15:21.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.948+0000 7fa5eb953700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40aed30 0x7fa5e41f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.948+0000 7fa5eb953700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e40cc1d0 0x7fa5e40b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.948+0000 7fa5eb953700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e4156880 0x7fa5e4153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.948+0000 7fa5eb953700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4154250 con 0x7fa5e40aed30 2023-07-07T18:15:21.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.948+0000 7fa5eb953700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40b51f0 con 0x7fa5e4156880 2023-07-07T18:15:21.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.948+0000 7fa5eb953700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41f2030 con 0x7fa5e40cc1d0 2023-07-07T18:15:21.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e96ef700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40aed30 0x7fa5e41f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e96ef700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40aed30 0x7fa5e41f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57928/0 (socket says 172.21.15.12:57928) 2023-07-07T18:15:21.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e96ef700 1 -- 172.21.15.12:0/3537771760 learned_addr learned my addr 172.21.15.12:0/3537771760 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:21.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e9ef0700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e4156880 0x7fa5e4153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e8eee700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e40cc1d0 0x7fa5e40b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e96ef700 1 -- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e40cc1d0 msgr2=0x7fa5e40b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e96ef700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e40cc1d0 0x7fa5e40b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e96ef700 1 -- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e4156880 msgr2=0x7fa5e4153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:21.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e96ef700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e4156880 0x7fa5e4153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:21.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e96ef700 1 -- 172.21.15.12:0/3537771760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009b30 con 0x7fa5e40aed30 2023-07-07T18:15:21.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5e96ef700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40aed30 0x7fa5e41f1a30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000d800 tx=0x7fa5e000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:21.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5d9ffb700 1 -- 172.21.15.12:0/3537771760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00125f0 con 0x7fa5e40aed30 2023-07-07T18:15:21.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5d9ffb700 1 -- 172.21.15.12:0/3537771760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e0012750 con 0x7fa5e40aed30 2023-07-07T18:15:21.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e41f2310 con 0x7fa5e40aed30 2023-07-07T18:15:21.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5d9ffb700 1 -- 172.21.15.12:0/3537771760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0012b00 con 0x7fa5e40aed30 2023-07-07T18:15:21.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.949+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e41f28d0 con 0x7fa5e40aed30 2023-07-07T18:15:21.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.950+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4073910 con 0x7fa5e40aed30 2023-07-07T18:15:21.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.951+0000 7fa5d9ffb700 1 -- 172.21.15.12:0/3537771760 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa5e0012c60 con 0x7fa5e40aed30 2023-07-07T18:15:21.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.951+0000 7fa5d9ffb700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa5c806ace0 0x7fa5c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:21.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.951+0000 7fa5d9ffb700 1 -- 172.21.15.12:0/3537771760 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa5e0089ae0 con 0x7fa5e40aed30 2023-07-07T18:15:21.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.951+0000 7fa5e8eee700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa5c806ace0 0x7fa5c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:21.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.952+0000 7fa5e8eee700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa5c806ace0 0x7fa5c806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009930 tx=0x7fa5d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:21.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:21.956+0000 7fa5d9ffb700 1 -- 172.21.15.12:0/3537771760 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa5e0054800 con 0x7fa5e40aed30 2023-07-07T18:15:22.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.198+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5e406b790 con 0x7fa5e40aed30 2023-07-07T18:15:22.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.198+0000 7fa5d9ffb700 1 -- 172.21.15.12:0/3537771760 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fa5e0057e20 con 0x7fa5e40aed30 2023-07-07T18:15:22.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:22.201 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:15:09.693432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-07T18:15:22.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa5c806ace0 msgr2=0x7fa5c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa5c806ace0 0x7fa5c806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009930 tx=0x7fa5d4008040 comp rx=0 tx=0).stop 2023-07-07T18:15:22.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40aed30 msgr2=0x7fa5e41f1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40aed30 0x7fa5e41f1a30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000d800 tx=0x7fa5e000db10 comp rx=0 tx=0).stop 2023-07-07T18:15:22.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 shutdown_connections 2023-07-07T18:15:22.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa5c806ace0 0x7fa5c806d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5e4156880 0x7fa5e4153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5e40aed30 0x7fa5e41f1a30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 --2- 172.21.15.12:0/3537771760 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5e40cc1d0 0x7fa5e40b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.200+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 >> 172.21.15.12:0/3537771760 conn(0x7fa5e406d4a0 msgr2=0x7fa5e4155ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:22.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.201+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 shutdown_connections 2023-07-07T18:15:22.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.201+0000 7fa5eb953700 1 -- 172.21.15.12:0/3537771760 wait complete. 2023-07-07T18:15:22.204 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2023-07-07T18:15:22.617 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-07T18:14:46.226517+0000', 'modified': '2023-07-07T18:15:09.693432+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6837/3361031905', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6835', 'nonce': 3361031905}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 3361031905}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-07T18:15:22.617 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-07T18:15:22.618 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-07T18:15:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.748+0000 7f39358c2700 1 Processor -- start 2023-07-07T18:15:22.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.748+0000 7f39358c2700 1 -- start start 2023-07-07T18:15:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f39358c2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3930156880 0x7f3930069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f39358c2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39300cee80 con 0x7f39300aed30 2023-07-07T18:15:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f39358c2700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39300cf100 con 0x7f39300cc1d0 2023-07-07T18:15:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f39358c2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39300cf3e0 con 0x7f3930156880 2023-07-07T18:15:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f392e7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f39300aed30 0x7f3930160580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55134/0 (socket says 172.21.15.12:55134) 2023-07-07T18:15:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f392e7fc700 1 -- 172.21.15.12:0/1822403727 learned_addr learned my addr 172.21.15.12:0/1822403727 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f392effd700 1 --2- 172.21.15.12:0/1822403727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3930156880 0x7f3930069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f392dffb700 1 -- 172.21.15.12:0/1822403727 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270992020 0 0) 0x7f39300cee80 con 0x7f39300aed30 2023-07-07T18:15:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f392dffb700 1 -- 172.21.15.12:0/1822403727 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f391c0035b0 con 0x7f39300aed30 2023-07-07T18:15:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f392dffb700 1 -- 172.21.15.12:0/1822403727 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231838349 0 0) 0x7f39300cf100 con 0x7f39300cc1d0 2023-07-07T18:15:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.749+0000 7f392dffb700 1 -- 172.21.15.12:0/1822403727 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39300cee80 con 0x7f39300cc1d0 2023-07-07T18:15:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f392dffb700 1 -- 172.21.15.12:0/1822403727 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3764241013 0 0) 0x7f391c0035b0 con 0x7f39300aed30 2023-07-07T18:15:22.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f392effd700 1 -- 172.21.15.12:0/1822403727 >> v1:172.21.15.160:6789/0 conn(0x7f39300cc1d0 legacy=0x7f393015cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f392effd700 1 -- 172.21.15.12:0/1822403727 >> v1:172.21.15.12:6789/0 conn(0x7f39300aed30 legacy=0x7f3930160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f392effd700 1 -- 172.21.15.12:0/1822403727 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39300cd390 con 0x7f3930156880 2023-07-07T18:15:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f392effd700 1 --2- 172.21.15.12:0/1822403727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3930156880 0x7f3930069ef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3920009870 tx=0x7f3920009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=526b92235ee1c3e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f392dffb700 1 -- 172.21.15.12:0/1822403727 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3918001670 con 0x7f3930156880 2023-07-07T18:15:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f392dffb700 1 -- 172.21.15.12:0/1822403727 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920004030 con 0x7f3930156880 2023-07-07T18:15:22.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f392dffb700 1 -- 172.21.15.12:0/1822403727 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39200043a0 con 0x7f3930156880 2023-07-07T18:15:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f39358c2700 1 -- 172.21.15.12:0/1822403727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3930156880 msgr2=0x7f3930069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.750+0000 7f39358c2700 1 --2- 172.21.15.12:0/1822403727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3930156880 0x7f3930069ef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3920009870 tx=0x7f3920009b80 comp rx=0 tx=0).stop 2023-07-07T18:15:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.751+0000 7f39358c2700 1 -- 172.21.15.12:0/1822403727 shutdown_connections 2023-07-07T18:15:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.751+0000 7f39358c2700 1 --2- 172.21.15.12:0/1822403727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3930156880 0x7f3930069ef0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.751+0000 7f39358c2700 1 -- 172.21.15.12:0/1822403727 >> 172.21.15.12:0/1822403727 conn(0x7f393006d4a0 msgr2=0x7f393006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.751+0000 7f39358c2700 1 -- 172.21.15.12:0/1822403727 shutdown_connections 2023-07-07T18:15:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.751+0000 7f39358c2700 1 -- 172.21.15.12:0/1822403727 wait complete. 2023-07-07T18:15:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.752+0000 7f39358c2700 1 Processor -- start 2023-07-07T18:15:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.752+0000 7f39358c2700 1 -- start start 2023-07-07T18:15:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f39358c2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39300aed30 0x7f39301f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f39358c2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39300cc1d0 0x7f39301f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f39358c2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3930156880 0x7f3930159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f39358c2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39301f60b0 con 0x7f3930156880 2023-07-07T18:15:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f39358c2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3930157340 con 0x7f39300cc1d0 2023-07-07T18:15:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f39358c2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39301587b0 con 0x7f39300aed30 2023-07-07T18:15:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3930156880 0x7f3930159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3930156880 0x7f3930159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57946/0 (socket says 172.21.15.12:57946) 2023-07-07T18:15:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392f7fe700 1 -- 172.21.15.12:0/1617508646 learned_addr learned my addr 172.21.15.12:0/1617508646 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392e7fc700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39300cc1d0 0x7f39301f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392effd700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39300aed30 0x7f39301f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392f7fe700 1 -- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39300aed30 msgr2=0x7f39301f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392f7fe700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39300aed30 0x7f39301f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392f7fe700 1 -- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39300cc1d0 msgr2=0x7f39301f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392f7fe700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39300cc1d0 0x7f39301f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392f7fe700 1 -- 172.21.15.12:0/1617508646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39200094a0 con 0x7f3930156880 2023-07-07T18:15:22.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392effd700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39300aed30 0x7f39301f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392e7fc700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39300cc1d0 0x7f39301f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f392f7fe700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3930156880 0x7f3930159250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f392800cc20 tx=0x7f392800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f3927fff700 1 -- 172.21.15.12:0/1617508646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392800ac20 con 0x7f3930156880 2023-07-07T18:15:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.753+0000 7f3927fff700 1 -- 172.21.15.12:0/1617508646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392800ad80 con 0x7f3930156880 2023-07-07T18:15:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.754+0000 7f39358c2700 1 -- 172.21.15.12:0/1617508646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3930156d80 con 0x7f3930156880 2023-07-07T18:15:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.754+0000 7f3927fff700 1 -- 172.21.15.12:0/1617508646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928003c20 con 0x7f3930156880 2023-07-07T18:15:22.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.754+0000 7f39358c2700 1 -- 172.21.15.12:0/1617508646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3930158a50 con 0x7f3930156880 2023-07-07T18:15:22.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.755+0000 7f3927fff700 1 -- 172.21.15.12:0/1617508646 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39280050d0 con 0x7f3930156880 2023-07-07T18:15:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.755+0000 7f3927fff700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f391006ace0 0x7f391006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.756+0000 7f3927fff700 1 -- 172.21.15.12:0/1617508646 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3928089890 con 0x7f3930156880 2023-07-07T18:15:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.756+0000 7f392effd700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f391006ace0 0x7f391006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.756+0000 7f392effd700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f391006ace0 0x7f391006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f39200097c0 tx=0x7f3920008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.758+0000 7f3941a47b80 1 Processor -- start 2023-07-07T18:15:22.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.758+0000 7f3941a47b80 1 -- start start 2023-07-07T18:15:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4ff50 0x5579ffa50320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa77d80 0x5579ffa76820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4d740 0x5579ffa7a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f3941a47b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ff954c60 con 0x5579ffa4ff50 2023-07-07T18:15:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f3941a47b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ff9a79f0 con 0x5579ffa4d740 2023-07-07T18:15:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f3941a47b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579ff9a0e80 con 0x5579ffa77d80 2023-07-07T18:15:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f392effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4ff50 0x5579ffa50320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f392effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4ff50 0x5579ffa50320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57950/0 (socket says 172.21.15.12:57950) 2023-07-07T18:15:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f392effd700 1 -- 172.21.15.12:0/2606769626 learned_addr learned my addr 172.21.15.12:0/2606769626 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f392f7fe700 1 --2- 172.21.15.12:0/2606769626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4d740 0x5579ffa7a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f392effd700 1 -- 172.21.15.12:0/2606769626 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa77d80 msgr2=0x5579ffa76820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f392effd700 1 --2- 172.21.15.12:0/2606769626 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa77d80 0x5579ffa76820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f392effd700 1 -- 172.21.15.12:0/2606769626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4d740 msgr2=0x5579ffa7a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.759+0000 7f392effd700 1 --2- 172.21.15.12:0/2606769626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4d740 0x5579ffa7a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.760+0000 7f392effd700 1 -- 172.21.15.12:0/2606769626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579ff8225e0 con 0x5579ffa4ff50 2023-07-07T18:15:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.760+0000 7f392effd700 1 --2- 172.21.15.12:0/2606769626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4ff50 0x5579ffa50320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f39300712a0 tx=0x7f3920010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976b0e2a8d343ea5 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.760+0000 7f39257fa700 1 -- 172.21.15.12:0/2606769626 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392002b070 con 0x5579ffa4ff50 2023-07-07T18:15:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.760+0000 7f39257fa700 1 -- 172.21.15.12:0/2606769626 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920003c40 con 0x5579ffa4ff50 2023-07-07T18:15:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.760+0000 7f39257fa700 1 -- 172.21.15.12:0/2606769626 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392001f070 con 0x5579ffa4ff50 2023-07-07T18:15:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.760+0000 7f3941a47b80 1 -- 172.21.15.12:0/2606769626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4ff50 msgr2=0x5579ffa50320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.760+0000 7f3941a47b80 1 --2- 172.21.15.12:0/2606769626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4ff50 0x5579ffa50320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f39300712a0 tx=0x7f3920010000 comp rx=0 tx=0).stop 2023-07-07T18:15:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.761+0000 7f3941a47b80 1 -- 172.21.15.12:0/2606769626 shutdown_connections 2023-07-07T18:15:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.761+0000 7f3941a47b80 1 --2- 172.21.15.12:0/2606769626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4d740 0x5579ffa7a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.761+0000 7f3941a47b80 1 --2- 172.21.15.12:0/2606769626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4ff50 0x5579ffa50320 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.761+0000 7f3941a47b80 1 --2- 172.21.15.12:0/2606769626 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa77d80 0x5579ffa76820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.761+0000 7f3941a47b80 1 -- 172.21.15.12:0/2606769626 >> 172.21.15.12:0/2606769626 conn(0x5579ffa44fc0 msgr2=0x5579ffa951a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.761+0000 7f3941a47b80 1 -- 172.21.15.12:0/2606769626 shutdown_connections 2023-07-07T18:15:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.761+0000 7f3941a47b80 1 -- 172.21.15.12:0/2606769626 wait complete. 2023-07-07T18:15:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.761+0000 7f3941a47b80 1 -- start start 2023-07-07T18:15:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.761+0000 7f3941a47b80 1 Processor -- start 2023-07-07T18:15:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffa95500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 0x5579ffa70980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f3941a47b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ff940a70 con 0x5579ffa4d740 2023-07-07T18:15:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f3941a47b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ff940770 con 0x5579ffa77d80 2023-07-07T18:15:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f3941a47b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579ff8248d0 con 0x5579ffa4ff50 2023-07-07T18:15:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffa95500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f3941a47b80 10 client.0 _ll_register_callbacks cb 0x5579ff946210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-07T18:15:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffa95500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57954/0 (socket says 172.21.15.12:57954) 2023-07-07T18:15:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392effd700 1 -- 172.21.15.12:0/3453850203 learned_addr learned my addr 172.21.15.12:0/3453850203 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392e7fc700 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 0x5579ffa70980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392f7fe700 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392effd700 1 -- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 msgr2=0x5579ffa70980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392effd700 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 0x5579ffa70980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392effd700 1 -- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 msgr2=0x5579ffa4db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392effd700 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392effd700 1 -- 172.21.15.12:0/3453850203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39300cd390 con 0x5579ffa4d740 2023-07-07T18:15:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392e7fc700 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 0x5579ffa70980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:22.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392f7fe700 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f392effd700 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffa95500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3920003e10 tx=0x7f39200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f1c6d63ca709de server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f390e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-07-07T18:15:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.763+0000 7f390e7fc700 1 -- 172.21.15.12:0/3453850203 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392002b070 con 0x5579ffa4d740 2023-07-07T18:15:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f390e7fc700 1 -- 172.21.15.12:0/3453850203 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39200119c0 con 0x5579ffa4d740 2023-07-07T18:15:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f3941a47b80 1 -- 172.21.15.12:0/3453850203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579ffa42780 con 0x5579ffa4d740 2023-07-07T18:15:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f390e7fc700 1 -- 172.21.15.12:0/3453850203 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3920011b80 con 0x5579ffa4d740 2023-07-07T18:15:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f3941a47b80 10 client.4866 fetch_fsmap learned FSMap version 9 2023-07-07T18:15:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f3941a47b80 1 -- 172.21.15.12:0/3453850203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5579ff7ced90 con 0x5579ffa4d740 2023-07-07T18:15:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f390e7fc700 1 -- 172.21.15.12:0/3453850203 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5579ffa42780 con 0x5579ffa4d740 2023-07-07T18:15:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f390e7fc700 1 -- 172.21.15.12:0/3453850203 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3920037070 con 0x5579ffa4d740 2023-07-07T18:15:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f3941a47b80 10 client.4866 fetch_fsmap finished waiting for FSMap version 9 2023-07-07T18:15:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f3941a47b80 10 client.4866 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-07T18:15:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f3941a47b80 20 client.4866 populate_metadata read hostname 'smithi012' 2023-07-07T18:15:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f3941a47b80 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x5579ffaa7e50 0x5579ffaa8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f3941a47b80 4 client.4866 mds_command: new command op to 4296 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-07T18:15:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f3941a47b80 1 -- 172.21.15.12:0/3453850203 --> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5579ff999e60 con 0x5579ffaa7e50 2023-07-07T18:15:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.764+0000 7f392e7fc700 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x5579ffaa7e50 0x5579ffaa8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.765+0000 7f392e7fc700 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x5579ffaa7e50 0x5579ffaa8220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=560341ce879f1004 server_cookie=819dc1a131b1ac09 in_seq=0 out_seq=0 2023-07-07T18:15:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.765+0000 7f390e7fc700 10 client.4866 ms_handle_connect on v2:172.21.15.160:6835/3361031905 2023-07-07T18:15:22.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.765+0000 7f390e7fc700 1 -- 172.21.15.12:0/3453850203 <== mds.0 v2:172.21.15.160:6835/3361031905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5579ff999e60 con 0x5579ffaa7e50 2023-07-07T18:15:22.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f390e7fc700 10 client.4866 handle_command_reply: tid=0 2023-07-07T18:15:22.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 client.4866 shutdown 2023-07-07T18:15:22.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 -- 172.21.15.12:0/3453850203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 msgr2=0x5579ffa95500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffa95500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3920003e10 tx=0x7f39200047c0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 -- 172.21.15.12:0/3453850203 shutdown_connections 2023-07-07T18:15:22.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x5579ffaa7e50 0x5579ffaa8220 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f390e7fc700 0 client.4866 ms_handle_reset on v2:172.21.15.160:6835/3361031905 2023-07-07T18:15:22.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffa95500 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 --2- 172.21.15.12:0/3453850203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 0x5579ffa70980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 -- 172.21.15.12:0/3453850203 >> 172.21.15.12:0/3453850203 conn(0x5579ffa44fc0 msgr2=0x5579ffa76e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 -- 172.21.15.12:0/3453850203 shutdown_connections 2023-07-07T18:15:22.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 1 -- 172.21.15.12:0/3453850203 wait complete. 2023-07-07T18:15:22.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.766+0000 7f3941a47b80 20 client.4866 trim_cache size 0 max 16384 2023-07-07T18:15:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.784+0000 7f3941a47b80 1 Processor -- start 2023-07-07T18:15:22.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.784+0000 7f3941a47b80 1 -- start start 2023-07-07T18:15:22.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4d740 0x5579ffa760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4ff50 0x5579ffa953c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa77d80 0x5579ffa95900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f3941a47b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ffa8f140 con 0x5579ffa77d80 2023-07-07T18:15:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f3941a47b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ffa8ef30 con 0x5579ffa4ff50 2023-07-07T18:15:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f3941a47b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579ffaa4210 con 0x5579ffa4d740 2023-07-07T18:15:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa77d80 0x5579ffa95900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa77d80 0x5579ffa95900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57966/0 (socket says 172.21.15.12:57966) 2023-07-07T18:15:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392f7fe700 1 -- 172.21.15.12:0/4166086659 learned_addr learned my addr 172.21.15.12:0/4166086659 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:22.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392f7fe700 1 -- 172.21.15.12:0/4166086659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4d740 msgr2=0x5579ffa760e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392f7fe700 1 --2- 172.21.15.12:0/4166086659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4d740 0x5579ffa760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392f7fe700 1 -- 172.21.15.12:0/4166086659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4ff50 msgr2=0x5579ffa953c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392e7fc700 1 --2- 172.21.15.12:0/4166086659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4ff50 0x5579ffa953c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392f7fe700 1 --2- 172.21.15.12:0/4166086659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4ff50 0x5579ffa953c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392f7fe700 1 -- 172.21.15.12:0/4166086659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579ff7b7c10 con 0x5579ffa77d80 2023-07-07T18:15:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f392f7fe700 1 --2- 172.21.15.12:0/4166086659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa77d80 0x5579ffa95900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f39280601c0 tx=0x7f3928057d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7cbfc03031c0c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.785+0000 7f3925ffb700 1 -- 172.21.15.12:0/4166086659 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392805c160 con 0x5579ffa77d80 2023-07-07T18:15:22.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3925ffb700 1 -- 172.21.15.12:0/4166086659 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3928056740 con 0x5579ffa77d80 2023-07-07T18:15:22.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3925ffb700 1 -- 172.21.15.12:0/4166086659 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928057890 con 0x5579ffa77d80 2023-07-07T18:15:22.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3941a47b80 1 -- 172.21.15.12:0/4166086659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa77d80 msgr2=0x5579ffa95900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3941a47b80 1 --2- 172.21.15.12:0/4166086659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa77d80 0x5579ffa95900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f39280601c0 tx=0x7f3928057d80 comp rx=0 tx=0).stop 2023-07-07T18:15:22.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3941a47b80 1 -- 172.21.15.12:0/4166086659 shutdown_connections 2023-07-07T18:15:22.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3941a47b80 1 --2- 172.21.15.12:0/4166086659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa77d80 0x5579ffa95900 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3941a47b80 1 --2- 172.21.15.12:0/4166086659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4d740 0x5579ffa760e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3941a47b80 1 --2- 172.21.15.12:0/4166086659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa4ff50 0x5579ffa953c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3941a47b80 1 -- 172.21.15.12:0/4166086659 >> 172.21.15.12:0/4166086659 conn(0x5579ffa44fc0 msgr2=0x5579ffa4e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:22.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3941a47b80 1 -- 172.21.15.12:0/4166086659 shutdown_connections 2023-07-07T18:15:22.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.786+0000 7f3941a47b80 1 -- 172.21.15.12:0/4166086659 wait complete. 2023-07-07T18:15:22.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.787+0000 7f3941a47b80 1 -- start start 2023-07-07T18:15:22.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.787+0000 7f3941a47b80 1 Processor -- start 2023-07-07T18:15:22.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffab0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 0x5579ffaf0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f3941a47b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f3941a47b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ffa91a30 con 0x5579ffa4d740 2023-07-07T18:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f3941a47b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579ffab1870 con 0x5579ffa77d80 2023-07-07T18:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f3941a47b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579ffa76270 con 0x5579ffa4ff50 2023-07-07T18:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f3941a47b80 10 client.0 _ll_register_callbacks cb 0x5579ff946210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-07T18:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffab0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffab0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57968/0 (socket says 172.21.15.12:57968) 2023-07-07T18:15:22.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392effd700 1 -- 172.21.15.12:0/1524866515 learned_addr learned my addr 172.21.15.12:0/1524866515 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:22.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392f7fe700 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392e7fc700 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 0x5579ffaf0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392effd700 1 -- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 msgr2=0x5579ffaf0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:22.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392effd700 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 0x5579ffaf0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392effd700 1 -- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 msgr2=0x5579ffa4e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392effd700 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392effd700 1 -- 172.21.15.12:0/1524866515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3930158a50 con 0x5579ffa4d740 2023-07-07T18:15:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392f7fe700 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f392effd700 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffab0d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3920006c30 tx=0x7f3920004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a47fd7c2f86ba92 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:22.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f390e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-07-07T18:15:22.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f390e7fc700 1 -- 172.21.15.12:0/1524866515 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920011d30 con 0x5579ffa4d740 2023-07-07T18:15:22.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f390e7fc700 1 -- 172.21.15.12:0/1524866515 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3920030470 con 0x5579ffa4d740 2023-07-07T18:15:22.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f3941a47b80 1 -- 172.21.15.12:0/1524866515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3920003c40 con 0x5579ffa4d740 2023-07-07T18:15:22.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.788+0000 7f390e7fc700 1 -- 172.21.15.12:0/1524866515 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3920030630 con 0x5579ffa4d740 2023-07-07T18:15:22.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f3941a47b80 10 client.4872 fetch_fsmap learned FSMap version 9 2023-07-07T18:15:22.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f3941a47b80 1 -- 172.21.15.12:0/1524866515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5579ff7f5200 con 0x5579ffa4d740 2023-07-07T18:15:22.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f390e7fc700 1 -- 172.21.15.12:0/1524866515 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920003c40 con 0x5579ffa4d740 2023-07-07T18:15:22.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f390e7fc700 1 -- 172.21.15.12:0/1524866515 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f39200037a0 con 0x5579ffa4d740 2023-07-07T18:15:22.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f3941a47b80 10 client.4872 fetch_fsmap finished waiting for FSMap version 9 2023-07-07T18:15:22.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f3941a47b80 10 client.4872 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-07T18:15:22.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f3941a47b80 20 client.4872 populate_metadata read hostname 'smithi012' 2023-07-07T18:15:22.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f3941a47b80 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x5579ffaede40 0x5579ffa4eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:22.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f3941a47b80 4 client.4872 mds_command: new command op to 4296 tid=0[{"prefix": "status"}] 2023-07-07T18:15:22.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f3941a47b80 1 -- 172.21.15.12:0/1524866515 --> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5579ff95c000 con 0x5579ffaede40 2023-07-07T18:15:22.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f392e7fc700 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x5579ffaede40 0x5579ffa4eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:22.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f390e7fc700 10 client.4872 ms_handle_connect on v2:172.21.15.160:6835/3361031905 2023-07-07T18:15:22.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.789+0000 7f392e7fc700 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x5579ffaede40 0x5579ffa4eae0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56043de508e77206 server_cookie=5f13941d80755126 in_seq=0 out_seq=0 2023-07-07T18:15:22.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f390e7fc700 1 -- 172.21.15.12:0/1524866515 <== mds.0 v2:172.21.15.160:6835/3361031905 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5579ff95c000 con 0x5579ffaede40 2023-07-07T18:15:22.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f390e7fc700 10 client.4872 handle_command_reply: tid=0 2023-07-07T18:15:22.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 client.4872 shutdown 2023-07-07T18:15:22.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 -- 172.21.15.12:0/1524866515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 msgr2=0x5579ffab0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffab0d80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3920006c30 tx=0x7f3920004750 comp rx=0 tx=0).stop 2023-07-07T18:15:22.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 -- 172.21.15.12:0/1524866515 shutdown_connections 2023-07-07T18:15:22.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:6835/3361031905,v1:172.21.15.160:6837/3361031905] conn(0x5579ffaede40 0x5579ffa4eae0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5579ffa77d80 0x5579ffa4e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5579ffa4d740 0x5579ffab0d80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f390e7fc700 0 client.4872 ms_handle_reset on v2:172.21.15.160:6835/3361031905 2023-07-07T18:15:22.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 --2- 172.21.15.12:0/1524866515 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5579ffa4ff50 0x5579ffaf0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 -- 172.21.15.12:0/1524866515 >> 172.21.15.12:0/1524866515 conn(0x5579ffa44fc0 msgr2=0x5579ffaa7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:22.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 -- 172.21.15.12:0/1524866515 shutdown_connections 2023-07-07T18:15:22.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 1 -- 172.21.15.12:0/1524866515 wait complete. 2023-07-07T18:15:22.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f3941a47b80 20 client.4872 trim_cache size 0 max 16384 2023-07-07T18:15:22.809 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-07-07T18:15:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "6f09c1a9-a759-4e94-bed7-68b16c28b7f9", 2023-07-07T18:15:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-07-07T18:15:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4296, 2023-07-07T18:15:22.810 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-07-07T18:15:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-07-07T18:15:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-07-07T18:15:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 36.562750518000001, 2023-07-07T18:15:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 9, 2023-07-07T18:15:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 29, 2023-07-07T18:15:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 29, 2023-07-07T18:15:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 42.027712909000002 2023-07-07T18:15:22.811 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-07-07T18:15:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 -- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f391006ace0 msgr2=0x7f391006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f391006ace0 0x7f391006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f39200097c0 tx=0x7f3920008030 comp rx=0 tx=0).stop 2023-07-07T18:15:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 -- 172.21.15.12:0/1617508646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3930156880 msgr2=0x7f3930159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:22.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3930156880 0x7f3930159250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f392800cc20 tx=0x7f392800a060 comp rx=0 tx=0).stop 2023-07-07T18:15:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 -- 172.21.15.12:0/1617508646 shutdown_connections 2023-07-07T18:15:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f391006ace0 0x7f391006d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3930156880 0x7f3930159250 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39300aed30 0x7f39301f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 --2- 172.21.15.12:0/1617508646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39300cc1d0 0x7f39301f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.790+0000 7f39358c2700 1 -- 172.21.15.12:0/1617508646 >> 172.21.15.12:0/1617508646 conn(0x7f393006d4a0 msgr2=0x7f3930160580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.791+0000 7f39358c2700 1 -- 172.21.15.12:0/1617508646 shutdown_connections 2023-07-07T18:15:22.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:22.791+0000 7f39358c2700 1 -- 172.21.15.12:0/1617508646 wait complete. 2023-07-07T18:15:22.816 INFO:teuthology.run_tasks:Running task kclient... 2023-07-07T18:15:22.833 INFO:tasks.kclient:Mounting kernel clients... 2023-07-07T18:15:22.834 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-07T18:15:22.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:22.834 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-07-07T18:15:22.852 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-07T18:15:22.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:22.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-07T18:15:22.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:22.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-07-07T18:15:23.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.061 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-07-07T18:15:23.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.079 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-07-07T18:15:23.149 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2023-07-07T18:15:23.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T18:15:23.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.151 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-07-07T18:15:23.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2023-07-07T18:15:23.247 INFO:teuthology.orchestra.run.smithi160.stderr:Cannot find device "ceph-brx" 2023-07-07T18:15:23.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T18:15:23.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.249 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-07-07T18:15:23.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.310 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2023-07-07T18:15:23.380 INFO:teuthology.orchestra.run.smithi160.stderr:Cannot find device "ceph-brx" 2023-07-07T18:15:23.381 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T18:15:23.382 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-07T18:15:23.382 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-07T18:15:23.382 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-07T18:15:23.383 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-07T18:15:23.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.507+0000 7f1b5532e700 1 Processor -- start 2023-07-07T18:15:23.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.507+0000 7f1b5532e700 1 -- start start 2023-07-07T18:15:23.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.508+0000 7f1b5532e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 0x7f1b500cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:23.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.508+0000 7f1b5532e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b5006c060 0x7f1b500702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:23.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.508+0000 7f1b5532e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b50070c60 con 0x7f1b50070820 2023-07-07T18:15:23.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.508+0000 7f1b5532e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5006c4d0 con 0x7f1b5006c060 2023-07-07T18:15:23.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.508+0000 7f1b5532e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500c9510 con 0x7f1b50158ef0 2023-07-07T18:15:23.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.508+0000 7f1b4e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b5006c060 0x7f1b500702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:23.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.508+0000 7f1b4f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1b50070820 0x7f1b500ca290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55178/0 (socket says 172.21.15.12:55178) 2023-07-07T18:15:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.508+0000 7f1b4f7fe700 1 -- 172.21.15.12:0/2218867661 learned_addr learned my addr 172.21.15.12:0/2218867661 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4effd700 1 --2- 172.21.15.12:0/2218867661 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 0x7f1b500cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4e7fc700 1 -- 172.21.15.12:0/2218867661 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 msgr2=0x7f1b500cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4e7fc700 1 --2- 172.21.15.12:0/2218867661 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 0x7f1b500cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4e7fc700 1 -- 172.21.15.12:0/2218867661 >> v1:172.21.15.12:6789/0 conn(0x7f1b50070820 legacy=0x7f1b500ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4e7fc700 1 -- 172.21.15.12:0/2218867661 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500cd6a0 con 0x7f1b5006c060 2023-07-07T18:15:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4dffb700 1 -- 172.21.15.12:0/2218867661 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990423347 0 0) 0x7f1b50070c60 con 0x7f1b50070820 2023-07-07T18:15:23.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4e7fc700 1 --2- 172.21.15.12:0/2218867661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b5006c060 0x7f1b500702e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009840 tx=0x7f1b40009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97cd690dfe4f3f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4dffb700 1 -- 172.21.15.12:0/2218867661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40011830 con 0x7f1b5006c060 2023-07-07T18:15:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4dffb700 1 -- 172.21.15.12:0/2218867661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40011990 con 0x7f1b5006c060 2023-07-07T18:15:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.509+0000 7f1b4dffb700 1 -- 172.21.15.12:0/2218867661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40011d20 con 0x7f1b5006c060 2023-07-07T18:15:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.510+0000 7f1b5532e700 1 -- 172.21.15.12:0/2218867661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b5006c060 msgr2=0x7f1b500702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.510+0000 7f1b5532e700 1 --2- 172.21.15.12:0/2218867661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b5006c060 0x7f1b500702e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009840 tx=0x7f1b40009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.510+0000 7f1b5532e700 1 -- 172.21.15.12:0/2218867661 shutdown_connections 2023-07-07T18:15:23.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.510+0000 7f1b5532e700 1 --2- 172.21.15.12:0/2218867661 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 0x7f1b500cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.510+0000 7f1b5532e700 1 --2- 172.21.15.12:0/2218867661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b5006c060 0x7f1b500702e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.510+0000 7f1b5532e700 1 -- 172.21.15.12:0/2218867661 >> 172.21.15.12:0/2218867661 conn(0x7f1b500b0ef0 msgr2=0x7f1b500ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.510+0000 7f1b5532e700 1 -- 172.21.15.12:0/2218867661 shutdown_connections 2023-07-07T18:15:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.510+0000 7f1b5532e700 1 -- 172.21.15.12:0/2218867661 wait complete. 2023-07-07T18:15:23.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.511+0000 7f1b5532e700 1 Processor -- start 2023-07-07T18:15:23.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.511+0000 7f1b5532e700 1 -- start start 2023-07-07T18:15:23.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b5532e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b5006c060 0x7f1b50152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:23.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b5532e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b50070820 0x7f1b500c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:23.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b5532e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 0x7f1b500ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:23.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b5532e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500c7700 con 0x7f1b50070820 2023-07-07T18:15:23.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b5532e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500ac9b0 con 0x7f1b5006c060 2023-07-07T18:15:23.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b5532e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500c7930 con 0x7f1b50158ef0 2023-07-07T18:15:23.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b50070820 0x7f1b500c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:23.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b50070820 0x7f1b500c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57984/0 (socket says 172.21.15.12:57984) 2023-07-07T18:15:23.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4e7fc700 1 -- 172.21.15.12:0/2881904890 learned_addr learned my addr 172.21.15.12:0/2881904890 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:23.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4effd700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b5006c060 0x7f1b50152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:23.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4f7fe700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 0x7f1b500ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:23.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4e7fc700 1 -- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 msgr2=0x7f1b500ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:23.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4e7fc700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 0x7f1b500ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:23.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4e7fc700 1 -- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b5006c060 msgr2=0x7f1b50152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:23.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4e7fc700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b5006c060 0x7f1b50152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:23.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.512+0000 7f1b4e7fc700 1 -- 172.21.15.12:0/2881904890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400094a0 con 0x7f1b50070820 2023-07-07T18:15:23.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.513+0000 7f1b4e7fc700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b50070820 0x7f1b500c71c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1b400090b0 tx=0x7f1b40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:23.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.513+0000 7f1b377fe700 1 -- 172.21.15.12:0/2881904890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b400036a0 con 0x7f1b50070820 2023-07-07T18:15:23.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.513+0000 7f1b377fe700 1 -- 172.21.15.12:0/2881904890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4001f070 con 0x7f1b50070820 2023-07-07T18:15:23.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.513+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b500c7c10 con 0x7f1b50070820 2023-07-07T18:15:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.513+0000 7f1b377fe700 1 -- 172.21.15.12:0/2881904890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40003a60 con 0x7f1b50070820 2023-07-07T18:15:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.513+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b500c81d0 con 0x7f1b50070820 2023-07-07T18:15:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.514+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b50073910 con 0x7f1b50070820 2023-07-07T18:15:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.514+0000 7f1b377fe700 1 -- 172.21.15.12:0/2881904890 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b40003bc0 con 0x7f1b50070820 2023-07-07T18:15:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.515+0000 7f1b377fe700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b3c06ace0 0x7f1b3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:23.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.515+0000 7f1b377fe700 1 -- 172.21.15.12:0/2881904890 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b40021070 con 0x7f1b50070820 2023-07-07T18:15:23.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.515+0000 7f1b4effd700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b3c06ace0 0x7f1b3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:23.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.516+0000 7f1b4effd700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b3c06ace0 0x7f1b3c06d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b44006b20 tx=0x7f1b44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:23.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.519+0000 7f1b377fe700 1 -- 172.21.15.12:0/2881904890 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b40055e60 con 0x7f1b50070820 2023-07-07T18:15:23.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.767+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1b500cefc0 con 0x7f1b50070820 2023-07-07T18:15:23.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.767+0000 7f1b377fe700 1 -- 172.21.15.12:0/2881904890 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1b40059480 con 0x7f1b50070820 2023-07-07T18:15:23.769 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-07T18:15:23.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b3c06ace0 msgr2=0x7f1b3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:23.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b3c06ace0 0x7f1b3c06d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b44006b20 tx=0x7f1b44008040 comp rx=0 tx=0).stop 2023-07-07T18:15:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b50070820 msgr2=0x7f1b500c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b50070820 0x7f1b500c71c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1b400090b0 tx=0x7f1b40004750 comp rx=0 tx=0).stop 2023-07-07T18:15:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 shutdown_connections 2023-07-07T18:15:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b3c06ace0 0x7f1b3c06d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b50158ef0 0x7f1b500ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b5006c060 0x7f1b50152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:23.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 --2- 172.21.15.12:0/2881904890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b50070820 0x7f1b500c71c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:23.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 >> 172.21.15.12:0/2881904890 conn(0x7f1b500b0ef0 msgr2=0x7f1b50155850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:23.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 shutdown_connections 2023-07-07T18:15:23.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:23.769+0000 7f1b5532e700 1 -- 172.21.15.12:0/2881904890 wait complete. 2023-07-07T18:15:23.783 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-07T18:15:23.783 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-07T18:15:23.784 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-07-07T18:15:23.784 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-07T18:15:23.784 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-07T18:15:23.784 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-07T18:15:23.784 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-07T18:15:23.785 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-07T18:15:23.785 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-07T18:15:23.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.786 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-07-07T18:15:23.803 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:15:23.803 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:15:23.803 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:15:23.803 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:23.803 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-07-07T18:15:23.804 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:23.804 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:23.804 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:23.804 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:23.804 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:23.804 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-07T18:15:23.804 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:23.805 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-07T18:15:23.805 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42111sec preferred_lft 42111sec 2023-07-07T18:15:23.805 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2023-07-07T18:15:23.805 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:23.805 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:23.805 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:23.806 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-07T18:15:23.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.806 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:15:23.806 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:15:23.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2023-07-07T18:15:23.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2023-07-07T18:15:23.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2023-07-07T18:15:23.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-07T18:15:23.807 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:15:23.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.922 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-07T18:15:23.949 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-07-07T18:15:23.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:23.951 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-07-07T18:15:24.010 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-07-07T18:15:24.010 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-07T18:15:24.010 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-07T18:15:24.011 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-07T18:15:24.011 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-07T18:15:24.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:24.011 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:15:24.012 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:15:24.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-07T18:15:24.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-07T18:15:24.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-07T18:15:24.013 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:15:24.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:24.118 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-07-07T18:15:24.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:24.136 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2023-07-07T18:15:24.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:24.193 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:15:24.193 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:15:24.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-07T18:15:24.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-07T18:15:24.194 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:15:24.288 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-07T18:15:24.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:24.289 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:15:24.289 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:15:24.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-07T18:15:24.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-07T18:15:24.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-07T18:15:24.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-07T18:15:24.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-07T18:15:24.290 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:15:24.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:24.495 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:15:24.496 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:15:24.496 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-07-07T18:15:24.496 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2023-07-07T18:15:24.496 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:15:24.617 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:15:24.617 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-07T18:15:24.636 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-07T18:15:24.637 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:15:24.637 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-07T18:15:24.693 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-07T18:15:24.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:24.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-07T18:15:24.781 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-07T18:15:24.781 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-07T18:15:24.782 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2023-07-07T18:15:24.914 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-07T18:15:24.915 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-07T18:15:24.915 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2023-07-07T18:15:24.915 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:15:24.915 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:15:24.981 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-07T18:15:24.981 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-07T18:15:24.981 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2023-07-07T18:15:24.981 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:15:24.981 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:15:24.981 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-07-07T18:15:24.982 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-07-07T18:15:24.982 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6f09c1a9-a759-4e94-bed7-68b16c28b7f9" will pass to kernel 2023-07-07T18:15:24.983 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-07T18:15:24.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:24.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-07T18:15:25.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:25.011 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:25.083 INFO:teuthology.orchestra.run.smithi012.stdout:client4628 2023-07-07T18:15:25.084 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:15:25.084 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:25.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:25.142 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:25.215 INFO:teuthology.orchestra.run.smithi012.stdout:client4628 2023-07-07T18:15:25.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:25.216 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:25.287 INFO:teuthology.orchestra.run.smithi012.stdout:client4628 2023-07-07T18:15:25.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:25.288 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6f09c1a9-a759-4e94-bed7-68b16c28b7f9.client4628/status') 2023-07-07T18:15:25.368 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.4628 (3)172.21.15.12:0/1191356125 2023-07-07T18:15:25.369 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2023-07-07T18:15:25.369 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2023-07-07T18:15:25.369 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2023-07-07T18:15:25.369 INFO:teuthology.orchestra.run.smithi012.stderr:70 bytes copied, 2.4013e-05 s, 2.9 MB/s 2023-07-07T18:15:25.370 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-07-07T18:15:25.371 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-07T18:15:25.371 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-07T18:15:25.371 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-07T18:15:25.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.533+0000 7fe476bc9700 1 Processor -- start 2023-07-07T18:15:25.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.533+0000 7fe476bc9700 1 -- start start 2023-07-07T18:15:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.534+0000 7fe476bc9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470165440 0x7fe470167820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.534+0000 7fe476bc9700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe470160f40 con 0x7fe47006a880 2023-07-07T18:15:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.534+0000 7fe476bc9700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4700b1c70 con 0x7fe47015c5a0 2023-07-07T18:15:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.534+0000 7fe476bc9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700b21f0 con 0x7fe470165440 2023-07-07T18:15:25.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.534+0000 7fe46ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe47006a880 0x7fe470160830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55192/0 (socket says 172.21.15.12:55192) 2023-07-07T18:15:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.534+0000 7fe46ffff700 1 -- 172.21.15.12:0/3529797526 learned_addr learned my addr 172.21.15.12:0/3529797526 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.534+0000 7fe475166700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470165440 0x7fe470167820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.534+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820173853 0 0) 0x7fe470160f40 con 0x7fe47006a880 2023-07-07T18:15:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.534+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4600035b0 con 0x7fe47006a880 2023-07-07T18:15:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2528753828 0 0) 0x7fe4600035b0 con 0x7fe47006a880 2023-07-07T18:15:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470165440 msgr2=0x7fe470167820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470165440 0x7fe470167820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:25.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 >> v1:172.21.15.160:6789/0 conn(0x7fe47015c5a0 legacy=0x7fe470160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700b1f10 con 0x7fe47006a880 2023-07-07T18:15:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fe45c001670 con 0x7fe47006a880 2023-07-07T18:15:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 >> v1:172.21.15.12:6789/0 conn(0x7fe47006a880 legacy=0x7fe470160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe460003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470165440 0x7fe460004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:25.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe460004d90 0x7fe460005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:25.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700b21f0 con 0x7fe460003a30 2023-07-07T18:15:25.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46000bb20 con 0x7fe460004d90 2023-07-07T18:15:25.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46000bce0 con 0x7fe470165440 2023-07-07T18:15:25.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe474965700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe460003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:25.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe46ffff700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470165440 0x7fe460004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:25.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe475166700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe460004d90 0x7fe460005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:25.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe474965700 1 -- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470165440 msgr2=0x7fe460004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:25.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe474965700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470165440 0x7fe460004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe474965700 1 -- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe460004d90 msgr2=0x7fe460005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe474965700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe460004d90 0x7fe460005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe474965700 1 -- 172.21.15.12:0/3529797526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4600035b0 con 0x7fe460003a30 2023-07-07T18:15:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.535+0000 7fe474965700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe460003e40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe4640017c0 tx=0x7fe460005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9061a6afb4c2517 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640052d0 con 0x7fe460003a30 2023-07-07T18:15:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe464005430 con 0x7fe460003a30 2023-07-07T18:15:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe46f7fe700 1 -- 172.21.15.12:0/3529797526 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640038c0 con 0x7fe460003a30 2023-07-07T18:15:25.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe476bc9700 1 -- 172.21.15.12:0/3529797526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 msgr2=0x7fe460003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:25.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe476bc9700 1 --2- 172.21.15.12:0/3529797526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe460003e40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe4640017c0 tx=0x7fe460005880 comp rx=0 tx=0).stop 2023-07-07T18:15:25.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe475166700 1 -- 172.21.15.12:0/3529797526 reap_dead start 2023-07-07T18:15:25.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe476bc9700 1 -- 172.21.15.12:0/3529797526 shutdown_connections 2023-07-07T18:15:25.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe476bc9700 1 -- 172.21.15.12:0/3529797526 >> 172.21.15.12:0/3529797526 conn(0x7fe47006d450 msgr2=0x7fe47006d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:25.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe476bc9700 1 -- 172.21.15.12:0/3529797526 shutdown_connections 2023-07-07T18:15:25.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.536+0000 7fe476bc9700 1 -- 172.21.15.12:0/3529797526 wait complete. 2023-07-07T18:15:25.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.537+0000 7fe476bc9700 1 Processor -- start 2023-07-07T18:15:25.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.537+0000 7fe476bc9700 1 -- start start 2023-07-07T18:15:25.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.538+0000 7fe476bc9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe470154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:25.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.538+0000 7fe476bc9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4700c76d0 0x7fe4700b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:25.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.538+0000 7fe476bc9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470153b30 0x7fe470153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:25.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.538+0000 7fe476bc9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c9350 con 0x7fe460003a30 2023-07-07T18:15:25.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.538+0000 7fe476bc9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c9630 con 0x7fe4700c76d0 2023-07-07T18:15:25.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.538+0000 7fe476bc9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4700c44c0 con 0x7fe470153b30 2023-07-07T18:15:25.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.538+0000 7fe474965700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe470154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:25.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.538+0000 7fe474965700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe470154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58006/0 (socket says 172.21.15.12:58006) 2023-07-07T18:15:25.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.538+0000 7fe474965700 1 -- 172.21.15.12:0/4019270342 learned_addr learned my addr 172.21.15.12:0/4019270342 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:25.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe475166700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470153b30 0x7fe470153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:25.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe46ffff700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4700c76d0 0x7fe4700b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:25.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe474965700 1 -- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470153b30 msgr2=0x7fe470153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:25.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe474965700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470153b30 0x7fe470153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:25.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe474965700 1 -- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4700c76d0 msgr2=0x7fe4700b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:25.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe474965700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4700c76d0 0x7fe4700b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:25.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe474965700 1 -- 172.21.15.12:0/4019270342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700c47a0 con 0x7fe460003a30 2023-07-07T18:15:25.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe474965700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe470154780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe46000baf0 tx=0x7fe464001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe46d7fa700 1 -- 172.21.15.12:0/4019270342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe464007240 con 0x7fe460003a30 2023-07-07T18:15:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe46d7fa700 1 -- 172.21.15.12:0/4019270342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4640073a0 con 0x7fe460003a30 2023-07-07T18:15:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe46d7fa700 1 -- 172.21.15.12:0/4019270342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe464007730 con 0x7fe460003a30 2023-07-07T18:15:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4700c9350 con 0x7fe460003a30 2023-07-07T18:15:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.539+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4700c9910 con 0x7fe460003a30 2023-07-07T18:15:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.540+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe470072160 con 0x7fe460003a30 2023-07-07T18:15:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.541+0000 7fe46d7fa700 1 -- 172.21.15.12:0/4019270342 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe464003680 con 0x7fe460003a30 2023-07-07T18:15:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.541+0000 7fe46d7fa700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe45406ace0 0x7fe45406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:25.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.541+0000 7fe46d7fa700 1 -- 172.21.15.12:0/4019270342 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe46408a6b0 con 0x7fe460003a30 2023-07-07T18:15:25.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.541+0000 7fe46ffff700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe45406ace0 0x7fe45406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:25.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.542+0000 7fe46ffff700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe45406ace0 0x7fe45406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe4700c43b0 tx=0x7fe45c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:25.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.545+0000 7fe46d7fa700 1 -- 172.21.15.12:0/4019270342 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe464055500 con 0x7fe460003a30 2023-07-07T18:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.796+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe4700cd300 con 0x7fe460003a30 2023-07-07T18:15:25.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.796+0000 7fe46d7fa700 1 -- 172.21.15.12:0/4019270342 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe4700cd300 con 0x7fe460003a30 2023-07-07T18:15:25.798 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-07T18:15:25.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe45406ace0 msgr2=0x7fe45406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:25.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe45406ace0 0x7fe45406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe4700c43b0 tx=0x7fe45c009040 comp rx=0 tx=0).stop 2023-07-07T18:15:25.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 msgr2=0x7fe470154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe470154780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe46000baf0 tx=0x7fe464001120 comp rx=0 tx=0).stop 2023-07-07T18:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 shutdown_connections 2023-07-07T18:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe45406ace0 0x7fe45406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe470153b30 0x7fe470153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe460003a30 0x7fe470154780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 --2- 172.21.15.12:0/4019270342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4700c76d0 0x7fe4700b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:25.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 >> 172.21.15.12:0/4019270342 conn(0x7fe47006d450 msgr2=0x7fe47015cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 shutdown_connections 2023-07-07T18:15:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:25.798+0000 7fe476bc9700 1 -- 172.21.15.12:0/4019270342 wait complete. 2023-07-07T18:15:25.812 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-07T18:15:25.813 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-07T18:15:25.813 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-07-07T18:15:25.813 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-07T18:15:25.813 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-07T18:15:25.813 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-07T18:15:25.814 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-07T18:15:25.814 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-07T18:15:25.814 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-07T18:15:25.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:25.814 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-07-07T18:15:25.832 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:15:25.832 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:15:25.833 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:15:25.833 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:25.833 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-07-07T18:15:25.833 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:25.833 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:25.833 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:25.833 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:25.833 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:25.834 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-07T18:15:25.834 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:25.834 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-07T18:15:25.834 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42109sec preferred_lft 42109sec 2023-07-07T18:15:25.834 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2023-07-07T18:15:25.834 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:25.834 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:25.835 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:25.835 INFO:teuthology.orchestra.run.smithi012.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-07T18:15:25.835 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 9a:c7:a8:8b:1f:40 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:25.835 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-07T18:15:25.835 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:25.835 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3c3f:1eff:fef4:546e/64 scope link 2023-07-07T18:15:25.835 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:25.835 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-07T18:15:25.836 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 9a:c7:a8:8b:1f:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-07T18:15:25.836 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::98c7:a8ff:fe8b:1f40/64 scope link 2023-07-07T18:15:25.836 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:25.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:25.837 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-07T18:15:25.899 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-07-07T18:15:25.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:25.900 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-07-07T18:15:25.959 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-07-07T18:15:25.959 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-07T18:15:25.959 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-07T18:15:25.959 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-07T18:15:25.959 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-07T18:15:25.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:25.960 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:15:25.960 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:15:25.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-07T18:15:25.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-07T18:15:25.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-07T18:15:25.961 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:15:26.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.066 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-07-07T18:15:26.083 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-07T18:15:26.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.084 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2023-07-07T18:15:26.141 INFO:teuthology.orchestra.run.smithi012.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-07T18:15:26.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.143 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:15:26.143 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:15:26.144 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-07T18:15:26.144 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-07T18:15:26.145 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:15:26.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-07T18:15:26.274 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:15:26.275 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:15:26.275 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:15:26.275 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:26.275 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-07-07T18:15:26.275 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:26.275 INFO:teuthology.orchestra.run.smithi012.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-07T18:15:26.276 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3e:49:aa:bd:f0:93 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-07T18:15:26.276 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-07T18:15:26.276 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:26.276 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3c49:aaff:febd:f093/64 scope link 2023-07-07T18:15:26.276 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:26.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-07T18:15:26.380 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:15:26.380 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:15:26.380 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:15:26.380 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:26.380 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-07-07T18:15:26.381 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:26.381 INFO:teuthology.orchestra.run.smithi012.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-07T18:15:26.381 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3e:49:aa:bd:f0:93 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-07T18:15:26.381 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-07T18:15:26.381 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:26.381 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3c49:aaff:febd:f093/64 scope link 2023-07-07T18:15:26.381 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:26.396 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-07T18:15:26.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.397 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:15:26.397 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:15:26.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-07T18:15:26.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-07T18:15:26.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-07T18:15:26.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-07T18:15:26.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-07T18:15:26.399 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:15:26.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.618 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:15:26.619 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:15:26.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2023-07-07T18:15:26.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.1 master ceph-brx 2023-07-07T18:15:26.619 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:15:26.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:15:26.740 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-07T18:15:26.774 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-07T18:15:26.774 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:15:26.775 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-07T18:15:26.831 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-07T18:15:26.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-07T18:15:26.918 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-07T18:15:26.919 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-07T18:15:26.919 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2023-07-07T18:15:26.927 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-07T18:15:26.928 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-07T18:15:26.928 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2023-07-07T18:15:26.928 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:15:26.928 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:15:26.954 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-07T18:15:26.955 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-07T18:15:26.955 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2023-07-07T18:15:26.955 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:15:26.955 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:15:26.955 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-07-07T18:15:26.955 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-07-07T18:15:26.956 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=6f09c1a9-a759-4e94-bed7-68b16c28b7f9" will pass to kernel 2023-07-07T18:15:26.960 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-07T18:15:26.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-07T18:15:26.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:26.995 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:27.069 INFO:teuthology.orchestra.run.smithi012.stdout:client4890 2023-07-07T18:15:27.069 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:15:27.070 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:27.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:27.126 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:27.199 INFO:teuthology.orchestra.run.smithi012.stdout:client4890 2023-07-07T18:15:27.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:27.200 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:27.273 INFO:teuthology.orchestra.run.smithi012.stdout:client4890 2023-07-07T18:15:27.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:27.274 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6f09c1a9-a759-4e94-bed7-68b16c28b7f9.client4890/status') 2023-07-07T18:15:27.354 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.4890 (3)192.168.0.2:0/3292694352 2023-07-07T18:15:27.354 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2023-07-07T18:15:27.355 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2023-07-07T18:15:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2023-07-07T18:15:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:69 bytes copied, 2.4974e-05 s, 2.8 MB/s 2023-07-07T18:15:27.356 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-07T18:15:27.357 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-07T18:15:27.357 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-07T18:15:27.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-07T18:15:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.519+0000 7f7eadec8700 1 Processor -- start 2023-07-07T18:15:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.519+0000 7f7eadec8700 1 -- start start 2023-07-07T18:15:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.519+0000 7f7eadec8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7ea815c420 0x7f7ea8069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.519+0000 7f7eadec8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea80b08d0 0x7f7ea806a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.519+0000 7f7eadec8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ea815c7f0 0x7f7ea80cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.519+0000 7f7eadec8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea80cf2a0 con 0x7f7ea815c7f0 2023-07-07T18:15:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.519+0000 7f7eadec8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea80ce690 con 0x7f7ea815c420 2023-07-07T18:15:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.519+0000 7f7eadec8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80ce970 con 0x7f7ea80b08d0 2023-07-07T18:15:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ea815c7f0 0x7f7ea80cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ea815c7f0 0x7f7ea80cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58022/0 (socket says 172.21.15.12:58022) 2023-07-07T18:15:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea7fff700 1 -- 172.21.15.12:0/4053832884 learned_addr learned my addr 172.21.15.12:0/4053832884 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea6ffd700 1 --2- 172.21.15.12:0/4053832884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea80b08d0 0x7f7ea806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea77fe700 1 --2- 172.21.15.12:0/4053832884 >> v2:172.21.15.160:3300/0 conn(0x7f7ea815c420 0x7f7ea8069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea7fff700 1 -- 172.21.15.12:0/4053832884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea80b08d0 msgr2=0x7f7ea806a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea7fff700 1 --2- 172.21.15.12:0/4053832884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea80b08d0 0x7f7ea806a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea7fff700 1 -- 172.21.15.12:0/4053832884 >> v2:172.21.15.160:3300/0 conn(0x7f7ea815c420 msgr2=0x7f7ea8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea7fff700 1 --2- 172.21.15.12:0/4053832884 >> v2:172.21.15.160:3300/0 conn(0x7f7ea815c420 0x7f7ea8069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea7fff700 1 -- 172.21.15.12:0/4053832884 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea80cec50 con 0x7f7ea815c7f0 2023-07-07T18:15:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea7fff700 1 --2- 172.21.15.12:0/4053832884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 0x7f7ea80cc020 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7ea806af50 tx=0x7f7ea0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e517272691bdc1c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea67fc700 1 -- 172.21.15.12:0/4053832884 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0011830 con 0x7f7ea815c7f0 2023-07-07T18:15:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea67fc700 1 -- 172.21.15.12:0/4053832884 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0011990 con 0x7f7ea815c7f0 2023-07-07T18:15:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.520+0000 7f7ea67fc700 1 -- 172.21.15.12:0/4053832884 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0011d20 con 0x7f7ea815c7f0 2023-07-07T18:15:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.521+0000 7f7eadec8700 1 -- 172.21.15.12:0/4053832884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 msgr2=0x7f7ea80cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.521+0000 7f7eadec8700 1 --2- 172.21.15.12:0/4053832884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 0x7f7ea80cc020 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7ea806af50 tx=0x7f7ea0009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.521+0000 7f7eadec8700 1 -- 172.21.15.12:0/4053832884 shutdown_connections 2023-07-07T18:15:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.521+0000 7f7eadec8700 1 --2- 172.21.15.12:0/4053832884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 0x7f7ea80cc020 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.521+0000 7f7eadec8700 1 --2- 172.21.15.12:0/4053832884 >> v2:172.21.15.160:3300/0 conn(0x7f7ea815c420 0x7f7ea8069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.521+0000 7f7eadec8700 1 --2- 172.21.15.12:0/4053832884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea80b08d0 0x7f7ea806a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.521+0000 7f7eadec8700 1 -- 172.21.15.12:0/4053832884 >> 172.21.15.12:0/4053832884 conn(0x7f7ea806b920 msgr2=0x7f7ea80cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.521+0000 7f7eadec8700 1 -- 172.21.15.12:0/4053832884 shutdown_connections 2023-07-07T18:15:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.521+0000 7f7eadec8700 1 -- 172.21.15.12:0/4053832884 wait complete. 2023-07-07T18:15:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.522+0000 7f7eadec8700 1 Processor -- start 2023-07-07T18:15:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.522+0000 7f7eadec8700 1 -- start start 2023-07-07T18:15:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7eadec8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ea80b08d0 0x7f7ea814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7eadec8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea815c420 0x7f7ea80995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7eadec8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 0x7f7ea8099ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7eadec8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea814d5f0 con 0x7f7ea815c7f0 2023-07-07T18:15:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7eadec8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea806dbc0 con 0x7f7ea80b08d0 2023-07-07T18:15:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7eadec8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea814d030 con 0x7f7ea815c420 2023-07-07T18:15:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7ea7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 0x7f7ea8099ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7ea7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 0x7f7ea8099ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58028/0 (socket says 172.21.15.12:58028) 2023-07-07T18:15:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7ea7fff700 1 -- 172.21.15.12:0/2518622066 learned_addr learned my addr 172.21.15.12:0/2518622066 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7ea6ffd700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea815c420 0x7f7ea80995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.523+0000 7f7ea77fe700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ea80b08d0 0x7f7ea814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7ea7fff700 1 -- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea815c420 msgr2=0x7f7ea80995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:27.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7ea7fff700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea815c420 0x7f7ea80995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7ea7fff700 1 -- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ea80b08d0 msgr2=0x7f7ea814c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7ea7fff700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ea80b08d0 0x7f7ea814c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7ea7fff700 1 -- 172.21.15.12:0/2518622066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea0009550 con 0x7f7ea815c7f0 2023-07-07T18:15:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7ea7fff700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 0x7f7ea8099ae0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80cd320 tx=0x7f7ea0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7e8ffff700 1 -- 172.21.15.12:0/2518622066 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0004240 con 0x7f7ea815c7f0 2023-07-07T18:15:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7e8ffff700 1 -- 172.21.15.12:0/2518622066 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea001f070 con 0x7f7ea815c7f0 2023-07-07T18:15:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7e8ffff700 1 -- 172.21.15.12:0/2518622066 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00045e0 con 0x7f7ea815c7f0 2023-07-07T18:15:27.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea814d310 con 0x7f7ea815c7f0 2023-07-07T18:15:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.524+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea814cc00 con 0x7f7ea815c7f0 2023-07-07T18:15:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.525+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea806dd50 con 0x7f7ea815c7f0 2023-07-07T18:15:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.526+0000 7f7e8ffff700 1 -- 172.21.15.12:0/2518622066 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ea0021030 con 0x7f7ea815c7f0 2023-07-07T18:15:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.526+0000 7f7e8ffff700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9406ace0 0x7f7e9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.526+0000 7f7e8ffff700 1 -- 172.21.15.12:0/2518622066 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7ea008a800 con 0x7f7ea815c7f0 2023-07-07T18:15:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.526+0000 7f7ea77fe700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9406ace0 0x7f7e9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:27.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.527+0000 7f7ea77fe700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9406ace0 0x7f7e9406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e980113e0 tx=0x7f7e9800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:27.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.530+0000 7f7e8ffff700 1 -- 172.21.15.12:0/2518622066 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ea0055610 con 0x7f7ea815c7f0 2023-07-07T18:15:27.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.777+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ea814cdc0 con 0x7f7ea815c7f0 2023-07-07T18:15:27.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.778+0000 7f7e8ffff700 1 -- 172.21.15.12:0/2518622066 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7ea0015070 con 0x7f7ea815c7f0 2023-07-07T18:15:27.780 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-07T18:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9406ace0 msgr2=0x7f7e9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9406ace0 0x7f7e9406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e980113e0 tx=0x7f7e9800b040 comp rx=0 tx=0).stop 2023-07-07T18:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 msgr2=0x7f7ea8099ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 0x7f7ea8099ae0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80cd320 tx=0x7f7ea0004750 comp rx=0 tx=0).stop 2023-07-07T18:15:27.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 shutdown_connections 2023-07-07T18:15:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7e9406ace0 0x7f7e9406d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ea815c7f0 0x7f7ea8099ae0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ea80b08d0 0x7f7ea814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 --2- 172.21.15.12:0/2518622066 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ea815c420 0x7f7ea80995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 >> 172.21.15.12:0/2518622066 conn(0x7f7ea806b920 msgr2=0x7f7ea80d0130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 shutdown_connections 2023-07-07T18:15:27.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:27.780+0000 7f7eadec8700 1 -- 172.21.15.12:0/2518622066 wait complete. 2023-07-07T18:15:27.794 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-07T18:15:27.794 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-07T18:15:27.795 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2023-07-07T18:15:27.795 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-07T18:15:27.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-07T18:15:27.795 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-07T18:15:27.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-07T18:15:27.796 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-07T18:15:27.796 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-07T18:15:27.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:27.796 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2023-07-07T18:15:27.817 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:15:27.818 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:15:27.818 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:15:27.818 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:27.818 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2023-07-07T18:15:27.818 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:27.819 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:27.819 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:27.819 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:27.819 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:27.819 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:27.819 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:27.819 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-07T18:15:27.820 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:27.820 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-07T18:15:27.820 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42354sec preferred_lft 42354sec 2023-07-07T18:15:27.820 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::1da3:a2cb:f035:b74d/64 scope link noprefixroute 2023-07-07T18:15:27.820 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:27.820 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-07T18:15:27.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:27.821 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-07-07T18:15:27.821 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-07-07T18:15:27.822 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add name ceph-brx type bridge 2023-07-07T18:15:27.822 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip addr flush dev ceph-brx 2023-07-07T18:15:27.822 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set ceph-brx up 2023-07-07T18:15:27.822 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-07T18:15:27.822 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-07-07T18:15:27.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:27.989 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-07T18:15:28.016 INFO:teuthology.orchestra.run.smithi160.stdout:1 2023-07-07T18:15:28.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:28.018 DEBUG:teuthology.orchestra.run.smithi160:> route 2023-07-07T18:15:28.090 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2023-07-07T18:15:28.091 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-07T18:15:28.091 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-07T18:15:28.091 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-07T18:15:28.091 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-07T18:15:28.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:28.092 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-07-07T18:15:28.092 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-07-07T18:15:28.093 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-07T18:15:28.093 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-07T18:15:28.093 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-07T18:15:28.093 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-07-07T18:15:28.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:28.339 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-07-07T18:15:28.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:28.356 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list-id 2023-07-07T18:15:28.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:28.415 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-07-07T18:15:28.416 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-07-07T18:15:28.416 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-07T18:15:28.417 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-07T18:15:28.418 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-07-07T18:15:28.507 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-07T18:15:28.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:28.508 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-07-07T18:15:28.508 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-07-07T18:15:28.508 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-07T18:15:28.509 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-07T18:15:28.509 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-07T18:15:28.509 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-07T18:15:28.509 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-07T18:15:28.510 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-07-07T18:15:28.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:28.736 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-07-07T18:15:28.736 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-07-07T18:15:28.736 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2023-07-07T18:15:28.737 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set dev brx.0 master ceph-brx 2023-07-07T18:15:28.737 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-07-07T18:15:28.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:15:28.841 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-07T18:15:28.862 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-07T18:15:28.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:15:28.862 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-07T18:15:28.917 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-07T18:15:28.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:28.918 DEBUG:teuthology.orchestra.run.smithi160:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-07T18:15:29.020 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-07T18:15:29.020 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-07T18:15:29.020 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-07-07T18:15:29.121 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-07T18:15:29.121 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-07T18:15:29.121 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-07-07T18:15:29.121 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:15:29.122 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:15:29.147 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-07T18:15:29.147 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-07T18:15:29.148 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-07-07T18:15:29.148 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:15:29.148 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:15:29.148 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-07-07T18:15:29.148 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-07-07T18:15:29.148 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=6f09c1a9-a759-4e94-bed7-68b16c28b7f9" will pass to kernel 2023-07-07T18:15:29.150 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-07T18:15:29.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:29.151 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-07T18:15:29.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:29.182 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:29.253 INFO:teuthology.orchestra.run.smithi160.stdout:client4810 2023-07-07T18:15:29.254 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:15:29.254 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:29.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:29.310 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:29.382 INFO:teuthology.orchestra.run.smithi160.stdout:client4810 2023-07-07T18:15:29.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:29.383 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:29.455 INFO:teuthology.orchestra.run.smithi160.stdout:client4810 2023-07-07T18:15:29.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:29.456 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6f09c1a9-a759-4e94-bed7-68b16c28b7f9.client4810/status') 2023-07-07T18:15:29.534 INFO:teuthology.orchestra.run.smithi160.stdout:instance: client.4810 (3)192.168.0.1:0/1355060419 2023-07-07T18:15:29.535 INFO:teuthology.orchestra.run.smithi160.stdout:blocklisted: false 2023-07-07T18:15:29.535 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2023-07-07T18:15:29.536 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2023-07-07T18:15:29.536 INFO:teuthology.orchestra.run.smithi160.stderr:69 bytes copied, 2.3434e-05 s, 2.9 MB/s 2023-07-07T18:15:29.536 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-07-07T18:15:29.536 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-07T18:15:29.537 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-07T18:15:29.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-07T18:15:29.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.673+0000 7f1ca760e700 1 Processor -- start 2023-07-07T18:15:29.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.674+0000 7f1ca760e700 1 -- start start 2023-07-07T18:15:29.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.674+0000 7f1ca760e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1ca006ccc0 0x7f1ca015fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:29.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.674+0000 7f1ca760e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00afdb0 con 0x7f1ca015c2e0 2023-07-07T18:15:29.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.674+0000 7f1ca760e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca015c6b0 con 0x7f1ca0160340 2023-07-07T18:15:29.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.674+0000 7f1ca760e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca00ceb90 con 0x7f1ca006ccc0 2023-07-07T18:15:29.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1ca53aa700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1ca015c2e0 0x7f1ca00ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55230/0 (socket says 172.21.15.12:55230) 2023-07-07T18:15:29.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1ca53aa700 1 -- 172.21.15.12:0/519604804 learned_addr learned my addr 172.21.15.12:0/519604804 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:29.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1ca4ba9700 1 --2- 172.21.15.12:0/519604804 >> v2:172.21.15.160:3300/0 conn(0x7f1ca006ccc0 0x7f1ca015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:29.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1c93fff700 1 -- 172.21.15.12:0/519604804 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989659771 0 0) 0x7f1ca00afdb0 con 0x7f1ca015c2e0 2023-07-07T18:15:29.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1c93fff700 1 -- 172.21.15.12:0/519604804 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c8c0035b0 con 0x7f1ca015c2e0 2023-07-07T18:15:29.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1c93fff700 1 -- 172.21.15.12:0/519604804 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495765210 0 0) 0x7f1ca015c6b0 con 0x7f1ca0160340 2023-07-07T18:15:29.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1c93fff700 1 -- 172.21.15.12:0/519604804 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca00afdb0 con 0x7f1ca0160340 2023-07-07T18:15:29.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1ca4ba9700 1 -- 172.21.15.12:0/519604804 >> v1:172.21.15.160:6789/0 conn(0x7f1ca0160340 legacy=0x7f1ca00d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:29.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1ca4ba9700 1 -- 172.21.15.12:0/519604804 >> v1:172.21.15.12:6789/0 conn(0x7f1ca015c2e0 legacy=0x7f1ca00ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:29.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1ca4ba9700 1 -- 172.21.15.12:0/519604804 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca00b0000 con 0x7f1ca006ccc0 2023-07-07T18:15:29.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1ca4ba9700 1 --2- 172.21.15.12:0/519604804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca006ccc0 0x7f1ca015fe00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009840 tx=0x7f1c94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f18f9e5c51a56a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:29.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1c93fff700 1 -- 172.21.15.12:0/519604804 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94011830 con 0x7f1ca006ccc0 2023-07-07T18:15:29.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1c93fff700 1 -- 172.21.15.12:0/519604804 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c94011990 con 0x7f1ca006ccc0 2023-07-07T18:15:29.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.675+0000 7f1c93fff700 1 -- 172.21.15.12:0/519604804 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94011d20 con 0x7f1ca006ccc0 2023-07-07T18:15:29.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.676+0000 7f1ca760e700 1 -- 172.21.15.12:0/519604804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca006ccc0 msgr2=0x7f1ca015fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:29.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.676+0000 7f1ca760e700 1 --2- 172.21.15.12:0/519604804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca006ccc0 0x7f1ca015fe00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009840 tx=0x7f1c94009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:29.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.676+0000 7f1ca760e700 1 -- 172.21.15.12:0/519604804 shutdown_connections 2023-07-07T18:15:29.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.676+0000 7f1ca760e700 1 --2- 172.21.15.12:0/519604804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca006ccc0 0x7f1ca015fe00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:29.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.676+0000 7f1ca760e700 1 -- 172.21.15.12:0/519604804 >> 172.21.15.12:0/519604804 conn(0x7f1ca006e530 msgr2=0x7f1ca006e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:29.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.676+0000 7f1ca760e700 1 -- 172.21.15.12:0/519604804 shutdown_connections 2023-07-07T18:15:29.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.676+0000 7f1ca760e700 1 -- 172.21.15.12:0/519604804 wait complete. 2023-07-07T18:15:29.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.677+0000 7f1ca760e700 1 Processor -- start 2023-07-07T18:15:29.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.677+0000 7f1ca760e700 1 -- start start 2023-07-07T18:15:29.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca760e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca006ccc0 0x7f1ca0153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:29.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca760e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ca015c2e0 0x7f1ca015ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:29.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca760e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca0160340 0x7f1ca015a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:29.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca760e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00b4110 con 0x7f1ca006ccc0 2023-07-07T18:15:29.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca760e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00b4360 con 0x7f1ca0160340 2023-07-07T18:15:29.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca760e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00b4640 con 0x7f1ca015c2e0 2023-07-07T18:15:29.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca53aa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca006ccc0 0x7f1ca0153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:29.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca53aa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca006ccc0 0x7f1ca0153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58036/0 (socket says 172.21.15.12:58036) 2023-07-07T18:15:29.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca53aa700 1 -- 172.21.15.12:0/1111618937 learned_addr learned my addr 172.21.15.12:0/1111618937 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:29.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca4ba9700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ca015c2e0 0x7f1ca015ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:29.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca5bab700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca0160340 0x7f1ca015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:29.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca53aa700 1 -- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ca015c2e0 msgr2=0x7f1ca015ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:29.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca53aa700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ca015c2e0 0x7f1ca015ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:29.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca53aa700 1 -- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca0160340 msgr2=0x7f1ca015a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:29.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca53aa700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca0160340 0x7f1ca015a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:29.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca53aa700 1 -- 172.21.15.12:0/1111618937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c940094a0 con 0x7f1ca006ccc0 2023-07-07T18:15:29.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.678+0000 7f1ca5bab700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca0160340 0x7f1ca015a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:29.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.679+0000 7f1ca53aa700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca006ccc0 0x7f1ca0153e80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00c700 tx=0x7f1c9c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:29.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.679+0000 7f1c91ffb700 1 -- 172.21.15.12:0/1111618937 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c005d70 con 0x7f1ca006ccc0 2023-07-07T18:15:29.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.679+0000 7f1c91ffb700 1 -- 172.21.15.12:0/1111618937 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9c0070d0 con 0x7f1ca006ccc0 2023-07-07T18:15:29.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.679+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca00b4920 con 0x7f1ca006ccc0 2023-07-07T18:15:29.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.679+0000 7f1c91ffb700 1 -- 172.21.15.12:0/1111618937 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c007460 con 0x7f1ca006ccc0 2023-07-07T18:15:29.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.679+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca00b4ee0 con 0x7f1ca006ccc0 2023-07-07T18:15:29.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.680+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca004ea20 con 0x7f1ca006ccc0 2023-07-07T18:15:29.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.680+0000 7f1c91ffb700 1 -- 172.21.15.12:0/1111618937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c9c0075c0 con 0x7f1ca006ccc0 2023-07-07T18:15:29.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.681+0000 7f1c91ffb700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1c8406ace0 0x7f1c8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:29.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.681+0000 7f1c91ffb700 1 -- 172.21.15.12:0/1111618937 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1c9c088dd0 con 0x7f1ca006ccc0 2023-07-07T18:15:29.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.681+0000 7f1ca4ba9700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1c8406ace0 0x7f1c8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:29.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.682+0000 7f1ca4ba9700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1c8406ace0 0x7f1c8406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009fd0 tx=0x7f1c9401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:29.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.685+0000 7f1c91ffb700 1 -- 172.21.15.12:0/1111618937 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1c9c053ac0 con 0x7f1ca006ccc0 2023-07-07T18:15:29.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.928+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ca00d04c0 con 0x7f1ca006ccc0 2023-07-07T18:15:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.928+0000 7f1c91ffb700 1 -- 172.21.15.12:0/1111618937 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1c9c08a070 con 0x7f1ca006ccc0 2023-07-07T18:15:29.930 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-07T18:15:29.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1c8406ace0 msgr2=0x7f1c8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1c8406ace0 0x7f1c8406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009fd0 tx=0x7f1c9401c040 comp rx=0 tx=0).stop 2023-07-07T18:15:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca006ccc0 msgr2=0x7f1ca0153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca006ccc0 0x7f1ca0153e80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c00c700 tx=0x7f1c9c00ca10 comp rx=0 tx=0).stop 2023-07-07T18:15:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 shutdown_connections 2023-07-07T18:15:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1c8406ace0 0x7f1c8406d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:29.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ca0160340 0x7f1ca015a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ca006ccc0 0x7f1ca0153e80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 --2- 172.21.15.12:0/1111618937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ca015c2e0 0x7f1ca015ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 >> 172.21.15.12:0/1111618937 conn(0x7f1ca006e530 msgr2=0x7f1ca015cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 shutdown_connections 2023-07-07T18:15:29.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:29.930+0000 7f1ca760e700 1 -- 172.21.15.12:0/1111618937 wait complete. 2023-07-07T18:15:29.944 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-07T18:15:29.945 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-07T18:15:29.945 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2023-07-07T18:15:29.945 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-07T18:15:29.945 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-07T18:15:29.945 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-07T18:15:29.946 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-07T18:15:29.946 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-07T18:15:29.946 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-07T18:15:29.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:29.947 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2023-07-07T18:15:29.965 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:15:29.965 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:15:29.965 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:15:29.966 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:29.966 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2023-07-07T18:15:29.966 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:29.966 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:29.966 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:29.966 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:29.966 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:29.967 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:15:29.967 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:29.967 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-07T18:15:29.967 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:29.967 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-07T18:15:29.968 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42352sec preferred_lft 42352sec 2023-07-07T18:15:29.968 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::1da3:a2cb:f035:b74d/64 scope link noprefixroute 2023-07-07T18:15:29.968 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:29.969 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-07T18:15:29.969 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 1e:f3:ba:17:51:35 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:15:29.969 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-07T18:15:29.969 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:29.970 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::fce0:ff:fe1d:ca54/64 scope link 2023-07-07T18:15:29.970 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:29.970 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-07T18:15:29.971 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 1e:f3:ba:17:51:35 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-07T18:15:29.972 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::1cf3:baff:fe17:5135/64 scope link tentative 2023-07-07T18:15:29.972 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:29.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:29.973 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-07T18:15:30.031 INFO:teuthology.orchestra.run.smithi160.stdout:1 2023-07-07T18:15:30.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.033 DEBUG:teuthology.orchestra.run.smithi160:> route 2023-07-07T18:15:30.091 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2023-07-07T18:15:30.091 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-07T18:15:30.091 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-07T18:15:30.092 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-07T18:15:30.092 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-07T18:15:30.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.092 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-07-07T18:15:30.093 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-07-07T18:15:30.093 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-07T18:15:30.093 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-07T18:15:30.093 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-07T18:15:30.094 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-07-07T18:15:30.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.197 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2023-07-07T18:15:30.213 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-07T18:15:30.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.214 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list-id 2023-07-07T18:15:30.269 INFO:teuthology.orchestra.run.smithi160.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-07T18:15:30.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.270 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-07-07T18:15:30.270 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-07-07T18:15:30.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-07T18:15:30.271 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-07T18:15:30.271 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-07-07T18:15:30.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.363 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-07T18:15:30.398 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:15:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:15:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:15:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2023-07-07T18:15:30.399 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:30.400 INFO:teuthology.orchestra.run.smithi160.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-07T18:15:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether ae:ec:95:f4:76:87 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-07T18:15:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-07T18:15:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::acec:95ff:fef4:7687/64 scope link tentative 2023-07-07T18:15:30.400 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:30.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.413 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-07T18:15:30.489 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:15:30.489 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:15:30.490 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:15:30.490 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:30.490 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2023-07-07T18:15:30.490 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:30.491 INFO:teuthology.orchestra.run.smithi160.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-07T18:15:30.491 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether ae:ec:95:f4:76:87 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-07T18:15:30.491 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-07T18:15:30.492 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:30.492 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::acec:95ff:fef4:7687/64 scope link 2023-07-07T18:15:30.492 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:15:30.505 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-07T18:15:30.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.506 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-07-07T18:15:30.506 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-07-07T18:15:30.506 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-07T18:15:30.507 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-07T18:15:30.507 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-07T18:15:30.507 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-07T18:15:30.508 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-07T18:15:30.508 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-07-07T18:15:30.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.748 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec bash -c ' 2023-07-07T18:15:30.749 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2023-07-07T18:15:30.749 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.1 up 2023-07-07T18:15:30.749 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set dev brx.1 master ceph-brx 2023-07-07T18:15:30.749 DEBUG:teuthology.orchestra.run.smithi160:> ') 2023-07-07T18:15:30.860 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:15:30.860 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-07T18:15:30.883 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-07T18:15:30.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:15:30.884 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-07T18:15:30.940 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-07T18:15:30.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:30.942 DEBUG:teuthology.orchestra.run.smithi160:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-07T18:15:31.026 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-07T18:15:31.027 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-07T18:15:31.027 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-07-07T18:15:31.035 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-07T18:15:31.035 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-07T18:15:31.036 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-07-07T18:15:31.036 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:15:31.036 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:15:31.077 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-07T18:15:31.078 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-07T18:15:31.078 INFO:teuthology.orchestra.run.smithi160.stdout:invalid new device string format 2023-07-07T18:15:31.078 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:15:31.079 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:15:31.079 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-07-07T18:15:31.079 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-07-07T18:15:31.079 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=6f09c1a9-a759-4e94-bed7-68b16c28b7f9" will pass to kernel 2023-07-07T18:15:31.081 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-07T18:15:31.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:31.082 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-07T18:15:31.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:31.111 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:31.183 INFO:teuthology.orchestra.run.smithi160.stdout:client4646 2023-07-07T18:15:31.184 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:15:31.184 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:31.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:31.241 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:31.312 INFO:teuthology.orchestra.run.smithi160.stdout:client4646 2023-07-07T18:15:31.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:31.313 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:15:31.384 INFO:teuthology.orchestra.run.smithi160.stdout:client4646 2023-07-07T18:15:31.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:31.385 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6f09c1a9-a759-4e94-bed7-68b16c28b7f9.client4646/status') 2023-07-07T18:15:31.464 INFO:teuthology.orchestra.run.smithi160.stdout:instance: client.4646 (3)192.168.0.2:0/4253765096 2023-07-07T18:15:31.465 INFO:teuthology.orchestra.run.smithi160.stdout:blocklisted: false 2023-07-07T18:15:31.465 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2023-07-07T18:15:31.466 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2023-07-07T18:15:31.466 INFO:teuthology.orchestra.run.smithi160.stderr:69 bytes copied, 3.0559e-05 s, 2.3 MB/s 2023-07-07T18:15:31.466 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-07T18:15:31.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:31.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.753+0000 7fec50c2b700 1 Processor -- start 2023-07-07T18:15:31.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.753+0000 7fec50c2b700 1 -- start start 2023-07-07T18:15:31.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.754+0000 7fec50c2b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec4c15a1e0 0x7fec4c0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:31.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.754+0000 7fec50c2b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c15d6a0 con 0x7fec4c0cddd0 2023-07-07T18:15:31.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.754+0000 7fec50c2b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c159700 con 0x7fec4c0ae6c0 2023-07-07T18:15:31.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.754+0000 7fec50c2b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4c0cdc80 con 0x7fec4c15a1e0 2023-07-07T18:15:31.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.754+0000 7fec4ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fec4c15a1e0 0x7fec4c0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:31.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.754+0000 7fec4a59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fec4c0cddd0 0x7fec4c0ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55242/0 (socket says 172.21.15.12:55242) 2023-07-07T18:15:31.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.754+0000 7fec4a59c700 1 -- 172.21.15.12:0/1700220260 learned_addr learned my addr 172.21.15.12:0/1700220260 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:31.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.755+0000 7fec4ad9d700 1 -- 172.21.15.12:0/1700220260 >> v1:172.21.15.160:6789/0 conn(0x7fec4c0ae6c0 legacy=0x7fec4c0714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:31.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.755+0000 7fec4ad9d700 1 -- 172.21.15.12:0/1700220260 >> v1:172.21.15.12:6789/0 conn(0x7fec4c0cddd0 legacy=0x7fec4c0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:31.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.755+0000 7fec4ad9d700 1 -- 172.21.15.12:0/1700220260 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c1599e0 con 0x7fec4c15a1e0 2023-07-07T18:15:31.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.755+0000 7fec4ad9d700 1 --2- 172.21.15.12:0/1700220260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c15a1e0 0x7fec4c0aec10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fec44009d90 tx=0x7fec4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e793a4b2fdf8f46b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:31.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.755+0000 7fec4959a700 1 -- 172.21.15.12:0/1700220260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4400e070 con 0x7fec4c15a1e0 2023-07-07T18:15:31.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.755+0000 7fec4959a700 1 -- 172.21.15.12:0/1700220260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4400bbd0 con 0x7fec4c15a1e0 2023-07-07T18:15:31.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.755+0000 7fec4959a700 1 -- 172.21.15.12:0/1700220260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44012430 con 0x7fec4c15a1e0 2023-07-07T18:15:31.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.756+0000 7fec50c2b700 1 -- 172.21.15.12:0/1700220260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c15a1e0 msgr2=0x7fec4c0aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:31.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.756+0000 7fec50c2b700 1 --2- 172.21.15.12:0/1700220260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c15a1e0 0x7fec4c0aec10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fec44009d90 tx=0x7fec4400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:31.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.756+0000 7fec50c2b700 1 -- 172.21.15.12:0/1700220260 shutdown_connections 2023-07-07T18:15:31.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.756+0000 7fec50c2b700 1 --2- 172.21.15.12:0/1700220260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c15a1e0 0x7fec4c0aec10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:31.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.756+0000 7fec50c2b700 1 -- 172.21.15.12:0/1700220260 >> 172.21.15.12:0/1700220260 conn(0x7fec4c06d4a0 msgr2=0x7fec4c06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:31.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.756+0000 7fec50c2b700 1 -- 172.21.15.12:0/1700220260 shutdown_connections 2023-07-07T18:15:31.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.756+0000 7fec50c2b700 1 -- 172.21.15.12:0/1700220260 wait complete. 2023-07-07T18:15:31.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.757+0000 7fec50c2b700 1 Processor -- start 2023-07-07T18:15:31.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.757+0000 7fec50c2b700 1 -- start start 2023-07-07T18:15:31.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec50c2b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec4c0ae6c0 0x7fec4c14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:31.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec50c2b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c0cddd0 0x7fec4c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:31.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec50c2b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec4c15a1e0 0x7fec4c0cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:31.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec50c2b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0b5520 con 0x7fec4c0cddd0 2023-07-07T18:15:31.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec50c2b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0b4910 con 0x7fec4c0ae6c0 2023-07-07T18:15:31.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec50c2b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0b4bf0 con 0x7fec4c15a1e0 2023-07-07T18:15:31.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec49d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c0cddd0 0x7fec4c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:31.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec49d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c0cddd0 0x7fec4c0cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58052/0 (socket says 172.21.15.12:58052) 2023-07-07T18:15:31.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec49d9b700 1 -- 172.21.15.12:0/2250916383 learned_addr learned my addr 172.21.15.12:0/2250916383 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:31.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec4a59c700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec4c0ae6c0 0x7fec4c14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:31.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec4ad9d700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec4c15a1e0 0x7fec4c0cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:31.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec49d9b700 1 -- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec4c15a1e0 msgr2=0x7fec4c0cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:31.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec49d9b700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec4c15a1e0 0x7fec4c0cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:31.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec49d9b700 1 -- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec4c0ae6c0 msgr2=0x7fec4c14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:31.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec49d9b700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec4c0ae6c0 0x7fec4c14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:31.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.758+0000 7fec49d9b700 1 -- 172.21.15.12:0/2250916383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44009a70 con 0x7fec4c0cddd0 2023-07-07T18:15:31.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.759+0000 7fec49d9b700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c0cddd0 0x7fec4c0cbc40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c450 tx=0x7fec3c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:31.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.759+0000 7fec3affd700 1 -- 172.21.15.12:0/2250916383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0052d0 con 0x7fec4c0cddd0 2023-07-07T18:15:31.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.759+0000 7fec3affd700 1 -- 172.21.15.12:0/2250916383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c005430 con 0x7fec4c0cddd0 2023-07-07T18:15:31.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.759+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c0b4ed0 con 0x7fec4c0cddd0 2023-07-07T18:15:31.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.759+0000 7fec3affd700 1 -- 172.21.15.12:0/2250916383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0038c0 con 0x7fec4c0cddd0 2023-07-07T18:15:31.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.759+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c14f190 con 0x7fec4c0cddd0 2023-07-07T18:15:31.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.760+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c073910 con 0x7fec4c0cddd0 2023-07-07T18:15:31.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.760+0000 7fec3affd700 1 -- 172.21.15.12:0/2250916383 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec3c003a20 con 0x7fec4c0cddd0 2023-07-07T18:15:31.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.761+0000 7fec3affd700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fec2c06ace0 0x7fec2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:31.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.761+0000 7fec3affd700 1 -- 172.21.15.12:0/2250916383 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fec3c088a40 con 0x7fec4c0cddd0 2023-07-07T18:15:31.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.761+0000 7fec4a59c700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fec2c06ace0 0x7fec2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:31.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.762+0000 7fec4a59c700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fec2c06ace0 0x7fec2c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fec40005910 tx=0x7fec40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:31.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.765+0000 7fec3affd700 1 -- 172.21.15.12:0/2250916383 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fec3c08ae60 con 0x7fec4c0cddd0 2023-07-07T18:15:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.962+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec4c157a30 con 0x7fec4c0cddd0 2023-07-07T18:15:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.963+0000 7fec3affd700 1 -- 172.21.15.12:0/2250916383 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7fec3c053850 con 0x7fec4c0cddd0 2023-07-07T18:15:31.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:31.966 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:31.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fec2c06ace0 msgr2=0x7fec2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fec2c06ace0 0x7fec2c06d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fec40005910 tx=0x7fec40009040 comp rx=0 tx=0).stop 2023-07-07T18:15:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c0cddd0 msgr2=0x7fec4c0cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c0cddd0 0x7fec4c0cbc40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c450 tx=0x7fec3c00c760 comp rx=0 tx=0).stop 2023-07-07T18:15:31.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 shutdown_connections 2023-07-07T18:15:31.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fec2c06ace0 0x7fec2c06d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:31.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec4c15a1e0 0x7fec4c0cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:31.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec4c0ae6c0 0x7fec4c14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:31.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 --2- 172.21.15.12:0/2250916383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fec4c0cddd0 0x7fec4c0cbc40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:31.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 >> 172.21.15.12:0/2250916383 conn(0x7fec4c06d4a0 msgr2=0x7fec4c158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:31.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 shutdown_connections 2023-07-07T18:15:31.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:31.965+0000 7fec50c2b700 1 -- 172.21.15.12:0/2250916383 wait complete. 2023-07-07T18:15:31.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:31.981 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:32.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.106+0000 7f24720cf700 1 Processor -- start 2023-07-07T18:15:32.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.106+0000 7f24720cf700 1 -- start start 2023-07-07T18:15:32.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f24720cf700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f246c0ae8b0 0x7f246c06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f24720cf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 0x7f246c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f24720cf700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c0aee00 con 0x7f246c15a430 2023-07-07T18:15:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f24720cf700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0af330 con 0x7f246c0ae8b0 2023-07-07T18:15:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f24720cf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c06e340 con 0x7f246c0acd10 2023-07-07T18:15:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f246affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f246c0ae8b0 0x7f246c06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f246affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f246c0ae8b0 0x7f246c06e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58060/0 (socket says 172.21.15.12:58060) 2023-07-07T18:15:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f246affd700 1 -- 172.21.15.12:0/1441915309 learned_addr learned my addr 172.21.15.12:0/1441915309 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f246b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f246c15a430 0x7f246c0ac600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55256/0 (socket says 172.21.15.12:55256) 2023-07-07T18:15:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.107+0000 7f246bfff700 1 --2- 172.21.15.12:0/1441915309 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 0x7f246c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f246affd700 1 -- 172.21.15.12:0/1441915309 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 msgr2=0x7f246c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f246affd700 1 --2- 172.21.15.12:0/1441915309 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 0x7f246c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f246affd700 1 -- 172.21.15.12:0/1441915309 >> v1:172.21.15.12:6789/0 conn(0x7f246c15a430 legacy=0x7f246c0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f246affd700 1 -- 172.21.15.12:0/1441915309 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0af050 con 0x7f246c0ae8b0 2023-07-07T18:15:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f246bfff700 1 --2- 172.21.15.12:0/1441915309 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 0x7f246c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f246affd700 1 --2- 172.21.15.12:0/1441915309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c0ae8b0 0x7f246c06e7d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f245c0098f0 tx=0x7f245c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65516fe075cbe891 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f246a7fc700 1 -- 172.21.15.12:0/1441915309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c00b8a0 con 0x7f246c0ae8b0 2023-07-07T18:15:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f246a7fc700 1 -- 172.21.15.12:0/1441915309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c00ba00 con 0x7f246c0ae8b0 2023-07-07T18:15:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f246a7fc700 1 -- 172.21.15.12:0/1441915309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c00bd90 con 0x7f246c0ae8b0 2023-07-07T18:15:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f24720cf700 1 -- 172.21.15.12:0/1441915309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c0ae8b0 msgr2=0x7f246c06e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f24720cf700 1 --2- 172.21.15.12:0/1441915309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c0ae8b0 0x7f246c06e7d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f245c0098f0 tx=0x7f245c009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f24720cf700 1 -- 172.21.15.12:0/1441915309 shutdown_connections 2023-07-07T18:15:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f24720cf700 1 --2- 172.21.15.12:0/1441915309 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 0x7f246c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f24720cf700 1 --2- 172.21.15.12:0/1441915309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c0ae8b0 0x7f246c06e7d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.108+0000 7f24720cf700 1 -- 172.21.15.12:0/1441915309 >> 172.21.15.12:0/1441915309 conn(0x7f246c06b920 msgr2=0x7f246c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.109+0000 7f24720cf700 1 -- 172.21.15.12:0/1441915309 shutdown_connections 2023-07-07T18:15:32.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.109+0000 7f24720cf700 1 -- 172.21.15.12:0/1441915309 wait complete. 2023-07-07T18:15:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.110+0000 7f24720cf700 1 Processor -- start 2023-07-07T18:15:32.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.110+0000 7f24720cf700 1 -- start start 2023-07-07T18:15:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f24720cf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 0x7f246c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f24720cf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f246c0ae8b0 0x7f246c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f24720cf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c15a430 0x7f246c0c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f24720cf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0c76b0 con 0x7f246c15a430 2023-07-07T18:15:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f24720cf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0c6d80 con 0x7f246c0ae8b0 2023-07-07T18:15:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f24720cf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0c7060 con 0x7f246c0acd10 2023-07-07T18:15:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c15a430 0x7f246c0c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c15a430 0x7f246c0c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58068/0 (socket says 172.21.15.12:58068) 2023-07-07T18:15:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246bfff700 1 -- 172.21.15.12:0/1888262139 learned_addr learned my addr 172.21.15.12:0/1888262139 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246affd700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f246c0ae8b0 0x7f246c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246b7fe700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 0x7f246c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246bfff700 1 -- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 msgr2=0x7f246c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246bfff700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 0x7f246c0cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246bfff700 1 -- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f246c0ae8b0 msgr2=0x7f246c0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246bfff700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f246c0ae8b0 0x7f246c0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246bfff700 1 -- 172.21.15.12:0/1888262139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c009550 con 0x7f246c15a430 2023-07-07T18:15:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f246bfff700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c15a430 0x7f246c0c8080 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2464007ef0 tx=0x7f246400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f2463fff700 1 -- 172.21.15.12:0/1888262139 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246400de60 con 0x7f246c15a430 2023-07-07T18:15:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f2463fff700 1 -- 172.21.15.12:0/1888262139 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246400f040 con 0x7f246c15a430 2023-07-07T18:15:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.111+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c0c7340 con 0x7f246c15a430 2023-07-07T18:15:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.112+0000 7f2463fff700 1 -- 172.21.15.12:0/1888262139 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2464003c60 con 0x7f246c15a430 2023-07-07T18:15:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.112+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c0cdd00 con 0x7f246c15a430 2023-07-07T18:15:32.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.112+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c04ea20 con 0x7f246c15a430 2023-07-07T18:15:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.113+0000 7f2463fff700 1 -- 172.21.15.12:0/1888262139 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2464004030 con 0x7f246c15a430 2023-07-07T18:15:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.113+0000 7f2463fff700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f244c06ace0 0x7f244c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.113+0000 7f2463fff700 1 -- 172.21.15.12:0/1888262139 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f24640899b0 con 0x7f246c15a430 2023-07-07T18:15:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.113+0000 7f246b7fe700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f244c06ace0 0x7f244c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.114+0000 7f246b7fe700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f244c06ace0 0x7f244c06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2454001020 tx=0x7f2454009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:32.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.118+0000 7f2463fff700 1 -- 172.21.15.12:0/1888262139 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2464054730 con 0x7f246c15a430 2023-07-07T18:15:32.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.318+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f246c0c77f0 con 0x7f246c15a430 2023-07-07T18:15:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.319+0000 7f2463fff700 1 -- 172.21.15.12:0/1888262139 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2464057d50 con 0x7f246c15a430 2023-07-07T18:15:32.321 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f244c06ace0 msgr2=0x7f244c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f244c06ace0 0x7f244c06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2454001020 tx=0x7f2454009040 comp rx=0 tx=0).stop 2023-07-07T18:15:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c15a430 msgr2=0x7f246c0c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c15a430 0x7f246c0c8080 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2464007ef0 tx=0x7f246400d3b0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 shutdown_connections 2023-07-07T18:15:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f244c06ace0 0x7f244c06d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f246c15a430 0x7f246c0c8080 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f246c0acd10 0x7f246c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 --2- 172.21.15.12:0/1888262139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f246c0ae8b0 0x7f246c0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.320+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 >> 172.21.15.12:0/1888262139 conn(0x7f246c06b920 msgr2=0x7f246c0ad190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.321+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 shutdown_connections 2023-07-07T18:15:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.321+0000 7f24720cf700 1 -- 172.21.15.12:0/1888262139 wait complete. 2023-07-07T18:15:32.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.459+0000 7f80e4a85700 1 Processor -- start 2023-07-07T18:15:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.459+0000 7f80e4a85700 1 -- start start 2023-07-07T18:15:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.460+0000 7f80e4a85700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80e00cd330 0x7f80e0070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.460+0000 7f80e4a85700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f80e00afc40 0x7f80e015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.460+0000 7f80e4a85700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e00caf70 con 0x7f80e015a330 2023-07-07T18:15:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.460+0000 7f80e4a85700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e00cb210 con 0x7f80e00cd330 2023-07-07T18:15:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.460+0000 7f80e4a85700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e00ccc20 con 0x7f80e00afc40 2023-07-07T18:15:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.460+0000 7f80de59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80e00cd330 0x7f80e0070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.460+0000 7f80de59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80e00cd330 0x7f80e0070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58072/0 (socket says 172.21.15.12:58072) 2023-07-07T18:15:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.460+0000 7f80de59c700 1 -- 172.21.15.12:0/2405533821 learned_addr learned my addr 172.21.15.12:0/2405533821 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80ded9d700 1 --2- 172.21.15.12:0/2405533821 >> v2:172.21.15.160:3300/0 conn(0x7f80e00afc40 0x7f80e015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80de59c700 1 -- 172.21.15.12:0/2405533821 >> v2:172.21.15.160:3300/0 conn(0x7f80e00afc40 msgr2=0x7f80e015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80de59c700 1 --2- 172.21.15.12:0/2405533821 >> v2:172.21.15.160:3300/0 conn(0x7f80e00afc40 0x7f80e015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80de59c700 1 -- 172.21.15.12:0/2405533821 >> v1:172.21.15.160:6789/0 conn(0x7f80e015a330 legacy=0x7f80e00cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80de59c700 1 -- 172.21.15.12:0/2405533821 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e00ccf00 con 0x7f80e00cd330 2023-07-07T18:15:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80de59c700 1 --2- 172.21.15.12:0/2405533821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 0x7f80e0070980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f80e00c43d0 tx=0x7f80d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749a539cad6783f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80dd59a700 1 -- 172.21.15.12:0/2405533821 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400b870 con 0x7f80e00cd330 2023-07-07T18:15:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80dd59a700 1 -- 172.21.15.12:0/2405533821 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d400b9d0 con 0x7f80e00cd330 2023-07-07T18:15:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80dd59a700 1 -- 172.21.15.12:0/2405533821 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400bd60 con 0x7f80e00cd330 2023-07-07T18:15:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80e4a85700 1 -- 172.21.15.12:0/2405533821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 msgr2=0x7f80e0070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.461+0000 7f80e4a85700 1 --2- 172.21.15.12:0/2405533821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 0x7f80e0070980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f80e00c43d0 tx=0x7f80d4009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.462+0000 7f80e4a85700 1 -- 172.21.15.12:0/2405533821 shutdown_connections 2023-07-07T18:15:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.462+0000 7f80e4a85700 1 --2- 172.21.15.12:0/2405533821 >> v2:172.21.15.160:3300/0 conn(0x7f80e00afc40 0x7f80e015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.462+0000 7f80e4a85700 1 --2- 172.21.15.12:0/2405533821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 0x7f80e0070980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.462+0000 7f80e4a85700 1 -- 172.21.15.12:0/2405533821 >> 172.21.15.12:0/2405533821 conn(0x7f80e006e5c0 msgr2=0x7f80e006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.462+0000 7f80e4a85700 1 -- 172.21.15.12:0/2405533821 shutdown_connections 2023-07-07T18:15:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.462+0000 7f80e4a85700 1 -- 172.21.15.12:0/2405533821 wait complete. 2023-07-07T18:15:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.463+0000 7f80e4a85700 1 Processor -- start 2023-07-07T18:15:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.463+0000 7f80e4a85700 1 -- start start 2023-07-07T18:15:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80e4a85700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00afc40 0x7f80e01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80e4a85700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 0x7f80e0155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80e4a85700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e015a330 0x7f80e0155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80e4a85700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e0155890 con 0x7f80e00cd330 2023-07-07T18:15:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80e4a85700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e0156f90 con 0x7f80e00afc40 2023-07-07T18:15:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80e4a85700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e0157420 con 0x7f80e015a330 2023-07-07T18:15:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ddd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 0x7f80e0155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ddd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 0x7f80e0155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58080/0 (socket says 172.21.15.12:58080) 2023-07-07T18:15:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ddd9b700 1 -- 172.21.15.12:0/2913155509 learned_addr learned my addr 172.21.15.12:0/2913155509 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80de59c700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00afc40 0x7f80e01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ded9d700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e015a330 0x7f80e0155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ddd9b700 1 -- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e015a330 msgr2=0x7f80e0155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ddd9b700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e015a330 0x7f80e0155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ddd9b700 1 -- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00afc40 msgr2=0x7f80e01584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ddd9b700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00afc40 0x7f80e01584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ddd9b700 1 -- 172.21.15.12:0/2913155509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d4009550 con 0x7f80e00cd330 2023-07-07T18:15:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.464+0000 7f80ddd9b700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 0x7f80e0155a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80d000c480 tx=0x7f80d000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.465+0000 7f80ceffd700 1 -- 172.21.15.12:0/2913155509 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00052d0 con 0x7f80e00cd330 2023-07-07T18:15:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.465+0000 7f80ceffd700 1 -- 172.21.15.12:0/2913155509 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d0005430 con 0x7f80e00cd330 2023-07-07T18:15:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.465+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e0156660 con 0x7f80e00cd330 2023-07-07T18:15:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.465+0000 7f80ceffd700 1 -- 172.21.15.12:0/2913155509 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00038c0 con 0x7f80e00cd330 2023-07-07T18:15:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.465+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e0156c20 con 0x7f80e00cd330 2023-07-07T18:15:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.465+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e0156de0 con 0x7f80e00cd330 2023-07-07T18:15:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.466+0000 7f80ceffd700 1 -- 172.21.15.12:0/2913155509 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80d0003a20 con 0x7f80e00cd330 2023-07-07T18:15:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.466+0000 7f80ceffd700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f80c006ace0 0x7f80c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.466+0000 7f80ceffd700 1 -- 172.21.15.12:0/2913155509 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f80d0088d10 con 0x7f80e00cd330 2023-07-07T18:15:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.467+0000 7f80de59c700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f80c006ace0 0x7f80c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.467+0000 7f80de59c700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f80c006ace0 0x7f80c006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80d4000c00 tx=0x7f80d4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.471+0000 7f80ceffd700 1 -- 172.21.15.12:0/2913155509 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f80d0053aa0 con 0x7f80e00cd330 2023-07-07T18:15:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.668+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f80e0157100 con 0x7f80e00cd330 2023-07-07T18:15:32.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.668+0000 7f80ceffd700 1 -- 172.21.15.12:0/2913155509 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f80d00570c0 con 0x7f80e00cd330 2023-07-07T18:15:32.670 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f80c006ace0 msgr2=0x7f80c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f80c006ace0 0x7f80c006d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f80d4000c00 tx=0x7f80d4008030 comp rx=0 tx=0).stop 2023-07-07T18:15:32.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 msgr2=0x7f80e0155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 0x7f80e0155a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f80d000c480 tx=0x7f80d000c840 comp rx=0 tx=0).stop 2023-07-07T18:15:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 shutdown_connections 2023-07-07T18:15:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f80c006ace0 0x7f80c006d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f80e015a330 0x7f80e0155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80e00afc40 0x7f80e01584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 --2- 172.21.15.12:0/2913155509 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00cd330 0x7f80e0155a30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 >> 172.21.15.12:0/2913155509 conn(0x7f80e006e5c0 msgr2=0x7f80e00b0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 shutdown_connections 2023-07-07T18:15:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.670+0000 7f80e4a85700 1 -- 172.21.15.12:0/2913155509 wait complete. 2023-07-07T18:15:32.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:32.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.810+0000 7f3d6559d700 1 Processor -- start 2023-07-07T18:15:32.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.810+0000 7f3d6559d700 1 -- start start 2023-07-07T18:15:32.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d6559d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600b5a70 0x7f3d600b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d6559d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3d600cf910 0x7f3d600d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d6559d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600b5ec0 con 0x7f3d600d0a60 2023-07-07T18:15:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d6559d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600d0060 con 0x7f3d600cf910 2023-07-07T18:15:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d6559d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600cd9d0 con 0x7f3d600b5a70 2023-07-07T18:15:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5effd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3d600d0a60 0x7f3d600d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55286/0 (socket says 172.21.15.12:55286) 2023-07-07T18:15:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5effd700 1 -- 172.21.15.12:0/4290354058 learned_addr learned my addr 172.21.15.12:0/4290354058 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5e7fc700 1 --2- 172.21.15.12:0/4290354058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600b5a70 0x7f3d600b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5f7fe700 1 --2- 172.21.15.12:0/4290354058 >> v2:172.21.15.160:3300/0 conn(0x7f3d600cf910 0x7f3d600d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5dffb700 1 -- 172.21.15.12:0/4290354058 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114219320 0 0) 0x7f3d600b5ec0 con 0x7f3d600d0a60 2023-07-07T18:15:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5dffb700 1 -- 172.21.15.12:0/4290354058 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d480035b0 con 0x7f3d600d0a60 2023-07-07T18:15:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5e7fc700 1 -- 172.21.15.12:0/4290354058 >> v2:172.21.15.160:3300/0 conn(0x7f3d600cf910 msgr2=0x7f3d600d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5e7fc700 1 --2- 172.21.15.12:0/4290354058 >> v2:172.21.15.160:3300/0 conn(0x7f3d600cf910 0x7f3d600d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5e7fc700 1 -- 172.21.15.12:0/4290354058 >> v1:172.21.15.12:6789/0 conn(0x7f3d600d0a60 legacy=0x7f3d600d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5e7fc700 1 -- 172.21.15.12:0/4290354058 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600cfd90 con 0x7f3d600b5a70 2023-07-07T18:15:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.811+0000 7f3d5f7fe700 1 --2- 172.21.15.12:0/4290354058 >> v2:172.21.15.160:3300/0 conn(0x7f3d600cf910 0x7f3d600d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:32.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d5e7fc700 1 --2- 172.21.15.12:0/4290354058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600b5a70 0x7f3d600b51d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009840 tx=0x7f3d50009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e786e682f512dae server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:32.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d5dffb700 1 -- 172.21.15.12:0/4290354058 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50011830 con 0x7f3d600b5a70 2023-07-07T18:15:32.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d5dffb700 1 -- 172.21.15.12:0/4290354058 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50011990 con 0x7f3d600b5a70 2023-07-07T18:15:32.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d5dffb700 1 -- 172.21.15.12:0/4290354058 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50011d20 con 0x7f3d600b5a70 2023-07-07T18:15:32.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d6559d700 1 -- 172.21.15.12:0/4290354058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600b5a70 msgr2=0x7f3d600b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d6559d700 1 --2- 172.21.15.12:0/4290354058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600b5a70 0x7f3d600b51d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009840 tx=0x7f3d50009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d6559d700 1 -- 172.21.15.12:0/4290354058 shutdown_connections 2023-07-07T18:15:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d6559d700 1 --2- 172.21.15.12:0/4290354058 >> v2:172.21.15.160:3300/0 conn(0x7f3d600cf910 0x7f3d600d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d6559d700 1 --2- 172.21.15.12:0/4290354058 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600b5a70 0x7f3d600b51d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d6559d700 1 -- 172.21.15.12:0/4290354058 >> 172.21.15.12:0/4290354058 conn(0x7f3d60071620 msgr2=0x7f3d600719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d6559d700 1 -- 172.21.15.12:0/4290354058 shutdown_connections 2023-07-07T18:15:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.812+0000 7f3d6559d700 1 -- 172.21.15.12:0/4290354058 wait complete. 2023-07-07T18:15:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.814+0000 7f3d6559d700 1 Processor -- start 2023-07-07T18:15:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.814+0000 7f3d6559d700 1 -- start start 2023-07-07T18:15:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.814+0000 7f3d6559d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d600b5a70 0x7f3d600c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.814+0000 7f3d6559d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d600cf910 0x7f3d6015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d6559d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600d0a60 0x7f3d6015e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d6559d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c8430 con 0x7f3d600cf910 2023-07-07T18:15:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d6559d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c8710 con 0x7f3d600b5a70 2023-07-07T18:15:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d6559d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600c89f0 con 0x7f3d600d0a60 2023-07-07T18:15:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d600cf910 0x7f3d6015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d600cf910 0x7f3d6015dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58094/0 (socket says 172.21.15.12:58094) 2023-07-07T18:15:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5e7fc700 1 -- 172.21.15.12:0/3011733981 learned_addr learned my addr 172.21.15.12:0/3011733981 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5effd700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d600b5a70 0x7f3d600c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5f7fe700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600d0a60 0x7f3d6015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5e7fc700 1 -- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600d0a60 msgr2=0x7f3d6015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5e7fc700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600d0a60 0x7f3d6015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5e7fc700 1 -- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d600b5a70 msgr2=0x7f3d600c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5e7fc700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d600b5a70 0x7f3d600c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5e7fc700 1 -- 172.21.15.12:0/3011733981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d58009a70 con 0x7f3d600cf910 2023-07-07T18:15:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d5e7fc700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d600cf910 0x7f3d6015dde0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3d500090b0 tx=0x7f3d50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d477fe700 1 -- 172.21.15.12:0/3011733981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50004550 con 0x7f3d600cf910 2023-07-07T18:15:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d477fe700 1 -- 172.21.15.12:0/3011733981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5001f070 con 0x7f3d600cf910 2023-07-07T18:15:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d500094a0 con 0x7f3d600cf910 2023-07-07T18:15:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d477fe700 1 -- 172.21.15.12:0/3011733981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d500038e0 con 0x7f3d600cf910 2023-07-07T18:15:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.815+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d600c6ca0 con 0x7f3d600cf910 2023-07-07T18:15:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.816+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d600c8f10 con 0x7f3d600cf910 2023-07-07T18:15:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.817+0000 7f3d477fe700 1 -- 172.21.15.12:0/3011733981 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d50003a40 con 0x7f3d600cf910 2023-07-07T18:15:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.817+0000 7f3d477fe700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d4c06ace0 0x7f3d4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.817+0000 7f3d477fe700 1 -- 172.21.15.12:0/3011733981 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3d50021070 con 0x7f3d600cf910 2023-07-07T18:15:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.817+0000 7f3d5effd700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d4c06ace0 0x7f3d4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.818+0000 7f3d5effd700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d4c06ace0 0x7f3d4c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3d54007fd0 tx=0x7f3d54007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:32.822+0000 7f3d477fe700 1 -- 172.21.15.12:0/3011733981 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3d600c8f10 con 0x7f3d600cf910 2023-07-07T18:15:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.017+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d600c8f10 con 0x7f3d600cf910 2023-07-07T18:15:33.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.018+0000 7f3d477fe700 1 -- 172.21.15.12:0/3011733981 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d600c8f10 con 0x7f3d600cf910 2023-07-07T18:15:33.020 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:33.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d4c06ace0 msgr2=0x7f3d4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d4c06ace0 0x7f3d4c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3d54007fd0 tx=0x7f3d54007dc0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d600cf910 msgr2=0x7f3d6015dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d600cf910 0x7f3d6015dde0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3d500090b0 tx=0x7f3d50004750 comp rx=0 tx=0).stop 2023-07-07T18:15:33.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 shutdown_connections 2023-07-07T18:15:33.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3d4c06ace0 0x7f3d4c06d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3d600d0a60 0x7f3d6015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d600b5a70 0x7f3d600c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 --2- 172.21.15.12:0/3011733981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d600cf910 0x7f3d6015dde0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 >> 172.21.15.12:0/3011733981 conn(0x7f3d60071620 msgr2=0x7f3d600b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:33.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 shutdown_connections 2023-07-07T18:15:33.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.020+0000 7f3d6559d700 1 -- 172.21.15.12:0/3011733981 wait complete. 2023-07-07T18:15:33.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:33.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.160+0000 7f9e34557700 1 Processor -- start 2023-07-07T18:15:33.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.160+0000 7f9e34557700 1 -- start start 2023-07-07T18:15:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e34557700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e2c0b23a0 0x7f9e2c06cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e34557700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9e2c15d2d0 0x7f9e2c0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e34557700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2c15c720 con 0x7f9e2c15fe40 2023-07-07T18:15:33.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e34557700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c15d820 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e34557700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c0d03a0 con 0x7f9e2c15d2d0 2023-07-07T18:15:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e322f3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e2c0b23a0 0x7f9e2c06cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e32af4700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9e2c15fe40 0x7f9e2c1602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55302/0 (socket says 172.21.15.12:55302) 2023-07-07T18:15:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e322f3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e2c0b23a0 0x7f9e2c06cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58100/0 (socket says 172.21.15.12:58100) 2023-07-07T18:15:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e32af4700 1 -- 172.21.15.12:0/360764666 learned_addr learned my addr 172.21.15.12:0/360764666 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.161+0000 7f9e31af2700 1 --2- 172.21.15.12:0/360764666 >> v2:172.21.15.160:3300/0 conn(0x7f9e2c15d2d0 0x7f9e2c0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e322f3700 1 -- 172.21.15.12:0/360764666 >> v2:172.21.15.160:3300/0 conn(0x7f9e2c15d2d0 msgr2=0x7f9e2c0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e322f3700 1 --2- 172.21.15.12:0/360764666 >> v2:172.21.15.160:3300/0 conn(0x7f9e2c15d2d0 0x7f9e2c0b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e322f3700 1 -- 172.21.15.12:0/360764666 >> v1:172.21.15.12:6789/0 conn(0x7f9e2c15fe40 legacy=0x7f9e2c1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e322f3700 1 -- 172.21.15.12:0/360764666 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c0b2cb0 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e312f1700 1 -- 172.21.15.12:0/360764666 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254149768 0 0) 0x7f9e24001490 con 0x7f9e2c15fe40 2023-07-07T18:15:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e322f3700 1 --2- 172.21.15.12:0/360764666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 0x7f9e2c06cc60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0ceef0 tx=0x7f9e1c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150c00f4b9f5fd10 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e312f1700 1 -- 172.21.15.12:0/360764666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c011830 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e312f1700 1 -- 172.21.15.12:0/360764666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c011990 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e312f1700 1 -- 172.21.15.12:0/360764666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c011d20 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e34557700 1 -- 172.21.15.12:0/360764666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 msgr2=0x7f9e2c06cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.162+0000 7f9e34557700 1 --2- 172.21.15.12:0/360764666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 0x7f9e2c06cc60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0ceef0 tx=0x7f9e1c009b20 comp rx=0 tx=0).stop 2023-07-07T18:15:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.163+0000 7f9e34557700 1 -- 172.21.15.12:0/360764666 shutdown_connections 2023-07-07T18:15:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.163+0000 7f9e34557700 1 --2- 172.21.15.12:0/360764666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 0x7f9e2c06cc60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.163+0000 7f9e34557700 1 --2- 172.21.15.12:0/360764666 >> v2:172.21.15.160:3300/0 conn(0x7f9e2c15d2d0 0x7f9e2c0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.163+0000 7f9e34557700 1 -- 172.21.15.12:0/360764666 >> 172.21.15.12:0/360764666 conn(0x7f9e2c06e5c0 msgr2=0x7f9e2c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.163+0000 7f9e34557700 1 -- 172.21.15.12:0/360764666 shutdown_connections 2023-07-07T18:15:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.163+0000 7f9e34557700 1 -- 172.21.15.12:0/360764666 wait complete. 2023-07-07T18:15:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.164+0000 7f9e34557700 1 Processor -- start 2023-07-07T18:15:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.164+0000 7f9e34557700 1 -- start start 2023-07-07T18:15:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.164+0000 7f9e34557700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 0x7f9e2c0aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.164+0000 7f9e34557700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e2c15d2d0 0x7f9e2c0b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.164+0000 7f9e34557700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c15fe40 0x7f9e2c0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e34557700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0ae480 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e34557700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0ad5d0 con 0x7f9e2c15fe40 2023-07-07T18:15:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e34557700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c0ad800 con 0x7f9e2c15d2d0 2023-07-07T18:15:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e322f3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 0x7f9e2c0aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e322f3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 0x7f9e2c0aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58106/0 (socket says 172.21.15.12:58106) 2023-07-07T18:15:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e322f3700 1 -- 172.21.15.12:0/2005552652 learned_addr learned my addr 172.21.15.12:0/2005552652 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e32af4700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c15fe40 0x7f9e2c0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e31af2700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e2c15d2d0 0x7f9e2c0b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e322f3700 1 -- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e2c15d2d0 msgr2=0x7f9e2c0b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e322f3700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e2c15d2d0 0x7f9e2c0b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e322f3700 1 -- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c15fe40 msgr2=0x7f9e2c0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e322f3700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c15fe40 0x7f9e2c0b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e322f3700 1 -- 172.21.15.12:0/2005552652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c0094a0 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e322f3700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 0x7f9e2c0aba60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c000c00 tx=0x7f9e1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e22ffd700 1 -- 172.21.15.12:0/2005552652 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c0036a0 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e22ffd700 1 -- 172.21.15.12:0/2005552652 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c01f070 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c0adae0 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e22ffd700 1 -- 172.21.15.12:0/2005552652 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c003a20 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.165+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c0ae0a0 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.166+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c04ea20 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.167+0000 7f9e22ffd700 1 -- 172.21.15.12:0/2005552652 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9e1c003b80 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.167+0000 7f9e22ffd700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9e1006ace0 0x7f9e1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.167+0000 7f9e22ffd700 1 -- 172.21.15.12:0/2005552652 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9e1c021070 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.167+0000 7f9e31af2700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9e1006ace0 0x7f9e1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.168+0000 7f9e31af2700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9e1006ace0 0x7f9e1006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0b1380 tx=0x7f9e28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:33.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.172+0000 7f9e22ffd700 1 -- 172.21.15.12:0/2005552652 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9e1c055ee0 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.367+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e2c0b6580 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.368+0000 7f9e22ffd700 1 -- 172.21.15.12:0/2005552652 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e1c0150a0 con 0x7f9e2c0b23a0 2023-07-07T18:15:33.370 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9e1006ace0 msgr2=0x7f9e1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9e1006ace0 0x7f9e1006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0b1380 tx=0x7f9e28008040 comp rx=0 tx=0).stop 2023-07-07T18:15:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 msgr2=0x7f9e2c0aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 0x7f9e2c0aba60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c000c00 tx=0x7f9e1c004750 comp rx=0 tx=0).stop 2023-07-07T18:15:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 shutdown_connections 2023-07-07T18:15:33.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f9e1006ace0 0x7f9e1006d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e2c15fe40 0x7f9e2c0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e2c0b23a0 0x7f9e2c0aba60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 --2- 172.21.15.12:0/2005552652 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e2c15d2d0 0x7f9e2c0b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 >> 172.21.15.12:0/2005552652 conn(0x7f9e2c06e5c0 msgr2=0x7f9e2c15bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 shutdown_connections 2023-07-07T18:15:33.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.370+0000 7f9e34557700 1 -- 172.21.15.12:0/2005552652 wait complete. 2023-07-07T18:15:33.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:33.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.509+0000 7f2811d5f700 1 Processor -- start 2023-07-07T18:15:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.509+0000 7f2811d5f700 1 -- start start 2023-07-07T18:15:33.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.510+0000 7f2811d5f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f280c0cd330 0x7f280c070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.510+0000 7f2811d5f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f280c15a330 0x7f280c0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.510+0000 7f2811d5f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0afc40 0x7f280c15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.510+0000 7f2811d5f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c0caf70 con 0x7f280c15a330 2023-07-07T18:15:33.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.510+0000 7f2811d5f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c0cdc40 con 0x7f280c0cd330 2023-07-07T18:15:33.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.510+0000 7f2811d5f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0cb210 con 0x7f280c0afc40 2023-07-07T18:15:33.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.510+0000 7f280affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f280c15a330 0x7f280c0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.510+0000 7f280affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f280c15a330 0x7f280c0cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58116/0 (socket says 172.21.15.12:58116) 2023-07-07T18:15:33.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.510+0000 7f280affd700 1 -- 172.21.15.12:0/577107709 learned_addr learned my addr 172.21.15.12:0/577107709 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:33.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280b7fe700 1 --2- 172.21.15.12:0/577107709 >> v2:172.21.15.160:3300/0 conn(0x7f280c0cd330 0x7f280c070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280bfff700 1 --2- 172.21.15.12:0/577107709 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0afc40 0x7f280c15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280affd700 1 -- 172.21.15.12:0/577107709 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0afc40 msgr2=0x7f280c15dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:33.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280affd700 1 --2- 172.21.15.12:0/577107709 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0afc40 0x7f280c15dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280affd700 1 -- 172.21.15.12:0/577107709 >> v2:172.21.15.160:3300/0 conn(0x7f280c0cd330 msgr2=0x7f280c070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:33.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280affd700 1 --2- 172.21.15.12:0/577107709 >> v2:172.21.15.160:3300/0 conn(0x7f280c0cd330 0x7f280c070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280affd700 1 -- 172.21.15.12:0/577107709 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0ccc20 con 0x7f280c15a330 2023-07-07T18:15:33.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280affd700 1 --2- 172.21.15.12:0/577107709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c15a330 0x7f280c0cd700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f280c0d0880 tx=0x7f27f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52395cdd1f522aa server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:33.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280a7fc700 1 -- 172.21.15.12:0/577107709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400b870 con 0x7f280c15a330 2023-07-07T18:15:33.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280a7fc700 1 -- 172.21.15.12:0/577107709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f400b9d0 con 0x7f280c15a330 2023-07-07T18:15:33.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f280a7fc700 1 -- 172.21.15.12:0/577107709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f400bd60 con 0x7f280c15a330 2023-07-07T18:15:33.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f2811d5f700 1 -- 172.21.15.12:0/577107709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c15a330 msgr2=0x7f280c0cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.511+0000 7f2811d5f700 1 --2- 172.21.15.12:0/577107709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c15a330 0x7f280c0cd700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f280c0d0880 tx=0x7f27f4009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.512+0000 7f2811d5f700 1 -- 172.21.15.12:0/577107709 shutdown_connections 2023-07-07T18:15:33.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.512+0000 7f2811d5f700 1 --2- 172.21.15.12:0/577107709 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0afc40 0x7f280c15dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.512+0000 7f2811d5f700 1 --2- 172.21.15.12:0/577107709 >> v2:172.21.15.160:3300/0 conn(0x7f280c0cd330 0x7f280c070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.512+0000 7f2811d5f700 1 --2- 172.21.15.12:0/577107709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c15a330 0x7f280c0cd700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.512+0000 7f2811d5f700 1 -- 172.21.15.12:0/577107709 >> 172.21.15.12:0/577107709 conn(0x7f280c06e5c0 msgr2=0x7f280c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:33.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.512+0000 7f2811d5f700 1 -- 172.21.15.12:0/577107709 shutdown_connections 2023-07-07T18:15:33.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.512+0000 7f2811d5f700 1 -- 172.21.15.12:0/577107709 wait complete. 2023-07-07T18:15:33.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.513+0000 7f2811d5f700 1 Processor -- start 2023-07-07T18:15:33.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.513+0000 7f2811d5f700 1 -- start start 2023-07-07T18:15:33.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2811d5f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c0afc40 0x7f280c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2811d5f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0cd330 0x7f280c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2811d5f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f280c15a330 0x7f280c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2811d5f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c155e30 con 0x7f280c0afc40 2023-07-07T18:15:33.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2811d5f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0b4f40 con 0x7f280c15a330 2023-07-07T18:15:33.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2811d5f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0b4330 con 0x7f280c0cd330 2023-07-07T18:15:33.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c0afc40 0x7f280c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c0afc40 0x7f280c0b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58120/0 (socket says 172.21.15.12:58120) 2023-07-07T18:15:33.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280b7fe700 1 -- 172.21.15.12:0/1287920212 learned_addr learned my addr 172.21.15.12:0/1287920212 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:33.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280affd700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0cd330 0x7f280c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280bfff700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f280c15a330 0x7f280c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280b7fe700 1 -- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0cd330 msgr2=0x7f280c158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280b7fe700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0cd330 0x7f280c158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280b7fe700 1 -- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f280c15a330 msgr2=0x7f280c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280b7fe700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f280c15a330 0x7f280c0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280b7fe700 1 -- 172.21.15.12:0/1287920212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4009550 con 0x7f280c0afc40 2023-07-07T18:15:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280affd700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0cd330 0x7f280c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f280b7fe700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c0afc40 0x7f280c0b53d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00e810 tx=0x7f27fc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2803fff700 1 -- 172.21.15.12:0/1287920212 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc013610 con 0x7f280c0afc40 2023-07-07T18:15:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2803fff700 1 -- 172.21.15.12:0/1287920212 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc013770 con 0x7f280c0afc40 2023-07-07T18:15:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c0b4610 con 0x7f280c0afc40 2023-07-07T18:15:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2803fff700 1 -- 172.21.15.12:0/1287920212 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc013b20 con 0x7f280c0afc40 2023-07-07T18:15:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.514+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c0b4bd0 con 0x7f280c0afc40 2023-07-07T18:15:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.515+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c0b5220 con 0x7f280c0afc40 2023-07-07T18:15:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.516+0000 7f2803fff700 1 -- 172.21.15.12:0/1287920212 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27fc013c80 con 0x7f280c0afc40 2023-07-07T18:15:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.516+0000 7f2803fff700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f27ec06ace0 0x7f27ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.516+0000 7f2803fff700 1 -- 172.21.15.12:0/1287920212 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f27fc089480 con 0x7f280c0afc40 2023-07-07T18:15:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.517+0000 7f280affd700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f27ec06ace0 0x7f27ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.517+0000 7f280affd700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f27ec06ace0 0x7f27ec06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f280c0d0880 tx=0x7f27f4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.521+0000 7f2803fff700 1 -- 172.21.15.12:0/1287920212 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f27fc054210 con 0x7f280c0afc40 2023-07-07T18:15:33.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.717+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f280c04ea20 con 0x7f280c0afc40 2023-07-07T18:15:33.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.717+0000 7f2803fff700 1 -- 172.21.15.12:0/1287920212 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f27fc057830 con 0x7f280c0afc40 2023-07-07T18:15:33.720 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:33.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f27ec06ace0 msgr2=0x7f27ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f27ec06ace0 0x7f27ec06d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f280c0d0880 tx=0x7f27f4008030 comp rx=0 tx=0).stop 2023-07-07T18:15:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c0afc40 msgr2=0x7f280c0b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c0afc40 0x7f280c0b53d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00e810 tx=0x7f27fc00ebd0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 shutdown_connections 2023-07-07T18:15:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f27ec06ace0 0x7f27ec06d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f280c15a330 0x7f280c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f280c0afc40 0x7f280c0b53d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 --2- 172.21.15.12:0/1287920212 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f280c0cd330 0x7f280c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.719+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 >> 172.21.15.12:0/1287920212 conn(0x7f280c06e5c0 msgr2=0x7f280c0cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.720+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 shutdown_connections 2023-07-07T18:15:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.720+0000 7f2811d5f700 1 -- 172.21.15.12:0/1287920212 wait complete. 2023-07-07T18:15:33.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:33.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.857+0000 7fbe97ac4700 1 Processor -- start 2023-07-07T18:15:33.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.857+0000 7fbe97ac4700 1 -- start start 2023-07-07T18:15:33.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe97ac4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90069ef0 0x7fbe90070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe97ac4700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe900cb580 con 0x7fbe900c95e0 2023-07-07T18:15:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe97ac4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe900cafb0 con 0x7fbe90157a90 2023-07-07T18:15:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe97ac4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9006db80 con 0x7fbe90069ef0 2023-07-07T18:15:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe96061700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbe900c95e0 0x7fbe9015a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55330/0 (socket says 172.21.15.12:55330) 2023-07-07T18:15:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe96061700 1 -- 172.21.15.12:0/325689080 learned_addr learned my addr 172.21.15.12:0/325689080 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe9505f700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90069ef0 0x7fbe90070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607639902 0 0) 0x7fbe900cb580 con 0x7fbe900c95e0 2023-07-07T18:15:33.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe7c0035b0 con 0x7fbe900c95e0 2023-07-07T18:15:33.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265483894 0 0) 0x7fbe900cafb0 con 0x7fbe90157a90 2023-07-07T18:15:33.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe900cb580 con 0x7fbe90157a90 2023-07-07T18:15:33.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.858+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3297733392 0 0) 0x7fbe7c0035b0 con 0x7fbe900c95e0 2023-07-07T18:15:33.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90069ef0 msgr2=0x7fbe90070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90069ef0 0x7fbe90070ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 >> v1:172.21.15.160:6789/0 conn(0x7fbe90157a90 legacy=0x7fbe9015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900cb250 con 0x7fbe900c95e0 2023-07-07T18:15:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fbe880019f0 con 0x7fbe900c95e0 2023-07-07T18:15:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 >> v1:172.21.15.12:6789/0 conn(0x7fbe900c95e0 legacy=0x7fbe9015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7c003bc0 0x7fbe7c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe7c004850 0x7fbe7c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90069ef0 0x7fbe7c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9006db80 con 0x7fbe7c004850 2023-07-07T18:15:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c00bac0 con 0x7fbe7c003bc0 2023-07-07T18:15:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c00bc80 con 0x7fbe90069ef0 2023-07-07T18:15:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9505f700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe7c004850 0x7fbe7c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe95860700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7c003bc0 0x7fbe7c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe96061700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90069ef0 0x7fbe7c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9505f700 1 -- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90069ef0 msgr2=0x7fbe7c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9505f700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90069ef0 0x7fbe7c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9505f700 1 -- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7c003bc0 msgr2=0x7fbe7c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9505f700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7c003bc0 0x7fbe7c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9505f700 1 -- 172.21.15.12:0/325689080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0035b0 con 0x7fbe7c004850 2023-07-07T18:15:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe96061700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90069ef0 0x7fbe7c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9505f700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe7c004850 0x7fbe7c004cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009b60 tx=0x7fbe7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791c0ab8db9988f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00e6c0 con 0x7fbe7c004850 2023-07-07T18:15:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c00e820 con 0x7fbe7c004850 2023-07-07T18:15:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.859+0000 7fbe9485e700 1 -- 172.21.15.12:0/325689080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00eb90 con 0x7fbe7c004850 2023-07-07T18:15:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.860+0000 7fbe97ac4700 1 -- 172.21.15.12:0/325689080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe7c004850 msgr2=0x7fbe7c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.860+0000 7fbe97ac4700 1 --2- 172.21.15.12:0/325689080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe7c004850 0x7fbe7c004cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c009b60 tx=0x7fbe7c005880 comp rx=0 tx=0).stop 2023-07-07T18:15:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.860+0000 7fbe96061700 1 -- 172.21.15.12:0/325689080 reap_dead start 2023-07-07T18:15:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.860+0000 7fbe97ac4700 1 -- 172.21.15.12:0/325689080 shutdown_connections 2023-07-07T18:15:33.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.860+0000 7fbe97ac4700 1 -- 172.21.15.12:0/325689080 >> 172.21.15.12:0/325689080 conn(0x7fbe900b1740 msgr2=0x7fbe9006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:33.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.860+0000 7fbe97ac4700 1 -- 172.21.15.12:0/325689080 shutdown_connections 2023-07-07T18:15:33.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.860+0000 7fbe97ac4700 1 -- 172.21.15.12:0/325689080 wait complete. 2023-07-07T18:15:33.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.861+0000 7fbe97ac4700 1 Processor -- start 2023-07-07T18:15:33.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.861+0000 7fbe97ac4700 1 -- start start 2023-07-07T18:15:33.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe97ac4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7c004850 0x7fbe90152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe97ac4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe90156000 0x7fbe90159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe97ac4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90153fe0 0x7fbe90154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe97ac4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe90154990 con 0x7fbe90156000 2023-07-07T18:15:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe97ac4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe901529a0 con 0x7fbe7c004850 2023-07-07T18:15:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe97ac4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9015b880 con 0x7fbe90153fe0 2023-07-07T18:15:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe9505f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe90156000 0x7fbe90159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe9505f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe90156000 0x7fbe90159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58142/0 (socket says 172.21.15.12:58142) 2023-07-07T18:15:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe9505f700 1 -- 172.21.15.12:0/1396571851 learned_addr learned my addr 172.21.15.12:0/1396571851 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe9505f700 1 -- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90153fe0 msgr2=0x7fbe90154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe96061700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90153fe0 0x7fbe90154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe95860700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7c004850 0x7fbe90152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe9505f700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90153fe0 0x7fbe90154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe9505f700 1 -- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7c004850 msgr2=0x7fbe90152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe9505f700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7c004850 0x7fbe90152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.862+0000 7fbe9505f700 1 -- 172.21.15.12:0/1396571851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90156590 con 0x7fbe90156000 2023-07-07T18:15:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.863+0000 7fbe9505f700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe90156000 0x7fbe90159900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0047b0 tx=0x7fbe8c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:33.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.863+0000 7fbe827fc700 1 -- 172.21.15.12:0/1396571851 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c021070 con 0x7fbe90156000 2023-07-07T18:15:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.863+0000 7fbe827fc700 1 -- 172.21.15.12:0/1396571851 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8c0045d0 con 0x7fbe90156000 2023-07-07T18:15:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.863+0000 7fbe827fc700 1 -- 172.21.15.12:0/1396571851 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c00e6c0 con 0x7fbe90156000 2023-07-07T18:15:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.863+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe90156870 con 0x7fbe90156000 2023-07-07T18:15:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.863+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe900c6060 con 0x7fbe90156000 2023-07-07T18:15:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.864+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe900c61f0 con 0x7fbe90156000 2023-07-07T18:15:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.864+0000 7fbe827fc700 1 -- 172.21.15.12:0/1396571851 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbe8c025070 con 0x7fbe90156000 2023-07-07T18:15:33.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.864+0000 7fbe827fc700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe7406ace0 0x7fbe7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:33.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.865+0000 7fbe827fc700 1 -- 172.21.15.12:0/1396571851 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe8c08a420 con 0x7fbe90156000 2023-07-07T18:15:33.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.865+0000 7fbe95860700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe7406ace0 0x7fbe7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:33.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.865+0000 7fbe95860700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe7406ace0 0x7fbe7406d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe901f5650 tx=0x7fbe84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:33.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:33.869+0000 7fbe827fc700 1 -- 172.21.15.12:0/1396571851 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbe900c61f0 con 0x7fbe90156000 2023-07-07T18:15:34.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.069+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe90156d90 con 0x7fbe90156000 2023-07-07T18:15:34.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.071+0000 7fbe827fc700 1 -- 172.21.15.12:0/1396571851 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7fbe90156d90 con 0x7fbe90156000 2023-07-07T18:15:34.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:34.073 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:34.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe7406ace0 msgr2=0x7fbe7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe7406ace0 0x7fbe7406d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe901f5650 tx=0x7fbe84009040 comp rx=0 tx=0).stop 2023-07-07T18:15:34.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe90156000 msgr2=0x7fbe90159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe90156000 0x7fbe90159900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0047b0 tx=0x7fbe8c0047c0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 shutdown_connections 2023-07-07T18:15:34.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fbe7406ace0 0x7fbe7406d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe90153fe0 0x7fbe90154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7c004850 0x7fbe90152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 --2- 172.21.15.12:0/1396571851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe90156000 0x7fbe90159900 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 >> 172.21.15.12:0/1396571851 conn(0x7fbe900b1740 msgr2=0x7fbe9006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:34.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 shutdown_connections 2023-07-07T18:15:34.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.073+0000 7fbe97ac4700 1 -- 172.21.15.12:0/1396571851 wait complete. 2023-07-07T18:15:34.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:34.088 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:34.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.214+0000 7f546642f700 1 Processor -- start 2023-07-07T18:15:34.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.214+0000 7f546642f700 1 -- start start 2023-07-07T18:15:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.215+0000 7f546642f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f54600aecc0 0x7f546006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.215+0000 7f546642f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f546006e970 0x7f54600ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.215+0000 7f546642f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54600ce620 con 0x7f546015fc60 2023-07-07T18:15:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.215+0000 7f546642f700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5460160580 con 0x7f54600aecc0 2023-07-07T18:15:34.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.215+0000 7f546642f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5460160860 con 0x7f546006e970 2023-07-07T18:15:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.215+0000 7f545f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f54600aecc0 0x7f546006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.215+0000 7f545ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f546015fc60 0x7f546006e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55346/0 (socket says 172.21.15.12:55346) 2023-07-07T18:15:34.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.215+0000 7f545f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f54600aecc0 0x7f546006a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58150/0 (socket says 172.21.15.12:58150) 2023-07-07T18:15:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.215+0000 7f545ffff700 1 -- 172.21.15.12:0/2124708448 learned_addr learned my addr 172.21.15.12:0/2124708448 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f54649cc700 1 --2- 172.21.15.12:0/2124708448 >> v2:172.21.15.160:3300/0 conn(0x7f546006e970 0x7f54600ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f545f7fe700 1 -- 172.21.15.12:0/2124708448 >> v2:172.21.15.160:3300/0 conn(0x7f546006e970 msgr2=0x7f54600ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f545f7fe700 1 --2- 172.21.15.12:0/2124708448 >> v2:172.21.15.160:3300/0 conn(0x7f546006e970 0x7f54600ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f545f7fe700 1 -- 172.21.15.12:0/2124708448 >> v1:172.21.15.12:6789/0 conn(0x7f546015fc60 legacy=0x7f546006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f545f7fe700 1 -- 172.21.15.12:0/2124708448 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460160b40 con 0x7f54600aecc0 2023-07-07T18:15:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f54649cc700 1 --2- 172.21.15.12:0/2124708448 >> v2:172.21.15.160:3300/0 conn(0x7f546006e970 0x7f54600ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:34.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f545f7fe700 1 --2- 172.21.15.12:0/2124708448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 0x7f546006a900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f54600c34f0 tx=0x7f5448009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9b8cca2a0570b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f545effd700 1 -- 172.21.15.12:0/2124708448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448011830 con 0x7f54600aecc0 2023-07-07T18:15:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f545effd700 1 -- 172.21.15.12:0/2124708448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5448011990 con 0x7f54600aecc0 2023-07-07T18:15:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f545effd700 1 -- 172.21.15.12:0/2124708448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448011d20 con 0x7f54600aecc0 2023-07-07T18:15:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f546642f700 1 -- 172.21.15.12:0/2124708448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 msgr2=0x7f546006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f546642f700 1 --2- 172.21.15.12:0/2124708448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 0x7f546006a900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f54600c34f0 tx=0x7f5448009b20 comp rx=0 tx=0).stop 2023-07-07T18:15:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f546642f700 1 -- 172.21.15.12:0/2124708448 shutdown_connections 2023-07-07T18:15:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.216+0000 7f546642f700 1 --2- 172.21.15.12:0/2124708448 >> v2:172.21.15.160:3300/0 conn(0x7f546006e970 0x7f54600ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.217+0000 7f546642f700 1 --2- 172.21.15.12:0/2124708448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 0x7f546006a900 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.217+0000 7f546642f700 1 -- 172.21.15.12:0/2124708448 >> 172.21.15.12:0/2124708448 conn(0x7f546006b920 msgr2=0x7f54600cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.217+0000 7f546642f700 1 -- 172.21.15.12:0/2124708448 shutdown_connections 2023-07-07T18:15:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.217+0000 7f546642f700 1 -- 172.21.15.12:0/2124708448 wait complete. 2023-07-07T18:15:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.218+0000 7f546642f700 1 Processor -- start 2023-07-07T18:15:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.218+0000 7f546642f700 1 -- start start 2023-07-07T18:15:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.219+0000 7f546642f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f546006e970 0x7f5460154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.219+0000 7f546642f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 0x7f54600c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.219+0000 7f546642f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546015fc60 0x7f54600c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.219+0000 7f546642f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600c6c10 con 0x7f54600aecc0 2023-07-07T18:15:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.219+0000 7f546642f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54600b47d0 con 0x7f546015fc60 2023-07-07T18:15:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.219+0000 7f546642f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54600b4a70 con 0x7f546006e970 2023-07-07T18:15:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.219+0000 7f545f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 0x7f54600c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.219+0000 7f545f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 0x7f54600c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58156/0 (socket says 172.21.15.12:58156) 2023-07-07T18:15:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.219+0000 7f545f7fe700 1 -- 172.21.15.12:0/332286664 learned_addr learned my addr 172.21.15.12:0/332286664 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545ffff700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f546006e970 0x7f5460154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f54649cc700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546015fc60 0x7f54600c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545f7fe700 1 -- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f546006e970 msgr2=0x7f5460154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545f7fe700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f546006e970 0x7f5460154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545f7fe700 1 -- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546015fc60 msgr2=0x7f54600c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545f7fe700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546015fc60 0x7f54600c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545f7fe700 1 -- 172.21.15.12:0/332286664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480094a0 con 0x7f54600aecc0 2023-07-07T18:15:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545f7fe700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 0x7f54600c54c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f54480090b0 tx=0x7f5448004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545cff9700 1 -- 172.21.15.12:0/332286664 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54480038a0 con 0x7f54600aecc0 2023-07-07T18:15:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545cff9700 1 -- 172.21.15.12:0/332286664 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544801f070 con 0x7f54600aecc0 2023-07-07T18:15:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54600b4d50 con 0x7f54600aecc0 2023-07-07T18:15:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f545cff9700 1 -- 172.21.15.12:0/332286664 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448003c40 con 0x7f54600aecc0 2023-07-07T18:15:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.220+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54600b5310 con 0x7f54600aecc0 2023-07-07T18:15:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.221+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54600708b0 con 0x7f54600aecc0 2023-07-07T18:15:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.222+0000 7f545cff9700 1 -- 172.21.15.12:0/332286664 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5448026480 con 0x7f54600aecc0 2023-07-07T18:15:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.222+0000 7f545cff9700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f544006ace0 0x7f544006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.222+0000 7f545cff9700 1 -- 172.21.15.12:0/332286664 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5448021070 con 0x7f54600aecc0 2023-07-07T18:15:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.222+0000 7f545ffff700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f544006ace0 0x7f544006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.223+0000 7f545ffff700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f544006ace0 0x7f544006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54500010e0 tx=0x7f5450009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.226+0000 7f545cff9700 1 -- 172.21.15.12:0/332286664 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5448056000 con 0x7f54600aecc0 2023-07-07T18:15:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.427+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f546004ea20 con 0x7f54600aecc0 2023-07-07T18:15:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.428+0000 7f545cff9700 1 -- 172.21.15.12:0/332286664 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5448059620 con 0x7f54600aecc0 2023-07-07T18:15:34.430 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f544006ace0 msgr2=0x7f544006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f544006ace0 0x7f544006d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f54500010e0 tx=0x7f5450009040 comp rx=0 tx=0).stop 2023-07-07T18:15:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 msgr2=0x7f54600c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 0x7f54600c54c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f54480090b0 tx=0x7f5448004750 comp rx=0 tx=0).stop 2023-07-07T18:15:34.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 shutdown_connections 2023-07-07T18:15:34.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f544006ace0 0x7f544006d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f546015fc60 0x7f54600c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f546006e970 0x7f5460154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 --2- 172.21.15.12:0/332286664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f54600aecc0 0x7f54600c54c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 >> 172.21.15.12:0/332286664 conn(0x7f546006b920 msgr2=0x7f54600ace60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:34.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 shutdown_connections 2023-07-07T18:15:34.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.430+0000 7f546642f700 1 -- 172.21.15.12:0/332286664 wait complete. 2023-07-07T18:15:34.444 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:34.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.571+0000 7f74e394d700 1 Processor -- start 2023-07-07T18:15:34.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.571+0000 7f74e394d700 1 -- start start 2023-07-07T18:15:34.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e394d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0a60 0x7f74dc0b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e394d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74dc0b51d0 0x7f74dc0cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e394d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc0cd9d0 con 0x7f74dc0d0e30 2023-07-07T18:15:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e394d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc0d0060 con 0x7f74dc0b51d0 2023-07-07T18:15:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e394d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0cfe50 con 0x7f74dc0d0a60 2023-07-07T18:15:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e0ee8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74dc0b51d0 0x7f74dc0cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e0ee8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74dc0b51d0 0x7f74dc0cf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58164/0 (socket says 172.21.15.12:58164) 2023-07-07T18:15:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e0ee8700 1 -- 172.21.15.12:0/1755234186 learned_addr learned my addr 172.21.15.12:0/1755234186 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e16e9700 1 --2- 172.21.15.12:0/1755234186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0a60 0x7f74dc0b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e0ee8700 1 -- 172.21.15.12:0/1755234186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0a60 msgr2=0x7f74dc0b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e0ee8700 1 --2- 172.21.15.12:0/1755234186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0a60 0x7f74dc0b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e0ee8700 1 -- 172.21.15.12:0/1755234186 >> v1:172.21.15.160:6789/0 conn(0x7f74dc0d0e30 legacy=0x7f74dc0d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e0ee8700 1 -- 172.21.15.12:0/1755234186 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc0b5640 con 0x7f74dc0b51d0 2023-07-07T18:15:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74e0ee8700 1 --2- 172.21.15.12:0/1755234186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0b51d0 0x7f74dc0cf910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0098f0 tx=0x7f74cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcc44feb85cde2b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74d3fff700 1 -- 172.21.15.12:0/1755234186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00b8a0 con 0x7f74dc0b51d0 2023-07-07T18:15:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74d3fff700 1 -- 172.21.15.12:0/1755234186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc00ba00 con 0x7f74dc0b51d0 2023-07-07T18:15:34.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.572+0000 7f74d3fff700 1 -- 172.21.15.12:0/1755234186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00bd90 con 0x7f74dc0b51d0 2023-07-07T18:15:34.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.573+0000 7f74e394d700 1 -- 172.21.15.12:0/1755234186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0b51d0 msgr2=0x7f74dc0cf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.573+0000 7f74e394d700 1 --2- 172.21.15.12:0/1755234186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0b51d0 0x7f74dc0cf910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0098f0 tx=0x7f74cc009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:34.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.573+0000 7f74e394d700 1 -- 172.21.15.12:0/1755234186 shutdown_connections 2023-07-07T18:15:34.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.573+0000 7f74e394d700 1 --2- 172.21.15.12:0/1755234186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0a60 0x7f74dc0b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.573+0000 7f74e394d700 1 --2- 172.21.15.12:0/1755234186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0b51d0 0x7f74dc0cf910 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.573+0000 7f74e394d700 1 -- 172.21.15.12:0/1755234186 >> 172.21.15.12:0/1755234186 conn(0x7f74dc071620 msgr2=0x7f74dc0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:34.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.573+0000 7f74e394d700 1 -- 172.21.15.12:0/1755234186 shutdown_connections 2023-07-07T18:15:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.573+0000 7f74e394d700 1 -- 172.21.15.12:0/1755234186 wait complete. 2023-07-07T18:15:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.574+0000 7f74e394d700 1 Processor -- start 2023-07-07T18:15:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.574+0000 7f74e394d700 1 -- start start 2023-07-07T18:15:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e394d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74dc0b51d0 0x7f74dc15eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e394d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0d0a60 0x7f74dc152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e394d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0e30 0x7f74dc15c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e394d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc1525d0 con 0x7f74dc0d0a60 2023-07-07T18:15:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e394d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc15c900 con 0x7f74dc0b51d0 2023-07-07T18:15:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e394d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc15cbe0 con 0x7f74dc0d0e30 2023-07-07T18:15:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e0ee8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0d0a60 0x7f74dc152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e0ee8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0d0a60 0x7f74dc152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58170/0 (socket says 172.21.15.12:58170) 2023-07-07T18:15:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e0ee8700 1 -- 172.21.15.12:0/753830383 learned_addr learned my addr 172.21.15.12:0/753830383 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e0ee8700 1 -- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0e30 msgr2=0x7f74dc15c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e16e9700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74dc0b51d0 0x7f74dc15eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e1eea700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0e30 0x7f74dc15c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e0ee8700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0e30 0x7f74dc15c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e0ee8700 1 -- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74dc0b51d0 msgr2=0x7f74dc15eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e0ee8700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74dc0b51d0 0x7f74dc15eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.575+0000 7f74e0ee8700 1 -- 172.21.15.12:0/753830383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc009550 con 0x7f74dc0d0a60 2023-07-07T18:15:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.576+0000 7f74e0ee8700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0d0a60 0x7f74dc152090 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000c00 tx=0x7f74cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.576+0000 7f74d1ffb700 1 -- 172.21.15.12:0/753830383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc004480 con 0x7f74dc0d0a60 2023-07-07T18:15:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.576+0000 7f74d1ffb700 1 -- 172.21.15.12:0/753830383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc01f070 con 0x7f74dc0d0a60 2023-07-07T18:15:34.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.576+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc15cec0 con 0x7f74dc0d0a60 2023-07-07T18:15:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.576+0000 7f74d1ffb700 1 -- 172.21.15.12:0/753830383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0038c0 con 0x7f74dc0d0a60 2023-07-07T18:15:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.576+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc15d480 con 0x7f74dc0d0a60 2023-07-07T18:15:34.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.577+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc04ea20 con 0x7f74dc0d0a60 2023-07-07T18:15:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.577+0000 7f74d1ffb700 1 -- 172.21.15.12:0/753830383 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74cc021030 con 0x7f74dc0d0a60 2023-07-07T18:15:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.578+0000 7f74d1ffb700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f74c006ace0 0x7f74c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.578+0000 7f74d1ffb700 1 -- 172.21.15.12:0/753830383 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74cc08ada0 con 0x7f74dc0d0a60 2023-07-07T18:15:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.578+0000 7f74e16e9700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f74c006ace0 0x7f74c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.579+0000 7f74e16e9700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f74c006ace0 0x7f74c006d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0b3310 tx=0x7f74d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:34.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.582+0000 7f74d1ffb700 1 -- 172.21.15.12:0/753830383 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f74cc055cd0 con 0x7f74dc0d0a60 2023-07-07T18:15:34.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.779+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74dc0b3340 con 0x7f74dc0d0a60 2023-07-07T18:15:34.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.779+0000 7f74d1ffb700 1 -- 172.21.15.12:0/753830383 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74cc0592f0 con 0x7f74dc0d0a60 2023-07-07T18:15:34.782 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:34.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.781+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f74c006ace0 msgr2=0x7f74c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.781+0000 7f74e394d700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f74c006ace0 0x7f74c006d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0b3310 tx=0x7f74d8008040 comp rx=0 tx=0).stop 2023-07-07T18:15:34.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.781+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0d0a60 msgr2=0x7f74dc152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.781+0000 7f74e394d700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0d0a60 0x7f74dc152090 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f74cc000c00 tx=0x7f74cc004750 comp rx=0 tx=0).stop 2023-07-07T18:15:34.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.782+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 shutdown_connections 2023-07-07T18:15:34.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.782+0000 7f74e394d700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f74c006ace0 0x7f74c006d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.782+0000 7f74e394d700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74dc0d0e30 0x7f74dc15c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.782+0000 7f74e394d700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74dc0b51d0 0x7f74dc15eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.782+0000 7f74e394d700 1 --2- 172.21.15.12:0/753830383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74dc0d0a60 0x7f74dc152090 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.782+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 >> 172.21.15.12:0/753830383 conn(0x7f74dc071620 msgr2=0x7f74dc0c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:34.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.782+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 shutdown_connections 2023-07-07T18:15:34.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.782+0000 7f74e394d700 1 -- 172.21.15.12:0/753830383 wait complete. 2023-07-07T18:15:34.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.921+0000 7f1969621700 1 Processor -- start 2023-07-07T18:15:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.921+0000 7f1969621700 1 -- start start 2023-07-07T18:15:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.922+0000 7f1969621700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19640b23a0 0x7f196406cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.922+0000 7f1969621700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f196415d2d0 0x7f19640b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.922+0000 7f1969621700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196415c720 con 0x7f196415fe40 2023-07-07T18:15:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.922+0000 7f1969621700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196415d820 con 0x7f19640b23a0 2023-07-07T18:15:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.922+0000 7f1969621700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19640d03a0 con 0x7f196415d2d0 2023-07-07T18:15:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.922+0000 7f1962ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f19640b23a0 0x7f196406cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.922+0000 7f19637fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f196415fe40 0x7f19641602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55378/0 (socket says 172.21.15.12:55378) 2023-07-07T18:15:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.922+0000 7f19637fe700 1 -- 172.21.15.12:0/2764225263 learned_addr learned my addr 172.21.15.12:0/2764225263 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.923+0000 7f1962ffd700 1 -- 172.21.15.12:0/2764225263 >> v2:172.21.15.160:3300/0 conn(0x7f196415d2d0 msgr2=0x7f19640b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.923+0000 7f1962ffd700 1 --2- 172.21.15.12:0/2764225263 >> v2:172.21.15.160:3300/0 conn(0x7f196415d2d0 0x7f19640b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.923+0000 7f1962ffd700 1 -- 172.21.15.12:0/2764225263 >> v1:172.21.15.12:6789/0 conn(0x7f196415fe40 legacy=0x7f19641602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.923+0000 7f1961ffb700 1 -- 172.21.15.12:0/2764225263 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160852917 0 0) 0x7f195c001490 con 0x7f196415fe40 2023-07-07T18:15:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.923+0000 7f1962ffd700 1 -- 172.21.15.12:0/2764225263 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19640b2cb0 con 0x7f19640b23a0 2023-07-07T18:15:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.923+0000 7f1962ffd700 1 --2- 172.21.15.12:0/2764225263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 0x7f196406cc60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f19640ceef0 tx=0x7f1954009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c170311953915322 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.923+0000 7f1961ffb700 1 -- 172.21.15.12:0/2764225263 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954011830 con 0x7f19640b23a0 2023-07-07T18:15:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.923+0000 7f1961ffb700 1 -- 172.21.15.12:0/2764225263 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1954011990 con 0x7f19640b23a0 2023-07-07T18:15:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.923+0000 7f1961ffb700 1 -- 172.21.15.12:0/2764225263 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954011d20 con 0x7f19640b23a0 2023-07-07T18:15:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.924+0000 7f1969621700 1 -- 172.21.15.12:0/2764225263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 msgr2=0x7f196406cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.924+0000 7f1969621700 1 --2- 172.21.15.12:0/2764225263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 0x7f196406cc60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f19640ceef0 tx=0x7f1954009b20 comp rx=0 tx=0).stop 2023-07-07T18:15:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.924+0000 7f1969621700 1 -- 172.21.15.12:0/2764225263 shutdown_connections 2023-07-07T18:15:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.924+0000 7f1969621700 1 --2- 172.21.15.12:0/2764225263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 0x7f196406cc60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.924+0000 7f1969621700 1 --2- 172.21.15.12:0/2764225263 >> v2:172.21.15.160:3300/0 conn(0x7f196415d2d0 0x7f19640b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.924+0000 7f1969621700 1 -- 172.21.15.12:0/2764225263 >> 172.21.15.12:0/2764225263 conn(0x7f196406e5c0 msgr2=0x7f196406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.924+0000 7f1969621700 1 -- 172.21.15.12:0/2764225263 shutdown_connections 2023-07-07T18:15:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.924+0000 7f1969621700 1 -- 172.21.15.12:0/2764225263 wait complete. 2023-07-07T18:15:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.925+0000 7f1969621700 1 Processor -- start 2023-07-07T18:15:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.925+0000 7f1969621700 1 -- start start 2023-07-07T18:15:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1969621700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 0x7f1964153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1969621700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f196415d2d0 0x7f19641534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1969621700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f196415fe40 0x7f196406b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1969621700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196406c850 con 0x7f19640b23a0 2023-07-07T18:15:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1969621700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196406c290 con 0x7f196415d2d0 2023-07-07T18:15:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1969621700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196406c570 con 0x7f196415fe40 2023-07-07T18:15:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1962ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 0x7f1964153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1962ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 0x7f1964153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58182/0 (socket says 172.21.15.12:58182) 2023-07-07T18:15:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1962ffd700 1 -- 172.21.15.12:0/3106000458 learned_addr learned my addr 172.21.15.12:0/3106000458 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1962ffd700 1 -- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f196415fe40 msgr2=0x7f196406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1962ffd700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f196415fe40 0x7f196406b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1962ffd700 1 -- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f196415d2d0 msgr2=0x7f19641534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1962ffd700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f196415d2d0 0x7f19641534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1962ffd700 1 -- 172.21.15.12:0/3106000458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540094a0 con 0x7f19640b23a0 2023-07-07T18:15:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.926+0000 7f1962ffd700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 0x7f1964153f60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f19540090b0 tx=0x7f1954004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.927+0000 7f194b7fe700 1 -- 172.21.15.12:0/3106000458 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19540038a0 con 0x7f19640b23a0 2023-07-07T18:15:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.927+0000 7f194b7fe700 1 -- 172.21.15.12:0/3106000458 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195401f070 con 0x7f19640b23a0 2023-07-07T18:15:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.927+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19641e5d90 con 0x7f19640b23a0 2023-07-07T18:15:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.927+0000 7f194b7fe700 1 -- 172.21.15.12:0/3106000458 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954003c60 con 0x7f19640b23a0 2023-07-07T18:15:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.927+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19641e6350 con 0x7f19640b23a0 2023-07-07T18:15:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.928+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196404ea20 con 0x7f19640b23a0 2023-07-07T18:15:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.928+0000 7f194b7fe700 1 -- 172.21.15.12:0/3106000458 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f195401a430 con 0x7f19640b23a0 2023-07-07T18:15:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.928+0000 7f194b7fe700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f195006ace0 0x7f195006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.928+0000 7f194b7fe700 1 -- 172.21.15.12:0/3106000458 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1954021070 con 0x7f19640b23a0 2023-07-07T18:15:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.929+0000 7f19627fc700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f195006ace0 0x7f195006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.929+0000 7f19627fc700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f195006ace0 0x7f195006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f196415e9a0 tx=0x7f1958006d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:34.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:34.933+0000 7f194b7fe700 1 -- 172.21.15.12:0/3106000458 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19540560a0 con 0x7f19640b23a0 2023-07-07T18:15:35.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.131+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1964070760 con 0x7f19640b23a0 2023-07-07T18:15:35.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.132+0000 7f194b7fe700 1 -- 172.21.15.12:0/3106000458 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f19540596c0 con 0x7f19640b23a0 2023-07-07T18:15:35.134 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:35.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f195006ace0 msgr2=0x7f195006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f195006ace0 0x7f195006d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f196415e9a0 tx=0x7f1958006d20 comp rx=0 tx=0).stop 2023-07-07T18:15:35.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 msgr2=0x7f1964153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 0x7f1964153f60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f19540090b0 tx=0x7f1954004750 comp rx=0 tx=0).stop 2023-07-07T18:15:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 shutdown_connections 2023-07-07T18:15:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f195006ace0 0x7f195006d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f196415fe40 0x7f196406b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19640b23a0 0x7f1964153f60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 --2- 172.21.15.12:0/3106000458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f196415d2d0 0x7f19641534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 >> 172.21.15.12:0/3106000458 conn(0x7f196406e5c0 msgr2=0x7f196415c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:35.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 shutdown_connections 2023-07-07T18:15:35.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.134+0000 7f1969621700 1 -- 172.21.15.12:0/3106000458 wait complete. 2023-07-07T18:15:35.148 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:35.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.274+0000 7fafb8647700 1 Processor -- start 2023-07-07T18:15:35.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.274+0000 7fafb8647700 1 -- start start 2023-07-07T18:15:35.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb8647700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fafb015a330 0x7fafb0070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb8647700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00caf70 con 0x7fafb00cd330 2023-07-07T18:15:35.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb8647700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00cb210 con 0x7fafb00afc40 2023-07-07T18:15:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb8647700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb015e360 con 0x7fafb015a330 2023-07-07T18:15:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb63e3700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fafb00cd330 0x7fafb00cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55388/0 (socket says 172.21.15.12:55388) 2023-07-07T18:15:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb63e3700 1 -- 172.21.15.12:0/1059157402 learned_addr learned my addr 172.21.15.12:0/1059157402 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb5be2700 1 --2- 172.21.15.12:0/1059157402 >> v2:172.21.15.160:3300/0 conn(0x7fafb015a330 0x7fafb0070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb53e1700 1 -- 172.21.15.12:0/1059157402 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672891273 0 0) 0x7fafb00caf70 con 0x7fafb00cd330 2023-07-07T18:15:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb53e1700 1 -- 172.21.15.12:0/1059157402 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf9c0035b0 con 0x7fafb00cd330 2023-07-07T18:15:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb53e1700 1 -- 172.21.15.12:0/1059157402 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754705121 0 0) 0x7fafb00cb210 con 0x7fafb00afc40 2023-07-07T18:15:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb53e1700 1 -- 172.21.15.12:0/1059157402 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb00caf70 con 0x7fafb00afc40 2023-07-07T18:15:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb5be2700 1 -- 172.21.15.12:0/1059157402 >> v1:172.21.15.160:6789/0 conn(0x7fafb00afc40 legacy=0x7fafb015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb5be2700 1 -- 172.21.15.12:0/1059157402 >> v1:172.21.15.12:6789/0 conn(0x7fafb00cd330 legacy=0x7fafb00cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb53e1700 1 -- 172.21.15.12:0/1059157402 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1240217869 0 0) 0x7faf9c0035b0 con 0x7fafb00cd330 2023-07-07T18:15:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.275+0000 7fafb5be2700 1 -- 172.21.15.12:0/1059157402 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00ccc20 con 0x7fafb015a330 2023-07-07T18:15:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.276+0000 7fafb5be2700 1 --2- 172.21.15.12:0/1059157402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb015a330 0x7fafb0070980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009840 tx=0x7fafa0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6b7293d8b0f2ce3 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:35.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.276+0000 7fafb53e1700 1 -- 172.21.15.12:0/1059157402 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac001670 con 0x7fafb015a330 2023-07-07T18:15:35.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.276+0000 7fafb53e1700 1 -- 172.21.15.12:0/1059157402 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa0004030 con 0x7fafb015a330 2023-07-07T18:15:35.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.276+0000 7fafb53e1700 1 -- 172.21.15.12:0/1059157402 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00043a0 con 0x7fafb015a330 2023-07-07T18:15:35.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.276+0000 7fafb8647700 1 -- 172.21.15.12:0/1059157402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb015a330 msgr2=0x7fafb0070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.276+0000 7fafb8647700 1 --2- 172.21.15.12:0/1059157402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb015a330 0x7fafb0070980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009840 tx=0x7fafa0009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:35.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.277+0000 7fafb8647700 1 -- 172.21.15.12:0/1059157402 shutdown_connections 2023-07-07T18:15:35.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.277+0000 7fafb8647700 1 --2- 172.21.15.12:0/1059157402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb015a330 0x7fafb0070980 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.277+0000 7fafb8647700 1 -- 172.21.15.12:0/1059157402 >> 172.21.15.12:0/1059157402 conn(0x7fafb006e5c0 msgr2=0x7fafb006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:35.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.277+0000 7fafb8647700 1 -- 172.21.15.12:0/1059157402 shutdown_connections 2023-07-07T18:15:35.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.277+0000 7fafb8647700 1 -- 172.21.15.12:0/1059157402 wait complete. 2023-07-07T18:15:35.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.278+0000 7fafb8647700 1 Processor -- start 2023-07-07T18:15:35.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.278+0000 7fafb8647700 1 -- start start 2023-07-07T18:15:35.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.278+0000 7fafb8647700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb00afc40 0x7fafb00b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.278+0000 7fafb8647700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb00cd330 0x7fafb00b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.278+0000 7fafb8647700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb015a330 0x7fafb014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb8647700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00b44e0 con 0x7fafb00cd330 2023-07-07T18:15:35.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb8647700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00b3910 con 0x7fafb015a330 2023-07-07T18:15:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb8647700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00b3bb0 con 0x7fafb00afc40 2023-07-07T18:15:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb5be2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb00cd330 0x7fafb00b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb5be2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb00cd330 0x7fafb00b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58198/0 (socket says 172.21.15.12:58198) 2023-07-07T18:15:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb5be2700 1 -- 172.21.15.12:0/3183115557 learned_addr learned my addr 172.21.15.12:0/3183115557 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb6be4700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb015a330 0x7fafb014f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb63e3700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb00afc40 0x7fafb00b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb5be2700 1 -- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb00afc40 msgr2=0x7fafb00b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb5be2700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb00afc40 0x7fafb00b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb5be2700 1 -- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb015a330 msgr2=0x7fafb014f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb5be2700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb015a330 0x7fafb014f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb5be2700 1 -- 172.21.15.12:0/3183115557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00094a0 con 0x7fafb00cd330 2023-07-07T18:15:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb5be2700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb00cd330 0x7fafb00b5e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fafa0000c00 tx=0x7fafa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafa6ffd700 1 -- 172.21.15.12:0/3183115557 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0003c90 con 0x7fafb00cd330 2023-07-07T18:15:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafa6ffd700 1 -- 172.21.15.12:0/3183115557 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa001f070 con 0x7fafb00cd330 2023-07-07T18:15:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafa6ffd700 1 -- 172.21.15.12:0/3183115557 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa0011870 con 0x7fafb00cd330 2023-07-07T18:15:35.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00b3e90 con 0x7fafb00cd330 2023-07-07T18:15:35.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.279+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb01e3c10 con 0x7fafb00cd330 2023-07-07T18:15:35.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.280+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb01e3da0 con 0x7fafb00cd330 2023-07-07T18:15:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.281+0000 7fafa6ffd700 1 -- 172.21.15.12:0/3183115557 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafa0021030 con 0x7fafb00cd330 2023-07-07T18:15:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.281+0000 7fafa6ffd700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9406ace0 0x7faf9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.281+0000 7fafa6ffd700 1 -- 172.21.15.12:0/3183115557 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafa008a900 con 0x7fafb00cd330 2023-07-07T18:15:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.281+0000 7fafb63e3700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9406ace0 0x7faf9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.282+0000 7fafb63e3700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9406ace0 0x7faf9406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fafac000fd0 tx=0x7fafac000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.286+0000 7fafa6ffd700 1 -- 172.21.15.12:0/3183115557 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fafa00591a0 con 0x7fafb00cd330 2023-07-07T18:15:35.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.480+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafb00b2740 con 0x7fafb00cd330 2023-07-07T18:15:35.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.481+0000 7fafa6ffd700 1 -- 172.21.15.12:0/3183115557 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafb00b2740 con 0x7fafb00cd330 2023-07-07T18:15:35.483 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9406ace0 msgr2=0x7faf9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9406ace0 0x7faf9406d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fafac000fd0 tx=0x7fafac000ed0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb00cd330 msgr2=0x7fafb00b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb00cd330 0x7fafb00b5e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fafa0000c00 tx=0x7fafa0004750 comp rx=0 tx=0).stop 2023-07-07T18:15:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 shutdown_connections 2023-07-07T18:15:35.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9406ace0 0x7faf9406d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb015a330 0x7fafb014f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb00afc40 0x7fafb00b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 --2- 172.21.15.12:0/3183115557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb00cd330 0x7fafb00b5e70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 >> 172.21.15.12:0/3183115557 conn(0x7fafb006e5c0 msgr2=0x7fafb00cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 shutdown_connections 2023-07-07T18:15:35.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.483+0000 7fafb8647700 1 -- 172.21.15.12:0/3183115557 wait complete. 2023-07-07T18:15:35.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:35.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.621+0000 7fba9655f700 1 Processor -- start 2023-07-07T18:15:35.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.622+0000 7fba9655f700 1 -- start start 2023-07-07T18:15:35.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.622+0000 7fba9655f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba900aecc0 0x7fba9006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.622+0000 7fba9655f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba900ce620 con 0x7fba9006e970 2023-07-07T18:15:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.622+0000 7fba9655f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba90160580 con 0x7fba9015fc60 2023-07-07T18:15:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.622+0000 7fba9655f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba90160860 con 0x7fba900aecc0 2023-07-07T18:15:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba94afc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fba9006e970 0x7fba900cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55406/0 (socket says 172.21.15.12:55406) 2023-07-07T18:15:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba94afc700 1 -- 172.21.15.12:0/528310756 learned_addr learned my addr 172.21.15.12:0/528310756 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8f7fe700 1 --2- 172.21.15.12:0/528310756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba900aecc0 0x7fba9006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8effd700 1 -- 172.21.15.12:0/528310756 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014705035 0 0) 0x7fba900ce620 con 0x7fba9006e970 2023-07-07T18:15:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8effd700 1 -- 172.21.15.12:0/528310756 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba780035b0 con 0x7fba9006e970 2023-07-07T18:15:35.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8effd700 1 -- 172.21.15.12:0/528310756 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214120094 0 0) 0x7fba90160580 con 0x7fba9015fc60 2023-07-07T18:15:35.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8effd700 1 -- 172.21.15.12:0/528310756 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba900ce620 con 0x7fba9015fc60 2023-07-07T18:15:35.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8f7fe700 1 -- 172.21.15.12:0/528310756 >> v1:172.21.15.160:6789/0 conn(0x7fba9015fc60 legacy=0x7fba9006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8f7fe700 1 -- 172.21.15.12:0/528310756 >> v1:172.21.15.12:6789/0 conn(0x7fba9006e970 legacy=0x7fba900cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8f7fe700 1 -- 172.21.15.12:0/528310756 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90160b40 con 0x7fba900aecc0 2023-07-07T18:15:35.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8f7fe700 1 --2- 172.21.15.12:0/528310756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba900aecc0 0x7fba9006a900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fba84009870 tx=0x7fba84009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c24f8264dac2f9f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8effd700 1 -- 172.21.15.12:0/528310756 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84011830 con 0x7fba900aecc0 2023-07-07T18:15:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8effd700 1 -- 172.21.15.12:0/528310756 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84011990 con 0x7fba900aecc0 2023-07-07T18:15:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.623+0000 7fba8effd700 1 -- 172.21.15.12:0/528310756 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84011d20 con 0x7fba900aecc0 2023-07-07T18:15:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.624+0000 7fba9655f700 1 -- 172.21.15.12:0/528310756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba900aecc0 msgr2=0x7fba9006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.624+0000 7fba9655f700 1 --2- 172.21.15.12:0/528310756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba900aecc0 0x7fba9006a900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fba84009870 tx=0x7fba84009b80 comp rx=0 tx=0).stop 2023-07-07T18:15:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.624+0000 7fba9655f700 1 -- 172.21.15.12:0/528310756 shutdown_connections 2023-07-07T18:15:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.624+0000 7fba9655f700 1 --2- 172.21.15.12:0/528310756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba900aecc0 0x7fba9006a900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.624+0000 7fba9655f700 1 -- 172.21.15.12:0/528310756 >> 172.21.15.12:0/528310756 conn(0x7fba9006b920 msgr2=0x7fba900cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.624+0000 7fba9655f700 1 -- 172.21.15.12:0/528310756 shutdown_connections 2023-07-07T18:15:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.624+0000 7fba9655f700 1 -- 172.21.15.12:0/528310756 wait complete. 2023-07-07T18:15:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.625+0000 7fba9655f700 1 Processor -- start 2023-07-07T18:15:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.625+0000 7fba9655f700 1 -- start start 2023-07-07T18:15:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba9655f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba9006e970 0x7fba90153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba9655f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba900aecc0 0x7fba901f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba9655f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba9015fc60 0x7fba901f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba9655f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900cba60 con 0x7fba9015fc60 2023-07-07T18:15:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba9655f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba900cbd40 con 0x7fba900aecc0 2023-07-07T18:15:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba9655f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba900cc020 con 0x7fba9006e970 2023-07-07T18:15:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba94afc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba9015fc60 0x7fba901f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba94afc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba9015fc60 0x7fba901f6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58214/0 (socket says 172.21.15.12:58214) 2023-07-07T18:15:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba94afc700 1 -- 172.21.15.12:0/919138192 learned_addr learned my addr 172.21.15.12:0/919138192 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba8ffff700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba9006e970 0x7fba90153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.626+0000 7fba8f7fe700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba900aecc0 0x7fba901f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba94afc700 1 -- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba9006e970 msgr2=0x7fba90153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba94afc700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba9006e970 0x7fba90153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba94afc700 1 -- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba900aecc0 msgr2=0x7fba901f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba94afc700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba900aecc0 0x7fba901f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba94afc700 1 -- 172.21.15.12:0/919138192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba840094a0 con 0x7fba9015fc60 2023-07-07T18:15:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba94afc700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba9015fc60 0x7fba901f6020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fba8800cae0 tx=0x7fba8800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba8cff9700 1 -- 172.21.15.12:0/919138192 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8800a9e0 con 0x7fba9015fc60 2023-07-07T18:15:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba8cff9700 1 -- 172.21.15.12:0/919138192 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8800ab40 con 0x7fba9015fc60 2023-07-07T18:15:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba900cc300 con 0x7fba9015fc60 2023-07-07T18:15:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba8cff9700 1 -- 172.21.15.12:0/919138192 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88012400 con 0x7fba9015fc60 2023-07-07T18:15:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.627+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba90153fe0 con 0x7fba9015fc60 2023-07-07T18:15:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.628+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba900cc820 con 0x7fba9015fc60 2023-07-07T18:15:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.629+0000 7fba8cff9700 1 -- 172.21.15.12:0/919138192 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba8801b3b0 con 0x7fba9015fc60 2023-07-07T18:15:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.629+0000 7fba8cff9700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fba7c06ace0 0x7fba7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.629+0000 7fba8cff9700 1 -- 172.21.15.12:0/919138192 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fba880893a0 con 0x7fba9015fc60 2023-07-07T18:15:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.629+0000 7fba8ffff700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fba7c06ace0 0x7fba7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.630+0000 7fba8ffff700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fba7c06ace0 0x7fba7c06d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba80007fd0 tx=0x7fba80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:35.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.633+0000 7fba8cff9700 1 -- 172.21.15.12:0/919138192 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba880541b0 con 0x7fba9015fc60 2023-07-07T18:15:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.832+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fba9004ea20 con 0x7fba9015fc60 2023-07-07T18:15:35.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.833+0000 7fba8cff9700 1 -- 172.21.15.12:0/919138192 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fba880577d0 con 0x7fba9015fc60 2023-07-07T18:15:35.836 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fba7c06ace0 msgr2=0x7fba7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fba7c06ace0 0x7fba7c06d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba80007fd0 tx=0x7fba80009040 comp rx=0 tx=0).stop 2023-07-07T18:15:35.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba9015fc60 msgr2=0x7fba901f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba9015fc60 0x7fba901f6020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fba8800cae0 tx=0x7fba8800cdf0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 shutdown_connections 2023-07-07T18:15:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fba7c06ace0 0x7fba7c06d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba9015fc60 0x7fba901f6020 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba9006e970 0x7fba90153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 --2- 172.21.15.12:0/919138192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba900aecc0 0x7fba901f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 >> 172.21.15.12:0/919138192 conn(0x7fba9006b920 msgr2=0x7fba900af450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 shutdown_connections 2023-07-07T18:15:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.835+0000 7fba9655f700 1 -- 172.21.15.12:0/919138192 wait complete. 2023-07-07T18:15:35.849 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:35.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.972+0000 7f4c196a0700 1 Processor -- start 2023-07-07T18:15:35.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.972+0000 7f4c196a0700 1 -- start start 2023-07-07T18:15:35.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c196a0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1415c570 0x7f4c140cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c196a0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4c140cd660 0x7f4c14160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c196a0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c14160880 0x7f4c1406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c196a0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1415d670 con 0x7f4c14160880 2023-07-07T18:15:35.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c196a0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c140cdad0 con 0x7f4c140cd660 2023-07-07T18:15:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c196a0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c141610a0 con 0x7f4c1415c570 2023-07-07T18:15:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c137fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c14160880 0x7f4c1406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c137fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c14160880 0x7f4c1406b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58222/0 (socket says 172.21.15.12:58222) 2023-07-07T18:15:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c137fe700 1 -- 172.21.15.12:0/1183993065 learned_addr learned my addr 172.21.15.12:0/1183993065 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c127fc700 1 --2- 172.21.15.12:0/1183993065 >> v2:172.21.15.160:3300/0 conn(0x7f4c140cd660 0x7f4c14160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c12ffd700 1 --2- 172.21.15.12:0/1183993065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1415c570 0x7f4c140cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c137fe700 1 -- 172.21.15.12:0/1183993065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1415c570 msgr2=0x7f4c140cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c137fe700 1 --2- 172.21.15.12:0/1183993065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1415c570 0x7f4c140cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c137fe700 1 -- 172.21.15.12:0/1183993065 >> v2:172.21.15.160:3300/0 conn(0x7f4c140cd660 msgr2=0x7f4c14160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c137fe700 1 --2- 172.21.15.12:0/1183993065 >> v2:172.21.15.160:3300/0 conn(0x7f4c140cd660 0x7f4c14160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c137fe700 1 -- 172.21.15.12:0/1183993065 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1415da90 con 0x7f4c14160880 2023-07-07T18:15:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c12ffd700 1 --2- 172.21.15.12:0/1183993065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1415c570 0x7f4c140cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c137fe700 1 --2- 172.21.15.12:0/1183993065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 0x7f4c1406b200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c140723d0 tx=0x7f4c0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9836fd0824b14c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c11ffb700 1 -- 172.21.15.12:0/1183993065 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00e070 con 0x7f4c14160880 2023-07-07T18:15:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c11ffb700 1 -- 172.21.15.12:0/1183993065 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c00b980 con 0x7f4c14160880 2023-07-07T18:15:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.973+0000 7f4c11ffb700 1 -- 172.21.15.12:0/1183993065 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00bd30 con 0x7f4c14160880 2023-07-07T18:15:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.974+0000 7f4c196a0700 1 -- 172.21.15.12:0/1183993065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 msgr2=0x7f4c1406b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.974+0000 7f4c196a0700 1 --2- 172.21.15.12:0/1183993065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 0x7f4c1406b200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4c140723d0 tx=0x7f4c0c00b330 comp rx=0 tx=0).stop 2023-07-07T18:15:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.974+0000 7f4c196a0700 1 -- 172.21.15.12:0/1183993065 shutdown_connections 2023-07-07T18:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.974+0000 7f4c196a0700 1 --2- 172.21.15.12:0/1183993065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c1415c570 0x7f4c140cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.974+0000 7f4c196a0700 1 --2- 172.21.15.12:0/1183993065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 0x7f4c1406b200 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.974+0000 7f4c196a0700 1 --2- 172.21.15.12:0/1183993065 >> v2:172.21.15.160:3300/0 conn(0x7f4c140cd660 0x7f4c14160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.974+0000 7f4c196a0700 1 -- 172.21.15.12:0/1183993065 >> 172.21.15.12:0/1183993065 conn(0x7f4c14071620 msgr2=0x7f4c140719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.974+0000 7f4c196a0700 1 -- 172.21.15.12:0/1183993065 shutdown_connections 2023-07-07T18:15:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.974+0000 7f4c196a0700 1 -- 172.21.15.12:0/1183993065 wait complete. 2023-07-07T18:15:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.975+0000 7f4c196a0700 1 Processor -- start 2023-07-07T18:15:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.975+0000 7f4c196a0700 1 -- start start 2023-07-07T18:15:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c196a0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c140cd660 0x7f4c14151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c196a0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1415c570 0x7f4c140c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c196a0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 0x7f4c140c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c196a0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140c7920 con 0x7f4c14160880 2023-07-07T18:15:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c196a0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140c7c00 con 0x7f4c1415c570 2023-07-07T18:15:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c196a0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140c7ee0 con 0x7f4c140cd660 2023-07-07T18:15:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 0x7f4c140c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 0x7f4c140c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58228/0 (socket says 172.21.15.12:58228) 2023-07-07T18:15:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c137fe700 1 -- 172.21.15.12:0/3817228228 learned_addr learned my addr 172.21.15.12:0/3817228228 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c12ffd700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c140cd660 0x7f4c14151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c127fc700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1415c570 0x7f4c140c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c137fe700 1 -- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c140cd660 msgr2=0x7f4c14151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c137fe700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c140cd660 0x7f4c14151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c137fe700 1 -- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1415c570 msgr2=0x7f4c140c6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:35.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c137fe700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1415c570 0x7f4c140c6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:35.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c137fe700 1 -- 172.21.15.12:0/3817228228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c009b30 con 0x7f4c14160880 2023-07-07T18:15:35.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.976+0000 7f4c127fc700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1415c570 0x7f4c140c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:35.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.977+0000 7f4c137fe700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 0x7f4c140c85a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4c140d0170 tx=0x7f4c0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.977+0000 7f4bfb7fe700 1 -- 172.21.15.12:0/3817228228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c004250 con 0x7f4c14160880 2023-07-07T18:15:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.977+0000 7f4bfb7fe700 1 -- 172.21.15.12:0/3817228228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c0043b0 con 0x7f4c14160880 2023-07-07T18:15:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.977+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c140b6480 con 0x7f4c14160880 2023-07-07T18:15:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.977+0000 7f4bfb7fe700 1 -- 172.21.15.12:0/3817228228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c004760 con 0x7f4c14160880 2023-07-07T18:15:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.977+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c140c7520 con 0x7f4c14160880 2023-07-07T18:15:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.978+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c140c8120 con 0x7f4c14160880 2023-07-07T18:15:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.979+0000 7f4bfb7fe700 1 -- 172.21.15.12:0/3817228228 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c0c01c440 con 0x7f4c14160880 2023-07-07T18:15:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.979+0000 7f4bfb7fe700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c0006ace0 0x7f4c0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:35.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.979+0000 7f4bfb7fe700 1 -- 172.21.15.12:0/3817228228 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4c0c08acb0 con 0x7f4c14160880 2023-07-07T18:15:35.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.979+0000 7f4c12ffd700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c0006ace0 0x7f4c0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:35.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.980+0000 7f4c12ffd700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c0006ace0 0x7f4c0006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c04006fd0 tx=0x7f4c04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:35.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:35.984+0000 7f4bfb7fe700 1 -- 172.21.15.12:0/3817228228 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4c140c8120 con 0x7f4c14160880 2023-07-07T18:15:36.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.184+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c140b66c0 con 0x7f4c14160880 2023-07-07T18:15:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.185+0000 7f4bfb7fe700 1 -- 172.21.15.12:0/3817228228 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f4c140b66c0 con 0x7f4c14160880 2023-07-07T18:15:36.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:36.188 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c0006ace0 msgr2=0x7f4c0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c0006ace0 0x7f4c0006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4c04006fd0 tx=0x7f4c04008040 comp rx=0 tx=0).stop 2023-07-07T18:15:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 msgr2=0x7f4c140c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 0x7f4c140c85a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4c140d0170 tx=0x7f4c0c004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 shutdown_connections 2023-07-07T18:15:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c0006ace0 0x7f4c0006d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c14160880 0x7f4c140c85a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c140cd660 0x7f4c14151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 --2- 172.21.15.12:0/3817228228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c1415c570 0x7f4c140c6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 >> 172.21.15.12:0/3817228228 conn(0x7f4c14071620 msgr2=0x7f4c1415e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 shutdown_connections 2023-07-07T18:15:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.188+0000 7f4c196a0700 1 -- 172.21.15.12:0/3817228228 wait complete. 2023-07-07T18:15:36.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:36.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:36.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.328+0000 7f898831d700 1 Processor -- start 2023-07-07T18:15:36.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.328+0000 7f898831d700 1 -- start start 2023-07-07T18:15:36.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.329+0000 7f898831d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898006e4d0 0x7f89800ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.329+0000 7f898831d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898006f0e0 con 0x7f89800cd5e0 2023-07-07T18:15:36.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.329+0000 7f898831d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898006eb20 con 0x7f898006e030 2023-07-07T18:15:36.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.329+0000 7f898831d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89800ce2c0 con 0x7f898006e4d0 2023-07-07T18:15:36.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.329+0000 7f89860b9700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f89800cd5e0 0x7f89800cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55430/0 (socket says 172.21.15.12:55430) 2023-07-07T18:15:36.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.329+0000 7f89860b9700 1 -- 172.21.15.12:0/3389449807 learned_addr learned my addr 172.21.15.12:0/3389449807 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:36.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89868ba700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898006e4d0 0x7f89800ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449282621 0 0) 0x7f898006f0e0 con 0x7f89800cd5e0 2023-07-07T18:15:36.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f896c0035b0 con 0x7f89800cd5e0 2023-07-07T18:15:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1805017531 0 0) 0x7f896c0035b0 con 0x7f89800cd5e0 2023-07-07T18:15:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898006e4d0 msgr2=0x7f89800ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898006e4d0 0x7f89800ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 >> v1:172.21.15.160:6789/0 conn(0x7f898006e030 legacy=0x7f89800acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898006ee00 con 0x7f89800cd5e0 2023-07-07T18:15:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f8978001b70 con 0x7f89800cd5e0 2023-07-07T18:15:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 >> v1:172.21.15.12:6789/0 conn(0x7f89800cd5e0 legacy=0x7f89800cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898006e4d0 0x7f896c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f896c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f896c004d90 0x7f896c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89800ce2c0 con 0x7f896c003fb0 2023-07-07T18:15:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c00bba0 con 0x7f896c004d90 2023-07-07T18:15:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c00bd60 con 0x7f898006e4d0 2023-07-07T18:15:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89858b8700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f896c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89860b9700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898006e4d0 0x7f896c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.330+0000 7f89868ba700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f896c004d90 0x7f896c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89858b8700 1 -- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898006e4d0 msgr2=0x7f896c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:36.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89858b8700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898006e4d0 0x7f896c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89858b8700 1 -- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f896c004d90 msgr2=0x7f896c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:36.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89858b8700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f896c004d90 0x7f896c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89858b8700 1 -- 172.21.15.12:0/3389449807 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0035b0 con 0x7f896c003fb0 2023-07-07T18:15:36.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89858b8700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f896c004850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8970007fd0 tx=0x7f896c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c033550dd4009e server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:36.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700012f0 con 0x7f896c003fb0 2023-07-07T18:15:36.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89700052f0 con 0x7f896c003fb0 2023-07-07T18:15:36.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89850b7700 1 -- 172.21.15.12:0/3389449807 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8970006860 con 0x7f896c003fb0 2023-07-07T18:15:36.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f898831d700 1 -- 172.21.15.12:0/3389449807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 msgr2=0x7f896c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f898831d700 1 --2- 172.21.15.12:0/3389449807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f896c004850 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8970007fd0 tx=0x7f896c005880 comp rx=0 tx=0).stop 2023-07-07T18:15:36.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.331+0000 7f89868ba700 1 -- 172.21.15.12:0/3389449807 reap_dead start 2023-07-07T18:15:36.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.332+0000 7f898831d700 1 -- 172.21.15.12:0/3389449807 shutdown_connections 2023-07-07T18:15:36.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.332+0000 7f898831d700 1 -- 172.21.15.12:0/3389449807 >> 172.21.15.12:0/3389449807 conn(0x7f898006b920 msgr2=0x7f89800cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.332+0000 7f898831d700 1 -- 172.21.15.12:0/3389449807 shutdown_connections 2023-07-07T18:15:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.332+0000 7f898831d700 1 -- 172.21.15.12:0/3389449807 wait complete. 2023-07-07T18:15:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.333+0000 7f898831d700 1 Processor -- start 2023-07-07T18:15:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.333+0000 7f898831d700 1 -- start start 2023-07-07T18:15:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f898831d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f89800b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f898831d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89801f23b0 0x7f89801e2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f898831d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8980150b40 0x7f8980150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f898831d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89801514f0 con 0x7f896c003fb0 2023-07-07T18:15:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f898831d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89801f2c50 con 0x7f8980150b40 2023-07-07T18:15:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f898831d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89801f2f30 con 0x7f89801f23b0 2023-07-07T18:15:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89860b9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f89800b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89860b9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f89800b51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58244/0 (socket says 172.21.15.12:58244) 2023-07-07T18:15:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89860b9700 1 -- 172.21.15.12:0/414230134 learned_addr learned my addr 172.21.15.12:0/414230134 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89858b8700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89801f23b0 0x7f89801e2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89868ba700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8980150b40 0x7f8980150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89860b9700 1 -- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89801f23b0 msgr2=0x7f89801e2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89860b9700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89801f23b0 0x7f89801e2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89860b9700 1 -- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8980150b40 msgr2=0x7f8980150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89860b9700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8980150b40 0x7f8980150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89860b9700 1 -- 172.21.15.12:0/414230134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89801f3210 con 0x7f896c003fb0 2023-07-07T18:15:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89868ba700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8980150b40 0x7f8980150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f89860b9700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f89800b51d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8978001b90 tx=0x7f897800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f8976ffd700 1 -- 172.21.15.12:0/414230134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978005bb0 con 0x7f896c003fb0 2023-07-07T18:15:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f8976ffd700 1 -- 172.21.15.12:0/414230134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8978005d10 con 0x7f896c003fb0 2023-07-07T18:15:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89801f3570 con 0x7f896c003fb0 2023-07-07T18:15:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f8976ffd700 1 -- 172.21.15.12:0/414230134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800dc60 con 0x7f896c003fb0 2023-07-07T18:15:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.334+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89801e3190 con 0x7f896c003fb0 2023-07-07T18:15:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.335+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89801f3a90 con 0x7f896c003fb0 2023-07-07T18:15:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.336+0000 7f8976ffd700 1 -- 172.21.15.12:0/414230134 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f89780070d0 con 0x7f896c003fb0 2023-07-07T18:15:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.336+0000 7f8976ffd700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f896406ace0 0x7f896406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.336+0000 7f8976ffd700 1 -- 172.21.15.12:0/414230134 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8978089b10 con 0x7f896c003fb0 2023-07-07T18:15:36.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.336+0000 7f89858b8700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f896406ace0 0x7f896406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.337+0000 7f89858b8700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f896406ace0 0x7f896406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f89800af220 tx=0x7f8970011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:36.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.341+0000 7f8976ffd700 1 -- 172.21.15.12:0/414230134 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89801f3a90 con 0x7f896c003fb0 2023-07-07T18:15:36.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.536+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89801f3a90 con 0x7f896c003fb0 2023-07-07T18:15:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.536+0000 7f8976ffd700 1 -- 172.21.15.12:0/414230134 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89801f3a90 con 0x7f896c003fb0 2023-07-07T18:15:36.538 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:36.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f896406ace0 msgr2=0x7f896406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f896406ace0 0x7f896406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f89800af220 tx=0x7f8970011000 comp rx=0 tx=0).stop 2023-07-07T18:15:36.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 msgr2=0x7f89800b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f89800b51d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8978001b90 tx=0x7f897800d430 comp rx=0 tx=0).stop 2023-07-07T18:15:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 shutdown_connections 2023-07-07T18:15:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f896406ace0 0x7f896406d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8980150b40 0x7f8980150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f896c003fb0 0x7f89800b51d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 --2- 172.21.15.12:0/414230134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89801f23b0 0x7f89801e2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 >> 172.21.15.12:0/414230134 conn(0x7f898006b920 msgr2=0x7f89801583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 shutdown_connections 2023-07-07T18:15:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.538+0000 7f898831d700 1 -- 172.21.15.12:0/414230134 wait complete. 2023-07-07T18:15:36.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:36.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.678+0000 7f81f0732700 1 Processor -- start 2023-07-07T18:15:36.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.678+0000 7f81f0732700 1 -- start start 2023-07-07T18:15:36.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81f0732700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f81e80d0a60 0x7f81e80b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81f0732700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80b51d0 0x7f81e80cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81f0732700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f81e80d0e30 0x7f81e80d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81f0732700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e80d0060 con 0x7f81e80d0a60 2023-07-07T18:15:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81f0732700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e80cfe50 con 0x7f81e80d0e30 2023-07-07T18:15:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81f0732700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80cd9d0 con 0x7f81e80b51d0 2023-07-07T18:15:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ee4ce700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f81e80d0a60 0x7f81e80b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ee4ce700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f81e80d0a60 0x7f81e80b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58252/0 (socket says 172.21.15.12:58252) 2023-07-07T18:15:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ee4ce700 1 -- 172.21.15.12:0/3160917759 learned_addr learned my addr 172.21.15.12:0/3160917759 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81edccd700 1 --2- 172.21.15.12:0/3160917759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80b51d0 0x7f81e80cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81eeccf700 1 --2- 172.21.15.12:0/3160917759 >> v2:172.21.15.160:3300/0 conn(0x7f81e80d0e30 0x7f81e80d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ee4ce700 1 -- 172.21.15.12:0/3160917759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80b51d0 msgr2=0x7f81e80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ee4ce700 1 --2- 172.21.15.12:0/3160917759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80b51d0 0x7f81e80cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ee4ce700 1 -- 172.21.15.12:0/3160917759 >> v2:172.21.15.160:3300/0 conn(0x7f81e80d0e30 msgr2=0x7f81e80d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ee4ce700 1 --2- 172.21.15.12:0/3160917759 >> v2:172.21.15.160:3300/0 conn(0x7f81e80d0e30 0x7f81e80d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ee4ce700 1 -- 172.21.15.12:0/3160917759 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e80b5620 con 0x7f81e80d0a60 2023-07-07T18:15:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ee4ce700 1 --2- 172.21.15.12:0/3160917759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80d0a60 0x7f81e80b5a70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f81e80b24d0 tx=0x7f81e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfac9e1ebd07376 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.679+0000 7f81ed4cc700 1 -- 172.21.15.12:0/3160917759 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400b870 con 0x7f81e80d0a60 2023-07-07T18:15:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81ed4cc700 1 -- 172.21.15.12:0/3160917759 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e400b9d0 con 0x7f81e80d0a60 2023-07-07T18:15:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81ed4cc700 1 -- 172.21.15.12:0/3160917759 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e400bd60 con 0x7f81e80d0a60 2023-07-07T18:15:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81f0732700 1 -- 172.21.15.12:0/3160917759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80d0a60 msgr2=0x7f81e80b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81f0732700 1 --2- 172.21.15.12:0/3160917759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80d0a60 0x7f81e80b5a70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f81e80b24d0 tx=0x7f81e4009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81f0732700 1 -- 172.21.15.12:0/3160917759 shutdown_connections 2023-07-07T18:15:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81f0732700 1 --2- 172.21.15.12:0/3160917759 >> v2:172.21.15.160:3300/0 conn(0x7f81e80d0e30 0x7f81e80d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81f0732700 1 --2- 172.21.15.12:0/3160917759 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80d0a60 0x7f81e80b5a70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81f0732700 1 --2- 172.21.15.12:0/3160917759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80b51d0 0x7f81e80cf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81f0732700 1 -- 172.21.15.12:0/3160917759 >> 172.21.15.12:0/3160917759 conn(0x7f81e8071620 msgr2=0x7f81e80719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81f0732700 1 -- 172.21.15.12:0/3160917759 shutdown_connections 2023-07-07T18:15:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.680+0000 7f81f0732700 1 -- 172.21.15.12:0/3160917759 wait complete. 2023-07-07T18:15:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.681+0000 7f81f0732700 1 Processor -- start 2023-07-07T18:15:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.681+0000 7f81f0732700 1 -- start start 2023-07-07T18:15:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.682+0000 7f81f0732700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80b51d0 0x7f81e81f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.682+0000 7f81f0732700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81e80d0a60 0x7f81e80cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.682+0000 7f81f0732700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80d0e30 0x7f81e80cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.682+0000 7f81f0732700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81f3190 con 0x7f81e80b51d0 2023-07-07T18:15:36.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.682+0000 7f81f0732700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81f2860 con 0x7f81e80d0a60 2023-07-07T18:15:36.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.682+0000 7f81f0732700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81f2b40 con 0x7f81e80d0e30 2023-07-07T18:15:36.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.682+0000 7f81ee4ce700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80b51d0 0x7f81e81f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81ee4ce700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80b51d0 0x7f81e81f1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58258/0 (socket says 172.21.15.12:58258) 2023-07-07T18:15:36.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81ee4ce700 1 -- 172.21.15.12:0/2978812283 learned_addr learned my addr 172.21.15.12:0/2978812283 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81edccd700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81e80d0a60 0x7f81e80cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81eeccf700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80d0e30 0x7f81e80cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81ee4ce700 1 -- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80d0e30 msgr2=0x7f81e80cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81ee4ce700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80d0e30 0x7f81e80cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81ee4ce700 1 -- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81e80d0a60 msgr2=0x7f81e80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81ee4ce700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81e80d0a60 0x7f81e80cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81ee4ce700 1 -- 172.21.15.12:0/2978812283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4009550 con 0x7f81e80b51d0 2023-07-07T18:15:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81ee4ce700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80b51d0 0x7f81e81f1ed0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f81e4000c00 tx=0x7f81e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:36.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81deffd700 1 -- 172.21.15.12:0/2978812283 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4004480 con 0x7f81e80b51d0 2023-07-07T18:15:36.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81deffd700 1 -- 172.21.15.12:0/2978812283 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e40045e0 con 0x7f81e80b51d0 2023-07-07T18:15:36.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e81f2e20 con 0x7f81e80b51d0 2023-07-07T18:15:36.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81deffd700 1 -- 172.21.15.12:0/2978812283 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e40038e0 con 0x7f81e80b51d0 2023-07-07T18:15:36.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.683+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e8156db0 con 0x7f81e80b51d0 2023-07-07T18:15:36.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.684+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e81f3470 con 0x7f81e80b51d0 2023-07-07T18:15:36.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.685+0000 7f81deffd700 1 -- 172.21.15.12:0/2978812283 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f81e4021070 con 0x7f81e80b51d0 2023-07-07T18:15:36.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.685+0000 7f81deffd700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f81cc06ace0 0x7f81cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:36.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.685+0000 7f81deffd700 1 -- 172.21.15.12:0/2978812283 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f81e408ae60 con 0x7f81e80b51d0 2023-07-07T18:15:36.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.685+0000 7f81edccd700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f81cc06ace0 0x7f81cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:36.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.686+0000 7f81edccd700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f81cc06ace0 0x7f81cc06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f81e8156500 tx=0x7f81d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:36.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.690+0000 7f81deffd700 1 -- 172.21.15.12:0/2978812283 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f81e4055d90 con 0x7f81e80b51d0 2023-07-07T18:15:36.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.888+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f81e804ea20 con 0x7f81e80b51d0 2023-07-07T18:15:36.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.888+0000 7f81deffd700 1 -- 172.21.15.12:0/2978812283 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81e40150a0 con 0x7f81e80b51d0 2023-07-07T18:15:36.891 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:36.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f81cc06ace0 msgr2=0x7f81cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f81cc06ace0 0x7f81cc06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f81e8156500 tx=0x7f81d8008040 comp rx=0 tx=0).stop 2023-07-07T18:15:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80b51d0 msgr2=0x7f81e81f1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80b51d0 0x7f81e81f1ed0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f81e4000c00 tx=0x7f81e4004750 comp rx=0 tx=0).stop 2023-07-07T18:15:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 shutdown_connections 2023-07-07T18:15:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f81cc06ace0 0x7f81cc06d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f81e80d0e30 0x7f81e80cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e80b51d0 0x7f81e81f1ed0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 --2- 172.21.15.12:0/2978812283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81e80d0a60 0x7f81e80cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:36.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.890+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 >> 172.21.15.12:0/2978812283 conn(0x7f81e8071620 msgr2=0x7f81e80cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:36.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.891+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 shutdown_connections 2023-07-07T18:15:36.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:36.891+0000 7f81f0732700 1 -- 172.21.15.12:0/2978812283 wait complete. 2023-07-07T18:15:36.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:37.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.031+0000 7f2525ba6700 1 Processor -- start 2023-07-07T18:15:37.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.031+0000 7f2525ba6700 1 -- start start 2023-07-07T18:15:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f2525ba6700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f252006e030 0x7f252006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f2525ba6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25200acf30 0x7f25200ad390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f2525ba6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252006f0e0 con 0x7f25200cd5e0 2023-07-07T18:15:37.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f2525ba6700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25200ce2c0 con 0x7f252006e030 2023-07-07T18:15:37.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f2525ba6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252006eb20 con 0x7f25200acf30 2023-07-07T18:15:37.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251effd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f252006e030 0x7f252006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251ffff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25200acf30 0x7f25200ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251effd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f252006e030 0x7f252006e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:53874/0 (socket says 172.21.15.12:53874) 2023-07-07T18:15:37.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251f7fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f25200cd5e0 0x7f25200cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:48704/0 (socket says 172.21.15.12:48704) 2023-07-07T18:15:37.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251effd700 1 -- 172.21.15.12:0/526194120 learned_addr learned my addr 172.21.15.12:0/526194120 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:37.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251ffff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25200acf30 0x7f25200ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:47360/0 (socket says 172.21.15.12:47360) 2023-07-07T18:15:37.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251effd700 1 -- 172.21.15.12:0/526194120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25200acf30 msgr2=0x7f25200ad390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:37.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251effd700 1 --2- 172.21.15.12:0/526194120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25200acf30 0x7f25200ad390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251effd700 1 -- 172.21.15.12:0/526194120 >> v1:172.21.15.160:6789/0 conn(0x7f25200cd5e0 legacy=0x7f25200cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.032+0000 7f251effd700 1 -- 172.21.15.12:0/526194120 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252006ee00 con 0x7f252006e030 2023-07-07T18:15:37.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f251effd700 1 --2- 172.21.15.12:0/526194120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f252006e030 0x7f252006e4d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f25100098f0 tx=0x7f2510009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ba10488a1e7667 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f251e7fc700 1 -- 172.21.15.12:0/526194120 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251000f8a0 con 0x7f252006e030 2023-07-07T18:15:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f251e7fc700 1 -- 172.21.15.12:0/526194120 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251000fa00 con 0x7f252006e030 2023-07-07T18:15:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f251e7fc700 1 -- 172.21.15.12:0/526194120 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251000fd90 con 0x7f252006e030 2023-07-07T18:15:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f2525ba6700 1 -- 172.21.15.12:0/526194120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f252006e030 msgr2=0x7f252006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f2525ba6700 1 --2- 172.21.15.12:0/526194120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f252006e030 0x7f252006e4d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f25100098f0 tx=0x7f2510009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f2525ba6700 1 -- 172.21.15.12:0/526194120 shutdown_connections 2023-07-07T18:15:37.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f2525ba6700 1 --2- 172.21.15.12:0/526194120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25200acf30 0x7f25200ad390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f2525ba6700 1 --2- 172.21.15.12:0/526194120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f252006e030 0x7f252006e4d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f2525ba6700 1 -- 172.21.15.12:0/526194120 >> 172.21.15.12:0/526194120 conn(0x7f252006b920 msgr2=0x7f25200cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f2525ba6700 1 -- 172.21.15.12:0/526194120 shutdown_connections 2023-07-07T18:15:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.033+0000 7f2525ba6700 1 -- 172.21.15.12:0/526194120 wait complete. 2023-07-07T18:15:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.035+0000 7f2525ba6700 1 Processor -- start 2023-07-07T18:15:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.035+0000 7f2525ba6700 1 -- start start 2023-07-07T18:15:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.035+0000 7f2525ba6700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f252006e030 0x7f2520152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2525ba6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25200acf30 0x7f25200c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2525ba6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25200cd5e0 0x7f25201558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2525ba6700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2520152d60 con 0x7f25200acf30 2023-07-07T18:15:37.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2525ba6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c3b90 con 0x7f25200cd5e0 2023-07-07T18:15:37.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2525ba6700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25200c3e70 con 0x7f252006e030 2023-07-07T18:15:37.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25200acf30 0x7f25200c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25200acf30 0x7f25200c3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58274/0 (socket says 172.21.15.12:58274) 2023-07-07T18:15:37.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251effd700 1 -- 172.21.15.12:0/3917282168 learned_addr learned my addr 172.21.15.12:0/3917282168 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:37.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251f7fe700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f252006e030 0x7f2520152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251ffff700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25200cd5e0 0x7f25201558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251effd700 1 -- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f252006e030 msgr2=0x7f2520152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251effd700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f252006e030 0x7f2520152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251effd700 1 -- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25200cd5e0 msgr2=0x7f25201558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251effd700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25200cd5e0 0x7f25201558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251effd700 1 -- 172.21.15.12:0/3917282168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2510009550 con 0x7f25200acf30 2023-07-07T18:15:37.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f251effd700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25200acf30 0x7f25200c3290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2510000c00 tx=0x7f2510004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:37.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2507fff700 1 -- 172.21.15.12:0/3917282168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251001e070 con 0x7f25200acf30 2023-07-07T18:15:37.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2507fff700 1 -- 172.21.15.12:0/3917282168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25100036a0 con 0x7f25200acf30 2023-07-07T18:15:37.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25200c4150 con 0x7f25200acf30 2023-07-07T18:15:37.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2507fff700 1 -- 172.21.15.12:0/3917282168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510003a30 con 0x7f25200acf30 2023-07-07T18:15:37.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.036+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25201ee0c0 con 0x7f25200acf30 2023-07-07T18:15:37.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.037+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25200c4670 con 0x7f25200acf30 2023-07-07T18:15:37.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.038+0000 7f2507fff700 1 -- 172.21.15.12:0/3917282168 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2510003b90 con 0x7f25200acf30 2023-07-07T18:15:37.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.038+0000 7f2507fff700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f250c06ace0 0x7f250c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.038+0000 7f2507fff700 1 -- 172.21.15.12:0/3917282168 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f251008c3a0 con 0x7f25200acf30 2023-07-07T18:15:37.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.039+0000 7f251f7fe700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f250c06ace0 0x7f250c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.039+0000 7f251f7fe700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f250c06ace0 0x7f250c06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2514000fb0 tx=0x7f2514007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:37.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.043+0000 7f2507fff700 1 -- 172.21.15.12:0/3917282168 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f25100571b0 con 0x7f25200acf30 2023-07-07T18:15:37.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.239+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f252004ea20 con 0x7f25200acf30 2023-07-07T18:15:37.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.239+0000 7f2507fff700 1 -- 172.21.15.12:0/3917282168 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f251005a7d0 con 0x7f25200acf30 2023-07-07T18:15:37.242 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f250c06ace0 msgr2=0x7f250c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f250c06ace0 0x7f250c06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2514000fb0 tx=0x7f2514007ec0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25200acf30 msgr2=0x7f25200c3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25200acf30 0x7f25200c3290 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2510000c00 tx=0x7f2510004750 comp rx=0 tx=0).stop 2023-07-07T18:15:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 shutdown_connections 2023-07-07T18:15:37.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f250c06ace0 0x7f250c06d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25200cd5e0 0x7f25201558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f252006e030 0x7f2520152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 --2- 172.21.15.12:0/3917282168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25200acf30 0x7f25200c3290 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 >> 172.21.15.12:0/3917282168 conn(0x7f252006b920 msgr2=0x7f25200afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 shutdown_connections 2023-07-07T18:15:37.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.242+0000 7f2525ba6700 1 -- 172.21.15.12:0/3917282168 wait complete. 2023-07-07T18:15:37.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:37.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.382+0000 7fe564d79700 1 Processor -- start 2023-07-07T18:15:37.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.382+0000 7fe564d79700 1 -- start start 2023-07-07T18:15:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe564d79700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe5600cd330 0x7fe560070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe564d79700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe56015a330 0x7fe5600cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe564d79700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe5600afc40 0x7fe56015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe564d79700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5600caf70 con 0x7fe5600cd330 2023-07-07T18:15:37.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe564d79700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5600cdc40 con 0x7fe5600afc40 2023-07-07T18:15:37.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe564d79700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600cb210 con 0x7fe56015a330 2023-07-07T18:15:37.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe5600cd330 0x7fe560070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe5600cd330 0x7fe560070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58280/0 (socket says 172.21.15.12:58280) 2023-07-07T18:15:37.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55e59c700 1 -- 172.21.15.12:0/133855189 learned_addr learned my addr 172.21.15.12:0/133855189 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55dd9b700 1 --2- 172.21.15.12:0/133855189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe56015a330 0x7fe5600cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55ed9d700 1 --2- 172.21.15.12:0/133855189 >> v2:172.21.15.160:3300/0 conn(0x7fe5600afc40 0x7fe56015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55e59c700 1 -- 172.21.15.12:0/133855189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe56015a330 msgr2=0x7fe5600cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55e59c700 1 --2- 172.21.15.12:0/133855189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe56015a330 0x7fe5600cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55e59c700 1 -- 172.21.15.12:0/133855189 >> v2:172.21.15.160:3300/0 conn(0x7fe5600afc40 msgr2=0x7fe56015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55e59c700 1 --2- 172.21.15.12:0/133855189 >> v2:172.21.15.160:3300/0 conn(0x7fe5600afc40 0x7fe56015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55e59c700 1 -- 172.21.15.12:0/133855189 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5600ccc20 con 0x7fe5600cd330 2023-07-07T18:15:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55dd9b700 1 --2- 172.21.15.12:0/133855189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe56015a330 0x7fe5600cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.383+0000 7fe55e59c700 1 --2- 172.21.15.12:0/133855189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5600cd330 0x7fe560070980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe560071150 tx=0x7fe550009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ddc30202e7cf6a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe55d59a700 1 -- 172.21.15.12:0/133855189 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550011830 con 0x7fe5600cd330 2023-07-07T18:15:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe55d59a700 1 -- 172.21.15.12:0/133855189 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550011990 con 0x7fe5600cd330 2023-07-07T18:15:37.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe55d59a700 1 -- 172.21.15.12:0/133855189 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550011d20 con 0x7fe5600cd330 2023-07-07T18:15:37.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe564d79700 1 -- 172.21.15.12:0/133855189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5600cd330 msgr2=0x7fe560070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe564d79700 1 --2- 172.21.15.12:0/133855189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5600cd330 0x7fe560070980 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe560071150 tx=0x7fe550009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe564d79700 1 -- 172.21.15.12:0/133855189 shutdown_connections 2023-07-07T18:15:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe564d79700 1 --2- 172.21.15.12:0/133855189 >> v2:172.21.15.160:3300/0 conn(0x7fe5600afc40 0x7fe56015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe564d79700 1 --2- 172.21.15.12:0/133855189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5600cd330 0x7fe560070980 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe564d79700 1 --2- 172.21.15.12:0/133855189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe56015a330 0x7fe5600cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe564d79700 1 -- 172.21.15.12:0/133855189 >> 172.21.15.12:0/133855189 conn(0x7fe56006e5c0 msgr2=0x7fe56006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:37.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe564d79700 1 -- 172.21.15.12:0/133855189 shutdown_connections 2023-07-07T18:15:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.384+0000 7fe564d79700 1 -- 172.21.15.12:0/133855189 wait complete. 2023-07-07T18:15:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe564d79700 1 Processor -- start 2023-07-07T18:15:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe564d79700 1 -- start start 2023-07-07T18:15:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe564d79700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5600afc40 0x7fe560153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe564d79700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5600cd330 0x7fe5600c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe564d79700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe56015a330 0x7fe5600c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe564d79700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5601544c0 con 0x7fe56015a330 2023-07-07T18:15:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe564d79700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600c86b0 con 0x7fe5600cd330 2023-07-07T18:15:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe564d79700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5600c8990 con 0x7fe5600afc40 2023-07-07T18:15:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe55ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe56015a330 0x7fe5600c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe55ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe56015a330 0x7fe5600c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58288/0 (socket says 172.21.15.12:58288) 2023-07-07T18:15:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.386+0000 7fe55ed9d700 1 -- 172.21.15.12:0/1408252886 learned_addr learned my addr 172.21.15.12:0/1408252886 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe55e59c700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5600afc40 0x7fe560153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe55dd9b700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5600cd330 0x7fe5600c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe55ed9d700 1 -- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5600afc40 msgr2=0x7fe560153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe55ed9d700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5600afc40 0x7fe560153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe55ed9d700 1 -- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5600cd330 msgr2=0x7fe5600c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe55ed9d700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5600cd330 0x7fe5600c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe55ed9d700 1 -- 172.21.15.12:0/1408252886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe550009550 con 0x7fe56015a330 2023-07-07T18:15:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe55dd9b700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5600cd330 0x7fe5600c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe55ed9d700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe56015a330 0x7fe5600c6b40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe55800efc0 tx=0x7fe55800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:37.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe54effd700 1 -- 172.21.15.12:0/1408252886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558009ea0 con 0x7fe56015a330 2023-07-07T18:15:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe54effd700 1 -- 172.21.15.12:0/1408252886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55800f040 con 0x7fe56015a330 2023-07-07T18:15:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5600c8c70 con 0x7fe56015a330 2023-07-07T18:15:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe54effd700 1 -- 172.21.15.12:0/1408252886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558014480 con 0x7fe56015a330 2023-07-07T18:15:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.387+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5600c9230 con 0x7fe56015a330 2023-07-07T18:15:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.388+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5600c9450 con 0x7fe56015a330 2023-07-07T18:15:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.388+0000 7fe54effd700 1 -- 172.21.15.12:0/1408252886 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5580145e0 con 0x7fe56015a330 2023-07-07T18:15:37.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.389+0000 7fe54effd700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe54006ace0 0x7fe54006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.389+0000 7fe54effd700 1 -- 172.21.15.12:0/1408252886 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe558089ff0 con 0x7fe56015a330 2023-07-07T18:15:37.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.389+0000 7fe55e59c700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe54006ace0 0x7fe54006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.390+0000 7fe55e59c700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe54006ace0 0x7fe54006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe550009c10 tx=0x7fe550008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:37.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.393+0000 7fe54effd700 1 -- 172.21.15.12:0/1408252886 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe558054d70 con 0x7fe56015a330 2023-07-07T18:15:37.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.590+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe56004ea20 con 0x7fe56015a330 2023-07-07T18:15:37.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.590+0000 7fe54effd700 1 -- 172.21.15.12:0/1408252886 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe558058390 con 0x7fe56015a330 2023-07-07T18:15:37.593 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:37.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.592+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe54006ace0 msgr2=0x7fe54006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.592+0000 7fe564d79700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe54006ace0 0x7fe54006d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe550009c10 tx=0x7fe550008030 comp rx=0 tx=0).stop 2023-07-07T18:15:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.592+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe56015a330 msgr2=0x7fe5600c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.592+0000 7fe564d79700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe56015a330 0x7fe5600c6b40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe55800efc0 tx=0x7fe55800c3a0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.593+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 shutdown_connections 2023-07-07T18:15:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.593+0000 7fe564d79700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe54006ace0 0x7fe54006d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.593+0000 7fe564d79700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe56015a330 0x7fe5600c6b40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.593+0000 7fe564d79700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5600afc40 0x7fe560153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.593+0000 7fe564d79700 1 --2- 172.21.15.12:0/1408252886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5600cd330 0x7fe5600c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.593+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 >> 172.21.15.12:0/1408252886 conn(0x7fe56006e5c0 msgr2=0x7fe5600b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.593+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 shutdown_connections 2023-07-07T18:15:37.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.593+0000 7fe564d79700 1 -- 172.21.15.12:0/1408252886 wait complete. 2023-07-07T18:15:37.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:37.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.732+0000 7f8d062ac700 1 Processor -- start 2023-07-07T18:15:37.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.732+0000 7f8d062ac700 1 -- start start 2023-07-07T18:15:37.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8d062ac700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d0006e970 0x7f8d0006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8d062ac700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d000ce620 con 0x7f8d0015fc60 2023-07-07T18:15:37.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8d062ac700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d00160580 con 0x7f8d000aecc0 2023-07-07T18:15:37.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8d062ac700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d00160860 con 0x7f8d0006e970 2023-07-07T18:15:37.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8d04849700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d0006e970 0x7f8d0006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8cfffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8d0015fc60 0x7f8d0006e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55490/0 (socket says 172.21.15.12:55490) 2023-07-07T18:15:37.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8cfffff700 1 -- 172.21.15.12:0/4219693086 learned_addr learned my addr 172.21.15.12:0/4219693086 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:37.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8d04849700 1 -- 172.21.15.12:0/4219693086 >> v1:172.21.15.160:6789/0 conn(0x7f8d000aecc0 legacy=0x7f8d000cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:37.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8d04849700 1 -- 172.21.15.12:0/4219693086 >> v1:172.21.15.12:6789/0 conn(0x7f8d0015fc60 legacy=0x7f8d0006e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8d04849700 1 -- 172.21.15.12:0/4219693086 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00160b40 con 0x7f8d0006e970 2023-07-07T18:15:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.733+0000 7f8d04849700 1 --2- 172.21.15.12:0/4219693086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0006e970 0x7f8d0006a900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009d90 tx=0x7f8cf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5a8edc954add2b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8cfeffd700 1 -- 172.21.15.12:0/4219693086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800e070 con 0x7f8d0006e970 2023-07-07T18:15:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8cfeffd700 1 -- 172.21.15.12:0/4219693086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf800bb90 con 0x7f8d0006e970 2023-07-07T18:15:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8cfeffd700 1 -- 172.21.15.12:0/4219693086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8003a20 con 0x7f8d0006e970 2023-07-07T18:15:37.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8d062ac700 1 -- 172.21.15.12:0/4219693086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0006e970 msgr2=0x7f8d0006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8d062ac700 1 --2- 172.21.15.12:0/4219693086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0006e970 0x7f8d0006a900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009d90 tx=0x7f8cf800b330 comp rx=0 tx=0).stop 2023-07-07T18:15:37.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8d062ac700 1 -- 172.21.15.12:0/4219693086 shutdown_connections 2023-07-07T18:15:37.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8d062ac700 1 --2- 172.21.15.12:0/4219693086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0006e970 0x7f8d0006a900 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8d062ac700 1 -- 172.21.15.12:0/4219693086 >> 172.21.15.12:0/4219693086 conn(0x7f8d0006b920 msgr2=0x7f8d000cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:37.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8d062ac700 1 -- 172.21.15.12:0/4219693086 shutdown_connections 2023-07-07T18:15:37.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.734+0000 7f8d062ac700 1 -- 172.21.15.12:0/4219693086 wait complete. 2023-07-07T18:15:37.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.735+0000 7f8d062ac700 1 Processor -- start 2023-07-07T18:15:37.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d062ac700 1 -- start start 2023-07-07T18:15:37.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d062ac700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d0006e970 0x7f8d001e6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d062ac700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d000aecc0 0x7f8d000c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d062ac700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0015fc60 0x7f8d000c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d062ac700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0015a960 con 0x7f8d0015fc60 2023-07-07T18:15:37.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d062ac700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0015a680 con 0x7f8d000aecc0 2023-07-07T18:15:37.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d062ac700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000b2950 con 0x7f8d0006e970 2023-07-07T18:15:37.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d04849700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0015fc60 0x7f8d000c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d04849700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0015fc60 0x7f8d000c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58300/0 (socket says 172.21.15.12:58300) 2023-07-07T18:15:37.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.736+0000 7f8d04849700 1 -- 172.21.15.12:0/1072722865 learned_addr learned my addr 172.21.15.12:0/1072722865 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:37.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8cfffff700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d0006e970 0x7f8d001e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8cff7fe700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d000aecc0 0x7f8d000c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8d04849700 1 -- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d0006e970 msgr2=0x7f8d001e6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8d04849700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d0006e970 0x7f8d001e6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8d04849700 1 -- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d000aecc0 msgr2=0x7f8d000c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8d04849700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d000aecc0 0x7f8d000c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8d04849700 1 -- 172.21.15.12:0/1072722865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf8009a70 con 0x7f8d0015fc60 2023-07-07T18:15:37.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8d04849700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0015fc60 0x7f8d000c9580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8004000 tx=0x7f8cf8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:37.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8cfcff9700 1 -- 172.21.15.12:0/1072722865 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8012630 con 0x7f8d0015fc60 2023-07-07T18:15:37.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8cfcff9700 1 -- 172.21.15.12:0/1072722865 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80127b0 con 0x7f8d0015fc60 2023-07-07T18:15:37.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8cfcff9700 1 -- 172.21.15.12:0/1072722865 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8012b60 con 0x7f8d0015fc60 2023-07-07T18:15:37.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d000b2c30 con 0x7f8d0015fc60 2023-07-07T18:15:37.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.737+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d001e66c0 con 0x7f8d0015fc60 2023-07-07T18:15:37.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.738+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d001e6880 con 0x7f8d0015fc60 2023-07-07T18:15:37.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.739+0000 7f8cfcff9700 1 -- 172.21.15.12:0/1072722865 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cf8012cc0 con 0x7f8d0015fc60 2023-07-07T18:15:37.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.739+0000 7f8cfcff9700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8ce006ace0 0x7f8ce006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:37.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.739+0000 7f8cfcff9700 1 -- 172.21.15.12:0/1072722865 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8cf808bdb0 con 0x7f8d0015fc60 2023-07-07T18:15:37.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.739+0000 7f8cfffff700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8ce006ace0 0x7f8ce006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:37.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.740+0000 7f8cfffff700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8ce006ace0 0x7f8ce006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80010e0 tx=0x7f8ce8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:37.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.744+0000 7f8cfcff9700 1 -- 172.21.15.12:0/1072722865 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8cf8056bc0 con 0x7f8d0015fc60 2023-07-07T18:15:37.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.943+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8d0004ea20 con 0x7f8d0015fc60 2023-07-07T18:15:37.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.943+0000 7f8cfcff9700 1 -- 172.21.15.12:0/1072722865 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8cf805a1e0 con 0x7f8d0015fc60 2023-07-07T18:15:37.945 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8ce006ace0 msgr2=0x7f8ce006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8ce006ace0 0x7f8ce006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80010e0 tx=0x7f8ce8009040 comp rx=0 tx=0).stop 2023-07-07T18:15:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0015fc60 msgr2=0x7f8d000c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0015fc60 0x7f8d000c9580 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8004000 tx=0x7f8cf8004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 shutdown_connections 2023-07-07T18:15:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8ce006ace0 0x7f8ce006d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d0015fc60 0x7f8d000c9580 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d0006e970 0x7f8d001e6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 --2- 172.21.15.12:0/1072722865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d000aecc0 0x7f8d000c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 >> 172.21.15.12:0/1072722865 conn(0x7f8d0006b920 msgr2=0x7f8d0006a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 shutdown_connections 2023-07-07T18:15:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:37.945+0000 7f8d062ac700 1 -- 172.21.15.12:0/1072722865 wait complete. 2023-07-07T18:15:37.959 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:38.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.082+0000 7efcf03b5700 1 Processor -- start 2023-07-07T18:15:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.082+0000 7efcf03b5700 1 -- start start 2023-07-07T18:15:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcf03b5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efce8069ef0 0x7efce806a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcf03b5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 0x7efce806a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcf03b5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce80cc9e0 con 0x7efce806eef0 2023-07-07T18:15:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcf03b5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce806ad40 con 0x7efce8069ef0 2023-07-07T18:15:38.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcf03b5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce80b5780 con 0x7efce806bab0 2023-07-07T18:15:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcee151700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efce8069ef0 0x7efce806a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcee952700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7efce806eef0 0x7efce806f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:48746/0 (socket says 172.21.15.12:48746) 2023-07-07T18:15:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcee952700 1 -- 172.21.15.12:0/1102114926 learned_addr learned my addr 172.21.15.12:0/1102114926 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efced950700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 0x7efce806a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efced14f700 1 -- 172.21.15.12:0/1102114926 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927875279 0 0) 0x7efce80cc9e0 con 0x7efce806eef0 2023-07-07T18:15:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efced14f700 1 -- 172.21.15.12:0/1102114926 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd40035b0 con 0x7efce806eef0 2023-07-07T18:15:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcee151700 1 -- 172.21.15.12:0/1102114926 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 msgr2=0x7efce806a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcee151700 1 --2- 172.21.15.12:0/1102114926 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 0x7efce806a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcee151700 1 -- 172.21.15.12:0/1102114926 >> v1:172.21.15.160:6789/0 conn(0x7efce806eef0 legacy=0x7efce806f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efcee151700 1 -- 172.21.15.12:0/1102114926 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce80c9f40 con 0x7efce8069ef0 2023-07-07T18:15:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.083+0000 7efced950700 1 --2- 172.21.15.12:0/1102114926 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 0x7efce806a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:38.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efcee151700 1 --2- 172.21.15.12:0/1102114926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce8069ef0 0x7efce806a2c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efce4009840 tx=0x7efce4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=642cbfb85b0c422f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efced14f700 1 -- 172.21.15.12:0/1102114926 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011830 con 0x7efce8069ef0 2023-07-07T18:15:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efced14f700 1 -- 172.21.15.12:0/1102114926 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4011990 con 0x7efce8069ef0 2023-07-07T18:15:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efced14f700 1 -- 172.21.15.12:0/1102114926 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011d20 con 0x7efce8069ef0 2023-07-07T18:15:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efcf03b5700 1 -- 172.21.15.12:0/1102114926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce8069ef0 msgr2=0x7efce806a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efcf03b5700 1 --2- 172.21.15.12:0/1102114926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce8069ef0 0x7efce806a2c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efce4009840 tx=0x7efce4009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efcf03b5700 1 -- 172.21.15.12:0/1102114926 shutdown_connections 2023-07-07T18:15:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efcf03b5700 1 --2- 172.21.15.12:0/1102114926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce8069ef0 0x7efce806a2c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efcf03b5700 1 --2- 172.21.15.12:0/1102114926 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 0x7efce806a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.084+0000 7efcf03b5700 1 -- 172.21.15.12:0/1102114926 >> 172.21.15.12:0/1102114926 conn(0x7efce806d4a0 msgr2=0x7efce806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.085+0000 7efcf03b5700 1 -- 172.21.15.12:0/1102114926 shutdown_connections 2023-07-07T18:15:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.085+0000 7efcf03b5700 1 -- 172.21.15.12:0/1102114926 wait complete. 2023-07-07T18:15:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.086+0000 7efcf03b5700 1 Processor -- start 2023-07-07T18:15:38.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.086+0000 7efcf03b5700 1 -- start start 2023-07-07T18:15:38.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.086+0000 7efcf03b5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efce8069ef0 0x7efce81f0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.086+0000 7efcf03b5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 0x7efce80afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.086+0000 7efcf03b5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce806eef0 0x7efce81eeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.086+0000 7efcf03b5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce81f3ba0 con 0x7efce8069ef0 2023-07-07T18:15:38.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.086+0000 7efcf03b5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce81f2cd0 con 0x7efce806eef0 2023-07-07T18:15:38.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.086+0000 7efcf03b5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce81f06c0 con 0x7efce806bab0 2023-07-07T18:15:38.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee151700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efce8069ef0 0x7efce81f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee151700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efce8069ef0 0x7efce81f0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58310/0 (socket says 172.21.15.12:58310) 2023-07-07T18:15:38.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee151700 1 -- 172.21.15.12:0/2577263811 learned_addr learned my addr 172.21.15.12:0/2577263811 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:38.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efced950700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 0x7efce80afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee952700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce806eef0 0x7efce81eeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee151700 1 -- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 msgr2=0x7efce80afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee151700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 0x7efce80afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee151700 1 -- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce806eef0 msgr2=0x7efce81eeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee151700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce806eef0 0x7efce81eeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee151700 1 -- 172.21.15.12:0/2577263811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80094a0 con 0x7efce8069ef0 2023-07-07T18:15:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcee151700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efce8069ef0 0x7efce81f0180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efce4009fd0 tx=0x7efce4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:38.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcdeffd700 1 -- 172.21.15.12:0/2577263811 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce40036a0 con 0x7efce8069ef0 2023-07-07T18:15:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcdeffd700 1 -- 172.21.15.12:0/2577263811 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce401e070 con 0x7efce8069ef0 2023-07-07T18:15:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce40094a0 con 0x7efce8069ef0 2023-07-07T18:15:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcdeffd700 1 -- 172.21.15.12:0/2577263811 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4003a60 con 0x7efce8069ef0 2023-07-07T18:15:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.087+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce81f3200 con 0x7efce8069ef0 2023-07-07T18:15:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.088+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce80716f0 con 0x7efce8069ef0 2023-07-07T18:15:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.089+0000 7efcdeffd700 1 -- 172.21.15.12:0/2577263811 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efce4003bc0 con 0x7efce8069ef0 2023-07-07T18:15:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.089+0000 7efcdeffd700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efccc06ace0 0x7efccc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.089+0000 7efcdeffd700 1 -- 172.21.15.12:0/2577263811 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efce408a610 con 0x7efce8069ef0 2023-07-07T18:15:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.089+0000 7efced950700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efccc06ace0 0x7efccc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.090+0000 7efced950700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efccc06ace0 0x7efccc06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efce8158060 tx=0x7efcd8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:38.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.093+0000 7efcdeffd700 1 -- 172.21.15.12:0/2577263811 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efce4055420 con 0x7efce8069ef0 2023-07-07T18:15:38.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.294+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efce8073910 con 0x7efce8069ef0 2023-07-07T18:15:38.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.296+0000 7efcdeffd700 1 -- 172.21.15.12:0/2577263811 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7efce4058a40 con 0x7efce8069ef0 2023-07-07T18:15:38.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:38.298 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efccc06ace0 msgr2=0x7efccc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efccc06ace0 0x7efccc06d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efce8158060 tx=0x7efcd8009210 comp rx=0 tx=0).stop 2023-07-07T18:15:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efce8069ef0 msgr2=0x7efce81f0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efce8069ef0 0x7efce81f0180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efce4009fd0 tx=0x7efce4004750 comp rx=0 tx=0).stop 2023-07-07T18:15:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 shutdown_connections 2023-07-07T18:15:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efccc06ace0 0x7efccc06d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efce806eef0 0x7efce81eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efce8069ef0 0x7efce81f0180 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 --2- 172.21.15.12:0/2577263811 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efce806bab0 0x7efce80afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 >> 172.21.15.12:0/2577263811 conn(0x7efce806d4a0 msgr2=0x7efce806a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 shutdown_connections 2023-07-07T18:15:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.298+0000 7efcf03b5700 1 -- 172.21.15.12:0/2577263811 wait complete. 2023-07-07T18:15:38.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:38.313 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:38.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.438+0000 7f32a0e3e700 1 Processor -- start 2023-07-07T18:15:38.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.438+0000 7f32a0e3e700 1 -- start start 2023-07-07T18:15:38.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.439+0000 7f32a0e3e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f329c06e450 0x7f329c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.439+0000 7f32a0e3e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f329c15aa10 0x7f329c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.439+0000 7f32a0e3e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c15e080 con 0x7f329c158040 2023-07-07T18:15:38.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.439+0000 7f32a0e3e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c15ec90 con 0x7f329c06e450 2023-07-07T18:15:38.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.439+0000 7f32a0e3e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c06ee10 con 0x7f329c15aa10 2023-07-07T18:15:38.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.439+0000 7f3299d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f329c06e450 0x7f329c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.439+0000 7f3299d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f329c06e450 0x7f329c06e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58320/0 (socket says 172.21.15.12:58320) 2023-07-07T18:15:38.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.439+0000 7f329a59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f329c158040 0x7f329c0caed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55516/0 (socket says 172.21.15.12:55516) 2023-07-07T18:15:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.439+0000 7f3299d9b700 1 -- 172.21.15.12:0/1513906978 learned_addr learned my addr 172.21.15.12:0/1513906978 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f329ad9d700 1 --2- 172.21.15.12:0/1513906978 >> v2:172.21.15.160:3300/0 conn(0x7f329c15aa10 0x7f329c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f3299d9b700 1 -- 172.21.15.12:0/1513906978 >> v2:172.21.15.160:3300/0 conn(0x7f329c15aa10 msgr2=0x7f329c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f3299d9b700 1 --2- 172.21.15.12:0/1513906978 >> v2:172.21.15.160:3300/0 conn(0x7f329c15aa10 0x7f329c15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f3299d9b700 1 -- 172.21.15.12:0/1513906978 >> v1:172.21.15.12:6789/0 conn(0x7f329c158040 legacy=0x7f329c0caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f3299d9b700 1 -- 172.21.15.12:0/1513906978 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c158410 con 0x7f329c06e450 2023-07-07T18:15:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f329ad9d700 1 --2- 172.21.15.12:0/1513906978 >> v2:172.21.15.160:3300/0 conn(0x7f329c15aa10 0x7f329c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f3299d9b700 1 --2- 172.21.15.12:0/1513906978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c06e450 0x7f329c06e8d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f329c0cae60 tx=0x7f328c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f653f7f430dcd server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f329959a700 1 -- 172.21.15.12:0/1513906978 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c00b870 con 0x7f329c06e450 2023-07-07T18:15:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f329959a700 1 -- 172.21.15.12:0/1513906978 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c00b9d0 con 0x7f329c06e450 2023-07-07T18:15:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.440+0000 7f329959a700 1 -- 172.21.15.12:0/1513906978 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c00bd60 con 0x7f329c06e450 2023-07-07T18:15:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.441+0000 7f32a0e3e700 1 -- 172.21.15.12:0/1513906978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c06e450 msgr2=0x7f329c06e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.441+0000 7f32a0e3e700 1 --2- 172.21.15.12:0/1513906978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c06e450 0x7f329c06e8d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f329c0cae60 tx=0x7f328c009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.441+0000 7f32a0e3e700 1 -- 172.21.15.12:0/1513906978 shutdown_connections 2023-07-07T18:15:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.441+0000 7f32a0e3e700 1 --2- 172.21.15.12:0/1513906978 >> v2:172.21.15.160:3300/0 conn(0x7f329c15aa10 0x7f329c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.441+0000 7f32a0e3e700 1 --2- 172.21.15.12:0/1513906978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c06e450 0x7f329c06e8d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.441+0000 7f32a0e3e700 1 -- 172.21.15.12:0/1513906978 >> 172.21.15.12:0/1513906978 conn(0x7f329c0d0910 msgr2=0x7f329c0d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.441+0000 7f32a0e3e700 1 -- 172.21.15.12:0/1513906978 shutdown_connections 2023-07-07T18:15:38.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.441+0000 7f32a0e3e700 1 -- 172.21.15.12:0/1513906978 wait complete. 2023-07-07T18:15:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.442+0000 7f32a0e3e700 1 Processor -- start 2023-07-07T18:15:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.442+0000 7f32a0e3e700 1 -- start start 2023-07-07T18:15:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f32a0e3e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06e450 0x7f329c152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f32a0e3e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c158040 0x7f329c0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f32a0e3e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c15aa10 0x7f329c1f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f32a0e3e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c153380 con 0x7f329c15aa10 2023-07-07T18:15:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f32a0e3e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b2df0 con 0x7f329c06e450 2023-07-07T18:15:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f32a0e3e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b30d0 con 0x7f329c158040 2023-07-07T18:15:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c15aa10 0x7f329c1f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c15aa10 0x7f329c1f1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58328/0 (socket says 172.21.15.12:58328) 2023-07-07T18:15:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329ad9d700 1 -- 172.21.15.12:0/658256506 learned_addr learned my addr 172.21.15.12:0/658256506 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:38.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329ad9d700 1 -- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c158040 msgr2=0x7f329c0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f3299d9b700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c158040 0x7f329c0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329a59c700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06e450 0x7f329c152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329ad9d700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c158040 0x7f329c0b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329ad9d700 1 -- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06e450 msgr2=0x7f329c152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329ad9d700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06e450 0x7f329c152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329ad9d700 1 -- 172.21.15.12:0/658256506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c009550 con 0x7f329c15aa10 2023-07-07T18:15:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f329ad9d700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c15aa10 0x7f329c1f1f70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f329400cd50 tx=0x7f329400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.443+0000 7f328affd700 1 -- 172.21.15.12:0/658256506 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400f480 con 0x7f329c15aa10 2023-07-07T18:15:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.444+0000 7f328affd700 1 -- 172.21.15.12:0/658256506 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329400f600 con 0x7f329c15aa10 2023-07-07T18:15:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.444+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c06b000 con 0x7f329c15aa10 2023-07-07T18:15:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.444+0000 7f328affd700 1 -- 172.21.15.12:0/658256506 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329400f9b0 con 0x7f329c15aa10 2023-07-07T18:15:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.444+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c06b5c0 con 0x7f329c15aa10 2023-07-07T18:15:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.445+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c06b7e0 con 0x7f329c15aa10 2023-07-07T18:15:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.445+0000 7f328affd700 1 -- 172.21.15.12:0/658256506 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f329400b040 con 0x7f329c15aa10 2023-07-07T18:15:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.445+0000 7f328affd700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f327c06ace0 0x7f327c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.445+0000 7f328affd700 1 -- 172.21.15.12:0/658256506 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f329408a040 con 0x7f329c15aa10 2023-07-07T18:15:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.446+0000 7f329a59c700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f327c06ace0 0x7f327c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.446+0000 7f329a59c700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f327c06ace0 0x7f327c06d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3290000f60 tx=0x7f3290009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:38.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.450+0000 7f328affd700 1 -- 172.21.15.12:0/658256506 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3294054dc0 con 0x7f329c15aa10 2023-07-07T18:15:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.646+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f329c04ea20 con 0x7f329c15aa10 2023-07-07T18:15:38.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.646+0000 7f328affd700 1 -- 172.21.15.12:0/658256506 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32940583e0 con 0x7f329c15aa10 2023-07-07T18:15:38.648 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:38.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f327c06ace0 msgr2=0x7f327c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f327c06ace0 0x7f327c06d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3290000f60 tx=0x7f3290009040 comp rx=0 tx=0).stop 2023-07-07T18:15:38.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c15aa10 msgr2=0x7f329c1f1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c15aa10 0x7f329c1f1f70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f329400cd50 tx=0x7f329400a560 comp rx=0 tx=0).stop 2023-07-07T18:15:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 shutdown_connections 2023-07-07T18:15:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f327c06ace0 0x7f327c06d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f329c15aa10 0x7f329c1f1f70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f329c06e450 0x7f329c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 --2- 172.21.15.12:0/658256506 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f329c158040 0x7f329c0b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 >> 172.21.15.12:0/658256506 conn(0x7f329c0d0910 msgr2=0x7f329c15d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 shutdown_connections 2023-07-07T18:15:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.648+0000 7f32a0e3e700 1 -- 172.21.15.12:0/658256506 wait complete. 2023-07-07T18:15:38.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:38.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.787+0000 7f9251f8e700 1 Processor -- start 2023-07-07T18:15:38.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.787+0000 7f9251f8e700 1 -- start start 2023-07-07T18:15:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.788+0000 7f9251f8e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f924c0cd5e0 0x7f924c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.788+0000 7f9251f8e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c06f0e0 con 0x7f924c0adf40 2023-07-07T18:15:38.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.788+0000 7f9251f8e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c15dd90 con 0x7f924c06e030 2023-07-07T18:15:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.788+0000 7f9251f8e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c0ce2c0 con 0x7f924c0cd5e0 2023-07-07T18:15:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.788+0000 7f924bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f924c0adf40 0x7f924c15d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55532/0 (socket says 172.21.15.12:55532) 2023-07-07T18:15:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.788+0000 7f924bfff700 1 -- 172.21.15.12:0/2494621878 learned_addr learned my addr 172.21.15.12:0/2494621878 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924b7fe700 1 --2- 172.21.15.12:0/2494621878 >> v2:172.21.15.160:3300/0 conn(0x7f924c0cd5e0 0x7f924c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303227834 0 0) 0x7f924c06f0e0 con 0x7f924c0adf40 2023-07-07T18:15:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92380035b0 con 0x7f924c0adf40 2023-07-07T18:15:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129717910 0 0) 0x7f924c15dd90 con 0x7f924c06e030 2023-07-07T18:15:38.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f924c06f0e0 con 0x7f924c06e030 2023-07-07T18:15:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 993737149 0 0) 0x7f92380035b0 con 0x7f924c0adf40 2023-07-07T18:15:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 >> v2:172.21.15.160:3300/0 conn(0x7f924c0cd5e0 msgr2=0x7f924c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 --2- 172.21.15.12:0/2494621878 >> v2:172.21.15.160:3300/0 conn(0x7f924c0cd5e0 0x7f924c0cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 >> v1:172.21.15.160:6789/0 conn(0x7f924c06e030 legacy=0x7f924c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c0cdef0 con 0x7f924c0adf40 2023-07-07T18:15:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f92440019f0 con 0x7f924c0adf40 2023-07-07T18:15:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 >> v1:172.21.15.12:6789/0 conn(0x7f924c0adf40 legacy=0x7f924c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238003be0 0x7f9238003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9238004850 0x7f9238004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9238005250 0x7f923800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c0ce2c0 con 0x7f9238004850 2023-07-07T18:15:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923800c160 con 0x7f9238003be0 2023-07-07T18:15:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923800c320 con 0x7f9238005250 2023-07-07T18:15:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924affd700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9238004850 0x7f9238004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924b7fe700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238003be0 0x7f9238003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924bfff700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9238005250 0x7f923800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924affd700 1 -- 172.21.15.12:0/2494621878 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9238005250 msgr2=0x7f923800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924affd700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9238005250 0x7f923800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924affd700 1 -- 172.21.15.12:0/2494621878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238003be0 msgr2=0x7f9238003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924affd700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238003be0 0x7f9238003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924affd700 1 -- 172.21.15.12:0/2494621878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92380035b0 con 0x7f9238004850 2023-07-07T18:15:38.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924b7fe700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238003be0 0x7f9238003fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.789+0000 7f924bfff700 1 -- 172.21.15.12:0/2494621878 reap_dead start 2023-07-07T18:15:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f924affd700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9238004850 0x7f9238004cc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9234007fd0 tx=0x7f9238005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529af4b9ac070573 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234001d80 con 0x7f9238004850 2023-07-07T18:15:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92340052f0 con 0x7f9238004850 2023-07-07T18:15:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f924a7fc700 1 -- 172.21.15.12:0/2494621878 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234001470 con 0x7f9238004850 2023-07-07T18:15:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f9251f8e700 1 -- 172.21.15.12:0/2494621878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9238004850 msgr2=0x7f9238004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f9251f8e700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9238004850 0x7f9238004cc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9234007fd0 tx=0x7f9238005880 comp rx=0 tx=0).stop 2023-07-07T18:15:38.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f9251f8e700 1 -- 172.21.15.12:0/2494621878 shutdown_connections 2023-07-07T18:15:38.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f9251f8e700 1 --2- 172.21.15.12:0/2494621878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9238004850 0x7f9238004cc0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f9251f8e700 1 -- 172.21.15.12:0/2494621878 >> 172.21.15.12:0/2494621878 conn(0x7f924c06b920 msgr2=0x7f924c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:38.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f9251f8e700 1 -- 172.21.15.12:0/2494621878 shutdown_connections 2023-07-07T18:15:38.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.790+0000 7f9251f8e700 1 -- 172.21.15.12:0/2494621878 wait complete. 2023-07-07T18:15:38.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.792+0000 7f9251f8e700 1 Processor -- start 2023-07-07T18:15:38.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.792+0000 7f9251f8e700 1 -- start start 2023-07-07T18:15:38.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.792+0000 7f9251f8e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238004850 0x7f924c0ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.792+0000 7f9251f8e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924c1520b0 0x7f924c152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.792+0000 7f9251f8e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f924c0c50f0 0x7f924c0c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.792+0000 7f9251f8e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c153570 con 0x7f924c1520b0 2023-07-07T18:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.792+0000 7f9251f8e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c0c6020 con 0x7f9238004850 2023-07-07T18:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.792+0000 7f9251f8e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c09d010 con 0x7f924c0c50f0 2023-07-07T18:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924c1520b0 0x7f924c152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924c1520b0 0x7f924c152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58346/0 (socket says 172.21.15.12:58346) 2023-07-07T18:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924affd700 1 -- 172.21.15.12:0/649601702 learned_addr learned my addr 172.21.15.12:0/649601702 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:38.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924b7fe700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238004850 0x7f924c0ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924bfff700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f924c0c50f0 0x7f924c0c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924affd700 1 -- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f924c0c50f0 msgr2=0x7f924c0c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924affd700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f924c0c50f0 0x7f924c0c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924affd700 1 -- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238004850 msgr2=0x7f924c0ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924affd700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238004850 0x7f924c0ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924affd700 1 -- 172.21.15.12:0/649601702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c09d2f0 con 0x7f924c1520b0 2023-07-07T18:15:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924bfff700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f924c0c50f0 0x7f924c0c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:38.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f924affd700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924c1520b0 0x7f924c152520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9234005040 tx=0x7f9234001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f9243fff700 1 -- 172.21.15.12:0/649601702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234006a70 con 0x7f924c1520b0 2023-07-07T18:15:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f9243fff700 1 -- 172.21.15.12:0/649601702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9234006bd0 con 0x7f924c1520b0 2023-07-07T18:15:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c152a60 con 0x7f924c1520b0 2023-07-07T18:15:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f9243fff700 1 -- 172.21.15.12:0/649601702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234007040 con 0x7f924c1520b0 2023-07-07T18:15:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.793+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c0c5aa0 con 0x7f924c1520b0 2023-07-07T18:15:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.794+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c09d530 con 0x7f924c1520b0 2023-07-07T18:15:38.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.795+0000 7f9243fff700 1 -- 172.21.15.12:0/649601702 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92340071a0 con 0x7f924c1520b0 2023-07-07T18:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.795+0000 7f9243fff700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f922c06ad10 0x7f922c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.795+0000 7f9243fff700 1 -- 172.21.15.12:0/649601702 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f923408a250 con 0x7f924c1520b0 2023-07-07T18:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.795+0000 7f924b7fe700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f922c06ad10 0x7f922c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.796+0000 7f924b7fe700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f922c06ad10 0x7f922c06d1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f924c04fa50 tx=0x7f923c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:38.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.801+0000 7f9243fff700 1 -- 172.21.15.12:0/649601702 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f924c09d530 con 0x7f924c1520b0 2023-07-07T18:15:39.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.998+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f924c09d530 con 0x7f924c1520b0 2023-07-07T18:15:39.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:38.998+0000 7f9243fff700 1 -- 172.21.15.12:0/649601702 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f924c09d530 con 0x7f924c1520b0 2023-07-07T18:15:39.000 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:39.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f922c06ad10 msgr2=0x7f922c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f922c06ad10 0x7f922c06d1c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f924c04fa50 tx=0x7f923c008040 comp rx=0 tx=0).stop 2023-07-07T18:15:39.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924c1520b0 msgr2=0x7f924c152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924c1520b0 0x7f924c152520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9234005040 tx=0x7f9234001310 comp rx=0 tx=0).stop 2023-07-07T18:15:39.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 shutdown_connections 2023-07-07T18:15:39.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f922c06ad10 0x7f922c06d1c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f924c0c50f0 0x7f924c0c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9238004850 0x7f924c0ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 --2- 172.21.15.12:0/649601702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f924c1520b0 0x7f924c152520 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.000+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 >> 172.21.15.12:0/649601702 conn(0x7f924c06b920 msgr2=0x7f924c0af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:39.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.001+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 shutdown_connections 2023-07-07T18:15:39.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.001+0000 7f9251f8e700 1 -- 172.21.15.12:0/649601702 wait complete. 2023-07-07T18:15:39.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:39.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.140+0000 7fcbbb48b700 1 Processor -- start 2023-07-07T18:15:39.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.140+0000 7fcbbb48b700 1 -- start start 2023-07-07T18:15:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbbb48b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcbb415a330 0x7fcbb4070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbbb48b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbb40afc40 0x7fcbb415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbbb48b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb40caf70 con 0x7fcbb40cd330 2023-07-07T18:15:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbbb48b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40cb210 con 0x7fcbb40afc40 2023-07-07T18:15:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbbb48b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40ccc20 con 0x7fcbb415a330 2023-07-07T18:15:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbb9a28700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbb40afc40 0x7fcbb415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbb9a28700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbb40afc40 0x7fcbb415dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58356/0 (socket says 172.21.15.12:58356) 2023-07-07T18:15:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbb9a28700 1 -- 172.21.15.12:0/3458288691 learned_addr learned my addr 172.21.15.12:0/3458288691 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbb8a26700 1 --2- 172.21.15.12:0/3458288691 >> v2:172.21.15.160:3300/0 conn(0x7fcbb415a330 0x7fcbb4070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbb9a28700 1 -- 172.21.15.12:0/3458288691 >> v2:172.21.15.160:3300/0 conn(0x7fcbb415a330 msgr2=0x7fcbb4070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbb9a28700 1 --2- 172.21.15.12:0/3458288691 >> v2:172.21.15.160:3300/0 conn(0x7fcbb415a330 0x7fcbb4070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbb9a28700 1 -- 172.21.15.12:0/3458288691 >> v1:172.21.15.160:6789/0 conn(0x7fcbb40cd330 legacy=0x7fcbb40cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.141+0000 7fcbb9a28700 1 -- 172.21.15.12:0/3458288691 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40ccf00 con 0x7fcbb40afc40 2023-07-07T18:15:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbb9a28700 1 --2- 172.21.15.12:0/3458288691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40afc40 0x7fcbb415dc50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40cc360 tx=0x7fcbac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30a12a328763514 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbabfff700 1 -- 172.21.15.12:0/3458288691 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00e070 con 0x7fcbb40afc40 2023-07-07T18:15:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbabfff700 1 -- 172.21.15.12:0/3458288691 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac00b910 con 0x7fcbb40afc40 2023-07-07T18:15:39.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbabfff700 1 -- 172.21.15.12:0/3458288691 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00bcc0 con 0x7fcbb40afc40 2023-07-07T18:15:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3458288691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40afc40 msgr2=0x7fcbb415dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbbb48b700 1 --2- 172.21.15.12:0/3458288691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40afc40 0x7fcbb415dc50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40cc360 tx=0x7fcbac00b330 comp rx=0 tx=0).stop 2023-07-07T18:15:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3458288691 shutdown_connections 2023-07-07T18:15:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbbb48b700 1 --2- 172.21.15.12:0/3458288691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40afc40 0x7fcbb415dc50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbbb48b700 1 --2- 172.21.15.12:0/3458288691 >> v2:172.21.15.160:3300/0 conn(0x7fcbb415a330 0x7fcbb4070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3458288691 >> 172.21.15.12:0/3458288691 conn(0x7fcbb406e5c0 msgr2=0x7fcbb406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3458288691 shutdown_connections 2023-07-07T18:15:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.142+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3458288691 wait complete. 2023-07-07T18:15:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.144+0000 7fcbbb48b700 1 Processor -- start 2023-07-07T18:15:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.144+0000 7fcbbb48b700 1 -- start start 2023-07-07T18:15:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.144+0000 7fcbbb48b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbb40afc40 0x7fcbb4158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.144+0000 7fcbbb48b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40cd330 0x7fcbb415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.144+0000 7fcbbb48b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbb415a330 0x7fcbb40ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.144+0000 7fcbbb48b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40b46d0 con 0x7fcbb40cd330 2023-07-07T18:15:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.144+0000 7fcbbb48b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40b3ac0 con 0x7fcbb415a330 2023-07-07T18:15:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.144+0000 7fcbbb48b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40b3da0 con 0x7fcbb40afc40 2023-07-07T18:15:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.144+0000 7fcbb8a26700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40cd330 0x7fcbb415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb8a26700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40cd330 0x7fcbb415cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58360/0 (socket says 172.21.15.12:58360) 2023-07-07T18:15:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb8a26700 1 -- 172.21.15.12:0/3177234727 learned_addr learned my addr 172.21.15.12:0/3177234727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb9a28700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbb415a330 0x7fcbb40ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb9227700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbb40afc40 0x7fcbb4158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb8a26700 1 -- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbb40afc40 msgr2=0x7fcbb4158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb8a26700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbb40afc40 0x7fcbb4158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb8a26700 1 -- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbb415a330 msgr2=0x7fcbb40ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb8a26700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbb415a330 0x7fcbb40ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb8a26700 1 -- 172.21.15.12:0/3177234727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac009b30 con 0x7fcbb40cd330 2023-07-07T18:15:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbb8a26700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40cd330 0x7fcbb415cfc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000e9b0 tx=0x7fcbb000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:39.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcba9ffb700 1 -- 172.21.15.12:0/3177234727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000ee50 con 0x7fcbb40cd330 2023-07-07T18:15:39.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcba9ffb700 1 -- 172.21.15.12:0/3177234727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb000c7f0 con 0x7fcbb40cd330 2023-07-07T18:15:39.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcba9ffb700 1 -- 172.21.15.12:0/3177234727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb000cb60 con 0x7fcbb40cd330 2023-07-07T18:15:39.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb40b4080 con 0x7fcbb40cd330 2023-07-07T18:15:39.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.145+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb41594c0 con 0x7fcbb40cd330 2023-07-07T18:15:39.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.146+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb40b4880 con 0x7fcbb40cd330 2023-07-07T18:15:39.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.147+0000 7fcba9ffb700 1 -- 172.21.15.12:0/3177234727 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbb000ccc0 con 0x7fcbb40cd330 2023-07-07T18:15:39.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.147+0000 7fcba9ffb700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcb9806ace0 0x7fcb9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.147+0000 7fcba9ffb700 1 -- 172.21.15.12:0/3177234727 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcbb0089bb0 con 0x7fcbb40cd330 2023-07-07T18:15:39.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.148+0000 7fcbb9227700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcb9806ace0 0x7fcb9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.148+0000 7fcbb9227700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcb9806ace0 0x7fcb9806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcba4007fd0 tx=0x7fcba4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:39.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.152+0000 7fcba9ffb700 1 -- 172.21.15.12:0/3177234727 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcbb40b4880 con 0x7fcbb40cd330 2023-07-07T18:15:39.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.349+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcbb404ea20 con 0x7fcbb40cd330 2023-07-07T18:15:39.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.349+0000 7fcba9ffb700 1 -- 172.21.15.12:0/3177234727 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcbb0058290 con 0x7fcbb40cd330 2023-07-07T18:15:39.352 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:39.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcb9806ace0 msgr2=0x7fcb9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcb9806ace0 0x7fcb9806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcba4007fd0 tx=0x7fcba4009040 comp rx=0 tx=0).stop 2023-07-07T18:15:39.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40cd330 msgr2=0x7fcbb415cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40cd330 0x7fcbb415cfc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000e9b0 tx=0x7fcbb000ecc0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 shutdown_connections 2023-07-07T18:15:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcb9806ace0 0x7fcb9806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbb415a330 0x7fcbb40ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcbb40afc40 0x7fcbb4158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 --2- 172.21.15.12:0/3177234727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbb40cd330 0x7fcbb415cfc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 >> 172.21.15.12:0/3177234727 conn(0x7fcbb406e5c0 msgr2=0x7fcbb40cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 shutdown_connections 2023-07-07T18:15:39.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.351+0000 7fcbbb48b700 1 -- 172.21.15.12:0/3177234727 wait complete. 2023-07-07T18:15:39.365 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:39.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.492+0000 7f258a0b7700 1 Processor -- start 2023-07-07T18:15:39.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.492+0000 7f258a0b7700 1 -- start start 2023-07-07T18:15:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.493+0000 7f258a0b7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f258415fc60 0x7f258406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.493+0000 7f258a0b7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f25840aecc0 0x7f25840ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.493+0000 7f258a0b7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840ce620 con 0x7f258406e260 2023-07-07T18:15:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.493+0000 7f258a0b7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2584160580 con 0x7f25840aecc0 2023-07-07T18:15:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.493+0000 7f258a0b7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2584160860 con 0x7f258415fc60 2023-07-07T18:15:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.493+0000 7f2582ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f25840aecc0 0x7f25840ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.493+0000 7f2583fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f258406e260 0x7f258406e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55568/0 (socket says 172.21.15.12:55568) 2023-07-07T18:15:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.493+0000 7f2583fff700 1 -- 172.21.15.12:0/3717200390 learned_addr learned my addr 172.21.15.12:0/3717200390 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:39.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f25837fe700 1 --2- 172.21.15.12:0/3717200390 >> v2:172.21.15.160:3300/0 conn(0x7f258415fc60 0x7f258406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f2582ffd700 1 -- 172.21.15.12:0/3717200390 >> v2:172.21.15.160:3300/0 conn(0x7f258415fc60 msgr2=0x7f258406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f2582ffd700 1 --2- 172.21.15.12:0/3717200390 >> v2:172.21.15.160:3300/0 conn(0x7f258415fc60 0x7f258406a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f2582ffd700 1 -- 172.21.15.12:0/3717200390 >> v1:172.21.15.12:6789/0 conn(0x7f258406e260 legacy=0x7f258406e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f2582ffd700 1 -- 172.21.15.12:0/3717200390 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584160b40 con 0x7f25840aecc0 2023-07-07T18:15:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f2582ffd700 1 --2- 172.21.15.12:0/3717200390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 0x7f25840ac600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2584066830 tx=0x7f256c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c24915698fcccc server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f25827fc700 1 -- 172.21.15.12:0/3717200390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c011830 con 0x7f25840aecc0 2023-07-07T18:15:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f25827fc700 1 -- 172.21.15.12:0/3717200390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c011990 con 0x7f25840aecc0 2023-07-07T18:15:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f25827fc700 1 -- 172.21.15.12:0/3717200390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c011d20 con 0x7f25840aecc0 2023-07-07T18:15:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f258a0b7700 1 -- 172.21.15.12:0/3717200390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 msgr2=0x7f25840ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f258a0b7700 1 --2- 172.21.15.12:0/3717200390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 0x7f25840ac600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2584066830 tx=0x7f256c009b20 comp rx=0 tx=0).stop 2023-07-07T18:15:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f258a0b7700 1 -- 172.21.15.12:0/3717200390 shutdown_connections 2023-07-07T18:15:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f258a0b7700 1 --2- 172.21.15.12:0/3717200390 >> v2:172.21.15.160:3300/0 conn(0x7f258415fc60 0x7f258406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f258a0b7700 1 --2- 172.21.15.12:0/3717200390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 0x7f25840ac600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.494+0000 7f258a0b7700 1 -- 172.21.15.12:0/3717200390 >> 172.21.15.12:0/3717200390 conn(0x7f258406b920 msgr2=0x7f25840cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:39.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.495+0000 7f258a0b7700 1 -- 172.21.15.12:0/3717200390 shutdown_connections 2023-07-07T18:15:39.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.495+0000 7f258a0b7700 1 -- 172.21.15.12:0/3717200390 wait complete. 2023-07-07T18:15:39.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.496+0000 7f258a0b7700 1 Processor -- start 2023-07-07T18:15:39.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.496+0000 7f258a0b7700 1 -- start start 2023-07-07T18:15:39.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f258a0b7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f258406e260 0x7f2584146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f258a0b7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 0x7f25840c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f258a0b7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f258415fc60 0x7f25840b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f258a0b7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840b2940 con 0x7f25840aecc0 2023-07-07T18:15:39.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f258a0b7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25840c4c00 con 0x7f258406e260 2023-07-07T18:15:39.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f258a0b7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25840c45f0 con 0x7f258415fc60 2023-07-07T18:15:39.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2582ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 0x7f25840c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2582ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 0x7f25840c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58374/0 (socket says 172.21.15.12:58374) 2023-07-07T18:15:39.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2582ffd700 1 -- 172.21.15.12:0/3947595775 learned_addr learned my addr 172.21.15.12:0/3947595775 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:39.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f25837fe700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f258406e260 0x7f2584146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2583fff700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f258415fc60 0x7f25840b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2582ffd700 1 -- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f258415fc60 msgr2=0x7f25840b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2582ffd700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f258415fc60 0x7f25840b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2582ffd700 1 -- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f258406e260 msgr2=0x7f2584146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2582ffd700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f258406e260 0x7f2584146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2582ffd700 1 -- 172.21.15.12:0/3947595775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0094a0 con 0x7f25840aecc0 2023-07-07T18:15:39.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f2582ffd700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 0x7f25840c8ff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f256c0090b0 tx=0x7f256c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:39.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.497+0000 7f257bfff700 1 -- 172.21.15.12:0/3947595775 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0036a0 con 0x7f25840aecc0 2023-07-07T18:15:39.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.498+0000 7f257bfff700 1 -- 172.21.15.12:0/3947595775 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c01f070 con 0x7f25840aecc0 2023-07-07T18:15:39.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.498+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25840c9640 con 0x7f25840aecc0 2023-07-07T18:15:39.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.498+0000 7f257bfff700 1 -- 172.21.15.12:0/3947595775 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c003a60 con 0x7f25840aecc0 2023-07-07T18:15:39.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.498+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25840c9920 con 0x7f25840aecc0 2023-07-07T18:15:39.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.498+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258404ea20 con 0x7f25840aecc0 2023-07-07T18:15:39.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.499+0000 7f257bfff700 1 -- 172.21.15.12:0/3947595775 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f256c003bc0 con 0x7f25840aecc0 2023-07-07T18:15:39.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.499+0000 7f257bfff700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f256406ace0 0x7f256406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.499+0000 7f257bfff700 1 -- 172.21.15.12:0/3947595775 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f256c021070 con 0x7f25840aecc0 2023-07-07T18:15:39.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.500+0000 7f25837fe700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f256406ace0 0x7f256406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.500+0000 7f25837fe700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f256406ace0 0x7f256406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f257400aaa0 tx=0x7f2574008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:39.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.504+0000 7f257bfff700 1 -- 172.21.15.12:0/3947595775 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f256c055e40 con 0x7f25840aecc0 2023-07-07T18:15:39.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.698+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25840c4d40 con 0x7f25840aecc0 2023-07-07T18:15:39.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.699+0000 7f257bfff700 1 -- 172.21.15.12:0/3947595775 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f256c059460 con 0x7f25840aecc0 2023-07-07T18:15:39.701 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:39.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f256406ace0 msgr2=0x7f256406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f256406ace0 0x7f256406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f257400aaa0 tx=0x7f2574008040 comp rx=0 tx=0).stop 2023-07-07T18:15:39.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 msgr2=0x7f25840c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 0x7f25840c8ff0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f256c0090b0 tx=0x7f256c004750 comp rx=0 tx=0).stop 2023-07-07T18:15:39.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 shutdown_connections 2023-07-07T18:15:39.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f256406ace0 0x7f256406d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f258415fc60 0x7f25840b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f258406e260 0x7f2584146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 --2- 172.21.15.12:0/3947595775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25840aecc0 0x7f25840c8ff0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 >> 172.21.15.12:0/3947595775 conn(0x7f258406b920 msgr2=0x7f25840b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:39.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 shutdown_connections 2023-07-07T18:15:39.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.701+0000 7f258a0b7700 1 -- 172.21.15.12:0/3947595775 wait complete. 2023-07-07T18:15:39.715 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:39.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.841+0000 7f6481274700 1 Processor -- start 2023-07-07T18:15:39.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.841+0000 7f6481274700 1 -- start start 2023-07-07T18:15:39.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f6481274700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f647c15a430 0x7f647c06e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f6481274700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 0x7f647c0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f6481274700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f647c0acb40 0x7f647c0acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f6481274700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c0af330 con 0x7f647c0acb40 2023-07-07T18:15:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f6481274700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c0aee00 con 0x7f647c15a430 2023-07-07T18:15:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f6481274700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c06e340 con 0x7f647c0ae8b0 2023-07-07T18:15:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f647b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f647c0acb40 0x7f647c0acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f647b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f647c0acb40 0x7f647c0acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58384/0 (socket says 172.21.15.12:58384) 2023-07-07T18:15:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f647b7fe700 1 -- 172.21.15.12:0/2901659972 learned_addr learned my addr 172.21.15.12:0/2901659972 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f647affd700 1 --2- 172.21.15.12:0/2901659972 >> v2:172.21.15.160:3300/0 conn(0x7f647c15a430 0x7f647c06e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.842+0000 7f647a7fc700 1 --2- 172.21.15.12:0/2901659972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 0x7f647c0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f647b7fe700 1 -- 172.21.15.12:0/2901659972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 msgr2=0x7f647c0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f647b7fe700 1 --2- 172.21.15.12:0/2901659972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 0x7f647c0ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f647b7fe700 1 -- 172.21.15.12:0/2901659972 >> v2:172.21.15.160:3300/0 conn(0x7f647c15a430 msgr2=0x7f647c06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f647b7fe700 1 --2- 172.21.15.12:0/2901659972 >> v2:172.21.15.160:3300/0 conn(0x7f647c15a430 0x7f647c06e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f647b7fe700 1 -- 172.21.15.12:0/2901659972 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c0af050 con 0x7f647c0acb40 2023-07-07T18:15:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f647b7fe700 1 --2- 172.21.15.12:0/2901659972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c0acb40 0x7f647c0acfc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f647c071190 tx=0x7f647400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2034e6e461720e3d server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f6479ffb700 1 -- 172.21.15.12:0/2901659972 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647400e070 con 0x7f647c0acb40 2023-07-07T18:15:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f6479ffb700 1 -- 172.21.15.12:0/2901659972 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647400b910 con 0x7f647c0acb40 2023-07-07T18:15:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f6479ffb700 1 -- 172.21.15.12:0/2901659972 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647400bcc0 con 0x7f647c0acb40 2023-07-07T18:15:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f6481274700 1 -- 172.21.15.12:0/2901659972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c0acb40 msgr2=0x7f647c0acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.843+0000 7f6481274700 1 --2- 172.21.15.12:0/2901659972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c0acb40 0x7f647c0acfc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f647c071190 tx=0x7f647400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.844+0000 7f6481274700 1 -- 172.21.15.12:0/2901659972 shutdown_connections 2023-07-07T18:15:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.844+0000 7f6481274700 1 --2- 172.21.15.12:0/2901659972 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c0acb40 0x7f647c0acfc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.844+0000 7f6481274700 1 --2- 172.21.15.12:0/2901659972 >> v2:172.21.15.160:3300/0 conn(0x7f647c15a430 0x7f647c06e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.844+0000 7f6481274700 1 --2- 172.21.15.12:0/2901659972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 0x7f647c0ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.844+0000 7f6481274700 1 -- 172.21.15.12:0/2901659972 >> 172.21.15.12:0/2901659972 conn(0x7f647c06b920 msgr2=0x7f647c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.844+0000 7f6481274700 1 -- 172.21.15.12:0/2901659972 shutdown_connections 2023-07-07T18:15:39.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.844+0000 7f6481274700 1 -- 172.21.15.12:0/2901659972 wait complete. 2023-07-07T18:15:39.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.845+0000 7f6481274700 1 Processor -- start 2023-07-07T18:15:39.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.845+0000 7f6481274700 1 -- start start 2023-07-07T18:15:39.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f6481274700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f647c0acb40 0x7f647c0b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f6481274700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 0x7f647c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f6481274700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c15a430 0x7f647c0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f6481274700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0afe80 con 0x7f647c15a430 2023-07-07T18:15:39.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f6481274700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0b0720 con 0x7f647c0acb40 2023-07-07T18:15:39.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f6481274700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c155580 con 0x7f647c0ae8b0 2023-07-07T18:15:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c15a430 0x7f647c0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c15a430 0x7f647c0c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58390/0 (socket says 172.21.15.12:58390) 2023-07-07T18:15:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647b7fe700 1 -- 172.21.15.12:0/3815380795 learned_addr learned my addr 172.21.15.12:0/3815380795 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647affd700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f647c0acb40 0x7f647c0b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647a7fc700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 0x7f647c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647b7fe700 1 -- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 msgr2=0x7f647c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647b7fe700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 0x7f647c154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647b7fe700 1 -- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f647c0acb40 msgr2=0x7f647c0b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647b7fe700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f647c0acb40 0x7f647c0b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647b7fe700 1 -- 172.21.15.12:0/3815380795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474009b30 con 0x7f647c15a430 2023-07-07T18:15:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.846+0000 7f647b7fe700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c15a430 0x7f647c0c5830 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f647400b680 tx=0x7f6474004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.847+0000 7f64637fe700 1 -- 172.21.15.12:0/3815380795 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64740092e0 con 0x7f647c15a430 2023-07-07T18:15:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.847+0000 7f64637fe700 1 -- 172.21.15.12:0/3815380795 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6474004250 con 0x7f647c15a430 2023-07-07T18:15:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.847+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c0c4ac0 con 0x7f647c15a430 2023-07-07T18:15:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.847+0000 7f64637fe700 1 -- 172.21.15.12:0/3815380795 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474004620 con 0x7f647c15a430 2023-07-07T18:15:39.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.847+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c0b03b0 con 0x7f647c15a430 2023-07-07T18:15:39.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.848+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c0b0540 con 0x7f647c15a430 2023-07-07T18:15:39.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.848+0000 7f64637fe700 1 -- 172.21.15.12:0/3815380795 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6474004780 con 0x7f647c15a430 2023-07-07T18:15:39.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.848+0000 7f64637fe700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f646806ad10 0x7f646806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:39.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.849+0000 7f64637fe700 1 -- 172.21.15.12:0/3815380795 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f647408a7c0 con 0x7f647c15a430 2023-07-07T18:15:39.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.849+0000 7f647affd700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f646806ad10 0x7f646806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:39.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.849+0000 7f647affd700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f646806ad10 0x7f646806d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6470009bc0 tx=0x7f64700091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:39.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:39.853+0000 7f64637fe700 1 -- 172.21.15.12:0/3815380795 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6474055680 con 0x7f647c15a430 2023-07-07T18:15:40.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.051+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f647c04ea20 con 0x7f647c15a430 2023-07-07T18:15:40.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.051+0000 7f64637fe700 1 -- 172.21.15.12:0/3815380795 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6474058ca0 con 0x7f647c15a430 2023-07-07T18:15:40.054 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:40.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f646806ad10 msgr2=0x7f646806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f646806ad10 0x7f646806d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6470009bc0 tx=0x7f64700091c0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c15a430 msgr2=0x7f647c0c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c15a430 0x7f647c0c5830 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f647400b680 tx=0x7f6474004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 shutdown_connections 2023-07-07T18:15:40.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f646806ad10 0x7f646806d1c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f647c15a430 0x7f647c0c5830 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f647c0acb40 0x7f647c0b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 --2- 172.21.15.12:0/3815380795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f647c0ae8b0 0x7f647c154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 >> 172.21.15.12:0/3815380795 conn(0x7f647c06b920 msgr2=0x7f647c0ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:40.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 shutdown_connections 2023-07-07T18:15:40.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.053+0000 7f6481274700 1 -- 172.21.15.12:0/3815380795 wait complete. 2023-07-07T18:15:40.075 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-07T18:15:40.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-07-07T18:15:40.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.281+0000 7f315e2e3700 1 Processor -- start 2023-07-07T18:15:40.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.281+0000 7f315e2e3700 1 -- start start 2023-07-07T18:15:40.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f315e2e3700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f315806ccc0 0x7f315815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f315e2e3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 0x7f31580d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f315e2e3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31580afdb0 con 0x7f315815c2e0 2023-07-07T18:15:40.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f315e2e3700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580ceb90 con 0x7f315806ccc0 2023-07-07T18:15:40.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f315e2e3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315815c6b0 con 0x7f3158160340 2023-07-07T18:15:40.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f31577fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f315806ccc0 0x7f315815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f31577fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f315806ccc0 0x7f315815fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58396/0 (socket says 172.21.15.12:58396) 2023-07-07T18:15:40.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f31577fe700 1 -- 172.21.15.12:0/1135761209 learned_addr learned my addr 172.21.15.12:0/1135761209 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:40.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f3157fff700 1 --1- 172.21.15.12:0/1135761209 >> v1:172.21.15.12:6789/0 conn(0x7f315815c2e0 0x7f31580ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55592/0 (socket says 172.21.15.12:55592) 2023-07-07T18:15:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f315c880700 1 --2- 172.21.15.12:0/1135761209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 0x7f31580d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f31577fe700 1 -- 172.21.15.12:0/1135761209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 msgr2=0x7f31580d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f31577fe700 1 --2- 172.21.15.12:0/1135761209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 0x7f31580d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f31577fe700 1 -- 172.21.15.12:0/1135761209 >> v1:172.21.15.12:6789/0 conn(0x7f315815c2e0 legacy=0x7f31580ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f31577fe700 1 -- 172.21.15.12:0/1135761209 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31580b0000 con 0x7f315806ccc0 2023-07-07T18:15:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f3156ffd700 1 -- 172.21.15.12:0/1135761209 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313855225 0 0) 0x7f31580afdb0 con 0x7f315815c2e0 2023-07-07T18:15:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.282+0000 7f31577fe700 1 --2- 172.21.15.12:0/1135761209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315806ccc0 0x7f315815fe00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f31480098f0 tx=0x7f3148009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f563e5708d4cb1dd server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f3156ffd700 1 -- 172.21.15.12:0/1135761209 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800b8a0 con 0x7f315806ccc0 2023-07-07T18:15:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f3156ffd700 1 -- 172.21.15.12:0/1135761209 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800ba00 con 0x7f315806ccc0 2023-07-07T18:15:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f3156ffd700 1 -- 172.21.15.12:0/1135761209 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800bd90 con 0x7f315806ccc0 2023-07-07T18:15:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f315e2e3700 1 -- 172.21.15.12:0/1135761209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315806ccc0 msgr2=0x7f315815fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f315e2e3700 1 --2- 172.21.15.12:0/1135761209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315806ccc0 0x7f315815fe00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f31480098f0 tx=0x7f3148009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f315e2e3700 1 -- 172.21.15.12:0/1135761209 shutdown_connections 2023-07-07T18:15:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f315e2e3700 1 --2- 172.21.15.12:0/1135761209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 0x7f31580d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f315e2e3700 1 --2- 172.21.15.12:0/1135761209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315806ccc0 0x7f315815fe00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f315e2e3700 1 -- 172.21.15.12:0/1135761209 >> 172.21.15.12:0/1135761209 conn(0x7f315806e530 msgr2=0x7f315806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:40.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f315e2e3700 1 -- 172.21.15.12:0/1135761209 shutdown_connections 2023-07-07T18:15:40.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.283+0000 7f315e2e3700 1 -- 172.21.15.12:0/1135761209 wait complete. 2023-07-07T18:15:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.284+0000 7f315e2e3700 1 Processor -- start 2023-07-07T18:15:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.285+0000 7f315e2e3700 1 -- start start 2023-07-07T18:15:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.285+0000 7f315e2e3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f315806ccc0 0x7f31580b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.285+0000 7f315e2e3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315815c2e0 0x7f31580b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.285+0000 7f315e2e3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 0x7f31581f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.285+0000 7f315e2e3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31580b5b90 con 0x7f315815c2e0 2023-07-07T18:15:40.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.285+0000 7f315e2e3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31581f24b0 con 0x7f315806ccc0 2023-07-07T18:15:40.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.285+0000 7f315e2e3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315814ce90 con 0x7f3158160340 2023-07-07T18:15:40.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.285+0000 7f31577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315815c2e0 0x7f31580b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f31577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315815c2e0 0x7f31580b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58402/0 (socket says 172.21.15.12:58402) 2023-07-07T18:15:40.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f31577fe700 1 -- 172.21.15.12:0/3762079606 learned_addr learned my addr 172.21.15.12:0/3762079606 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:40.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f315c880700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 0x7f31581f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f3157fff700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f315806ccc0 0x7f31580b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f31577fe700 1 -- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 msgr2=0x7f31581f1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f31577fe700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 0x7f31581f1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f31577fe700 1 -- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f315806ccc0 msgr2=0x7f31580b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f31577fe700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f315806ccc0 0x7f31580b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f31577fe700 1 -- 172.21.15.12:0/3762079606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3148009550 con 0x7f315815c2e0 2023-07-07T18:15:40.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f315c880700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 0x7f31581f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:40.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f31577fe700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315815c2e0 0x7f31580b3700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3148009c40 tx=0x7f3148004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:40.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f3154ff9700 1 -- 172.21.15.12:0/3762079606 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148004380 con 0x7f315815c2e0 2023-07-07T18:15:40.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f3154ff9700 1 -- 172.21.15.12:0/3762079606 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314801f070 con 0x7f315815c2e0 2023-07-07T18:15:40.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f3154ff9700 1 -- 172.21.15.12:0/3762079606 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31480036a0 con 0x7f315815c2e0 2023-07-07T18:15:40.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31580b5dc0 con 0x7f315815c2e0 2023-07-07T18:15:40.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.286+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31580b6380 con 0x7f315815c2e0 2023-07-07T18:15:40.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.287+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3158073910 con 0x7f315815c2e0 2023-07-07T18:15:40.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.288+0000 7f3154ff9700 1 -- 172.21.15.12:0/3762079606 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3148021030 con 0x7f315815c2e0 2023-07-07T18:15:40.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.288+0000 7f3154ff9700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f313806ace0 0x7f313806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.288+0000 7f3154ff9700 1 -- 172.21.15.12:0/3762079606 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f314808aba0 con 0x7f315815c2e0 2023-07-07T18:15:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.288+0000 7f3157fff700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f313806ace0 0x7f313806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.289+0000 7f3157fff700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f313806ace0 0x7f313806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3140000f60 tx=0x7f3140007c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.292+0000 7f3154ff9700 1 -- 172.21.15.12:0/3762079606 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f31480559b0 con 0x7f315815c2e0 2023-07-07T18:15:40.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.573+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f3158160a90 con 0x7f315815c2e0 2023-07-07T18:15:40.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.808+0000 7f3154ff9700 1 -- 172.21.15.12:0/3762079606 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v74) v1 ==== 147+0+0 (secure 0 0 0) 0x7f3148006d80 con 0x7f315815c2e0 2023-07-07T18:15:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f313806ace0 msgr2=0x7f313806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f313806ace0 0x7f313806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3140000f60 tx=0x7f3140007c00 comp rx=0 tx=0).stop 2023-07-07T18:15:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315815c2e0 msgr2=0x7f31580b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315815c2e0 0x7f31580b3700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3148009c40 tx=0x7f3148004750 comp rx=0 tx=0).stop 2023-07-07T18:15:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 shutdown_connections 2023-07-07T18:15:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f313806ace0 0x7f313806d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3158160340 0x7f31581f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f315806ccc0 0x7f31580b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 --2- 172.21.15.12:0/3762079606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f315815c2e0 0x7f31580b3700 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 >> 172.21.15.12:0/3762079606 conn(0x7f315806e530 msgr2=0x7f3158159920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 shutdown_connections 2023-07-07T18:15:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.811+0000 7f315e2e3700 1 -- 172.21.15.12:0/3762079606 wait complete. 2023-07-07T18:15:40.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-07T18:15:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.952+0000 7f49c63fe700 1 Processor -- start 2023-07-07T18:15:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.952+0000 7f49c63fe700 1 -- start start 2023-07-07T18:15:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49c63fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49c015fc60 0x7f49c006a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49c63fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c00aecc0 0x7f49c00ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49c63fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c00ce620 con 0x7f49c006e260 2023-07-07T18:15:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49c63fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c0160580 con 0x7f49c015fc60 2023-07-07T18:15:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49c63fe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c0160860 con 0x7f49c00aecc0 2023-07-07T18:15:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49bffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49c015fc60 0x7f49c006a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49c499b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f49c006e260 0x7f49c00cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55610/0 (socket says 172.21.15.12:55610) 2023-07-07T18:15:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49bffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49c015fc60 0x7f49c006a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58408/0 (socket says 172.21.15.12:58408) 2023-07-07T18:15:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49c499b700 1 -- 172.21.15.12:0/654424934 learned_addr learned my addr 172.21.15.12:0/654424934 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49bf7fe700 1 --2- 172.21.15.12:0/654424934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c00aecc0 0x7f49c00ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49bffff700 1 -- 172.21.15.12:0/654424934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c00aecc0 msgr2=0x7f49c00ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49bffff700 1 --2- 172.21.15.12:0/654424934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c00aecc0 0x7f49c00ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49bffff700 1 -- 172.21.15.12:0/654424934 >> v1:172.21.15.12:6789/0 conn(0x7f49c006e260 legacy=0x7f49c00cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49bffff700 1 -- 172.21.15.12:0/654424934 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0160b40 con 0x7f49c015fc60 2023-07-07T18:15:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49beffd700 1 -- 172.21.15.12:0/654424934 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271062013 0 0) 0x7f49c00ce620 con 0x7f49c006e260 2023-07-07T18:15:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.953+0000 7f49bffff700 1 --2- 172.21.15.12:0/654424934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c015fc60 0x7f49c006a900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009820 tx=0x7f49b4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20ee3bd16db560f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:40.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49beffd700 1 -- 172.21.15.12:0/654424934 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4005e30 con 0x7f49c015fc60 2023-07-07T18:15:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49beffd700 1 -- 172.21.15.12:0/654424934 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4006030 con 0x7f49c015fc60 2023-07-07T18:15:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49beffd700 1 -- 172.21.15.12:0/654424934 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40063e0 con 0x7f49c015fc60 2023-07-07T18:15:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49c63fe700 1 -- 172.21.15.12:0/654424934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c015fc60 msgr2=0x7f49c006a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49c63fe700 1 --2- 172.21.15.12:0/654424934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c015fc60 0x7f49c006a900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009820 tx=0x7f49b4009b30 comp rx=0 tx=0).stop 2023-07-07T18:15:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49c63fe700 1 -- 172.21.15.12:0/654424934 shutdown_connections 2023-07-07T18:15:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49c63fe700 1 --2- 172.21.15.12:0/654424934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c015fc60 0x7f49c006a900 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49c63fe700 1 --2- 172.21.15.12:0/654424934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c00aecc0 0x7f49c00ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49c63fe700 1 -- 172.21.15.12:0/654424934 >> 172.21.15.12:0/654424934 conn(0x7f49c006b920 msgr2=0x7f49c00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:40.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49c63fe700 1 -- 172.21.15.12:0/654424934 shutdown_connections 2023-07-07T18:15:40.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.954+0000 7f49c63fe700 1 -- 172.21.15.12:0/654424934 wait complete. 2023-07-07T18:15:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.955+0000 7f49c63fe700 1 Processor -- start 2023-07-07T18:15:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49c63fe700 1 -- start start 2023-07-07T18:15:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49c63fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c006e260 0x7f49c00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49c63fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c00aecc0 0x7f49c01e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49c63fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c015fc60 0x7f49c00b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49c63fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00b4ff0 con 0x7f49c00aecc0 2023-07-07T18:15:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49c63fe700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00ca150 con 0x7f49c015fc60 2023-07-07T18:15:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49c63fe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c00ca430 con 0x7f49c006e260 2023-07-07T18:15:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c00aecc0 0x7f49c01e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49bf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c00aecc0 0x7f49c01e5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58416/0 (socket says 172.21.15.12:58416) 2023-07-07T18:15:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.956+0000 7f49bf7fe700 1 -- 172.21.15.12:0/1280593278 learned_addr learned my addr 172.21.15.12:0/1280593278 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bffff700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c006e260 0x7f49c00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49c499b700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c015fc60 0x7f49c00b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bf7fe700 1 -- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c006e260 msgr2=0x7f49c00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bf7fe700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c006e260 0x7f49c00cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bf7fe700 1 -- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c015fc60 msgr2=0x7f49c00b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bf7fe700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c015fc60 0x7f49c00b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bf7fe700 1 -- 172.21.15.12:0/1280593278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4009430 con 0x7f49c00aecc0 2023-07-07T18:15:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bffff700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c006e260 0x7f49c00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49c499b700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c015fc60 0x7f49c00b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bf7fe700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c00aecc0 0x7f49c01e5f10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f49b000e7e0 tx=0x7f49b000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bcff9700 1 -- 172.21.15.12:0/1280593278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0013610 con 0x7f49c00aecc0 2023-07-07T18:15:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bcff9700 1 -- 172.21.15.12:0/1280593278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b0013790 con 0x7f49c00aecc0 2023-07-07T18:15:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c00ca710 con 0x7f49c00aecc0 2023-07-07T18:15:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49bcff9700 1 -- 172.21.15.12:0/1280593278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0013b40 con 0x7f49c00aecc0 2023-07-07T18:15:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.957+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c01e6450 con 0x7f49c00aecc0 2023-07-07T18:15:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.958+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c01e6610 con 0x7f49c00aecc0 2023-07-07T18:15:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.959+0000 7f49bcff9700 1 -- 172.21.15.12:0/1280593278 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49b0013ca0 con 0x7f49c00aecc0 2023-07-07T18:15:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.959+0000 7f49bcff9700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f49ac06ace0 0x7f49ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.959+0000 7f49bcff9700 1 -- 172.21.15.12:0/1280593278 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f49b0089490 con 0x7f49c00aecc0 2023-07-07T18:15:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.959+0000 7f49bffff700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f49ac06ace0 0x7f49ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.960+0000 7f49bffff700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f49ac06ace0 0x7f49ac06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009b70 tx=0x7f49b4008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:40.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:40.964+0000 7f49bcff9700 1 -- 172.21.15.12:0/1280593278 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49b0057ca0 con 0x7f49c00aecc0 2023-07-07T18:15:41.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.161+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f49c004ea20 con 0x7f49c00aecc0 2023-07-07T18:15:41.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.164+0000 7f49bcff9700 1 -- 172.21.15.12:0/1280593278 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f49b0057830 con 0x7f49c00aecc0 2023-07-07T18:15:41.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f49ac06ace0 msgr2=0x7f49ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f49ac06ace0 0x7f49ac06d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009b70 tx=0x7f49b4008070 comp rx=0 tx=0).stop 2023-07-07T18:15:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c00aecc0 msgr2=0x7f49c01e5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c00aecc0 0x7f49c01e5f10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f49b000e7e0 tx=0x7f49b000eba0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 shutdown_connections 2023-07-07T18:15:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f49ac06ace0 0x7f49ac06d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c015fc60 0x7f49c00b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c006e260 0x7f49c00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 --2- 172.21.15.12:0/1280593278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49c00aecc0 0x7f49c01e5f10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.166+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 >> 172.21.15.12:0/1280593278 conn(0x7f49c006b920 msgr2=0x7f49c00cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.167+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 shutdown_connections 2023-07-07T18:15:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.167+0000 7f49c63fe700 1 -- 172.21.15.12:0/1280593278 wait complete. 2023-07-07T18:15:41.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-07T18:15:41.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-07T18:15:41.220 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-07T18:15:41.265 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-07T18:15:41.266 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:15:41.266 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:41.283 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:15:41.283 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:41.340 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:15:41.341 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:41.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.559+0000 7fafbfe75700 1 Processor -- start 2023-07-07T18:15:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.559+0000 7fafbfe75700 1 -- start start 2023-07-07T18:15:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.560+0000 7fafbfe75700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fafb8157a90 0x7fafb815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.560+0000 7fafbfe75700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fafb8069ef0 0x7fafb8070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.560+0000 7fafbfe75700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb80cb580 con 0x7fafb80c95e0 2023-07-07T18:15:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.560+0000 7fafbfe75700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb806db80 con 0x7fafb8069ef0 2023-07-07T18:15:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.560+0000 7fafbfe75700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb815eb10 con 0x7fafb8157a90 2023-07-07T18:15:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.560+0000 7fafbd410700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fafb8069ef0 0x7fafb8070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.560+0000 7fafbe412700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fafb80c95e0 0x7fafb806df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55622/0 (socket says 172.21.15.12:55622) 2023-07-07T18:15:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.560+0000 7fafbe412700 1 -- 172.21.15.12:0/4072571577 learned_addr learned my addr 172.21.15.12:0/4072571577 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbdc11700 1 --2- 172.21.15.12:0/4072571577 >> v2:172.21.15.160:3300/0 conn(0x7fafb8157a90 0x7fafb815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbd410700 1 -- 172.21.15.12:0/4072571577 >> v2:172.21.15.160:3300/0 conn(0x7fafb8157a90 msgr2=0x7fafb815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbd410700 1 --2- 172.21.15.12:0/4072571577 >> v2:172.21.15.160:3300/0 conn(0x7fafb8157a90 0x7fafb815e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbd410700 1 -- 172.21.15.12:0/4072571577 >> v1:172.21.15.12:6789/0 conn(0x7fafb80c95e0 legacy=0x7fafb806df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbd410700 1 -- 172.21.15.12:0/4072571577 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80cafb0 con 0x7fafb8069ef0 2023-07-07T18:15:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbcc0f700 1 -- 172.21.15.12:0/4072571577 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577391351 0 0) 0x7fafb80cb580 con 0x7fafb80c95e0 2023-07-07T18:15:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbdc11700 1 --2- 172.21.15.12:0/4072571577 >> v2:172.21.15.160:3300/0 conn(0x7fafb8157a90 0x7fafb815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbd410700 1 --2- 172.21.15.12:0/4072571577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb8069ef0 0x7fafb8070ae0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fafb8066b30 tx=0x7fafac009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef687aef2b1f9dcb server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbcc0f700 1 -- 172.21.15.12:0/4072571577 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac011830 con 0x7fafb8069ef0 2023-07-07T18:15:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbcc0f700 1 -- 172.21.15.12:0/4072571577 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac011990 con 0x7fafb8069ef0 2023-07-07T18:15:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbcc0f700 1 -- 172.21.15.12:0/4072571577 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac011d20 con 0x7fafb8069ef0 2023-07-07T18:15:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbfe75700 1 -- 172.21.15.12:0/4072571577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb8069ef0 msgr2=0x7fafb8070ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbfe75700 1 --2- 172.21.15.12:0/4072571577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb8069ef0 0x7fafb8070ae0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fafb8066b30 tx=0x7fafac009b20 comp rx=0 tx=0).stop 2023-07-07T18:15:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.561+0000 7fafbfe75700 1 -- 172.21.15.12:0/4072571577 shutdown_connections 2023-07-07T18:15:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.562+0000 7fafbfe75700 1 --2- 172.21.15.12:0/4072571577 >> v2:172.21.15.160:3300/0 conn(0x7fafb8157a90 0x7fafb815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.562+0000 7fafbfe75700 1 --2- 172.21.15.12:0/4072571577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb8069ef0 0x7fafb8070ae0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.562+0000 7fafbfe75700 1 -- 172.21.15.12:0/4072571577 >> 172.21.15.12:0/4072571577 conn(0x7fafb80b1740 msgr2=0x7fafb806cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.562+0000 7fafbfe75700 1 -- 172.21.15.12:0/4072571577 shutdown_connections 2023-07-07T18:15:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.562+0000 7fafbfe75700 1 -- 172.21.15.12:0/4072571577 wait complete. 2023-07-07T18:15:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.563+0000 7fafbfe75700 1 Processor -- start 2023-07-07T18:15:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.563+0000 7fafbfe75700 1 -- start start 2023-07-07T18:15:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbfe75700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb8069ef0 0x7fafb81f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbfe75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb80c95e0 0x7fafb806e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbfe75700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb8157a90 0x7fafb806e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbfe75700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80abc20 con 0x7fafb80c95e0 2023-07-07T18:15:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbfe75700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb806eef0 con 0x7fafb8157a90 2023-07-07T18:15:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbfe75700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80c70b0 con 0x7fafb8069ef0 2023-07-07T18:15:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbd410700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb80c95e0 0x7fafb806e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbd410700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb80c95e0 0x7fafb806e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58428/0 (socket says 172.21.15.12:58428) 2023-07-07T18:15:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbd410700 1 -- 172.21.15.12:0/622257081 learned_addr learned my addr 172.21.15.12:0/622257081 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbdc11700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb8069ef0 0x7fafb81f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbe412700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb8157a90 0x7fafb806e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbd410700 1 -- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb8069ef0 msgr2=0x7fafb81f0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbd410700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb8069ef0 0x7fafb81f0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbd410700 1 -- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb8157a90 msgr2=0x7fafb806e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbd410700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb8157a90 0x7fafb806e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbd410700 1 -- 172.21.15.12:0/622257081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0094a0 con 0x7fafb80c95e0 2023-07-07T18:15:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbdc11700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb8069ef0 0x7fafb81f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbe412700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb8157a90 0x7fafb806e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbd410700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb80c95e0 0x7fafb806e310 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fafac000c00 tx=0x7fafac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafaa7fc700 1 -- 172.21.15.12:0/622257081 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac0038a0 con 0x7fafb80c95e0 2023-07-07T18:15:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafaa7fc700 1 -- 172.21.15.12:0/622257081 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac01f070 con 0x7fafb80c95e0 2023-07-07T18:15:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb80c7390 con 0x7fafb80c95e0 2023-07-07T18:15:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafaa7fc700 1 -- 172.21.15.12:0/622257081 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac003c40 con 0x7fafb80c95e0 2023-07-07T18:15:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.564+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb80c7950 con 0x7fafb80c95e0 2023-07-07T18:15:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.565+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb8073910 con 0x7fafb80c95e0 2023-07-07T18:15:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.566+0000 7fafaa7fc700 1 -- 172.21.15.12:0/622257081 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafac026480 con 0x7fafb80c95e0 2023-07-07T18:15:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.566+0000 7fafaa7fc700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9c06ace0 0x7faf9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.566+0000 7fafaa7fc700 1 -- 172.21.15.12:0/622257081 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafac021070 con 0x7fafb80c95e0 2023-07-07T18:15:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.567+0000 7fafbdc11700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9c06ace0 0x7faf9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.567+0000 7fafbdc11700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9c06ace0 0x7faf9c06d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fafb4008910 tx=0x7fafb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.571+0000 7fafaa7fc700 1 -- 172.21.15.12:0/622257081 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fafac056020 con 0x7fafb80c95e0 2023-07-07T18:15:41.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.768+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafb80c93a0 con 0x7fafb80c95e0 2023-07-07T18:15:41.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.769+0000 7fafaa7fc700 1 -- 172.21.15.12:0/622257081 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7fafac059640 con 0x7fafb80c95e0 2023-07-07T18:15:41.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:41.771 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:41.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9c06ace0 msgr2=0x7faf9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9c06ace0 0x7faf9c06d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fafb4008910 tx=0x7fafb4008040 comp rx=0 tx=0).stop 2023-07-07T18:15:41.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb80c95e0 msgr2=0x7fafb806e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb80c95e0 0x7fafb806e310 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fafac000c00 tx=0x7fafac004750 comp rx=0 tx=0).stop 2023-07-07T18:15:41.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 shutdown_connections 2023-07-07T18:15:41.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7faf9c06ace0 0x7faf9c06d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb8157a90 0x7fafb806e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb8069ef0 0x7fafb81f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 --2- 172.21.15.12:0/622257081 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb80c95e0 0x7fafb806e310 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 >> 172.21.15.12:0/622257081 conn(0x7fafb80b1740 msgr2=0x7fafb80af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:41.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 shutdown_connections 2023-07-07T18:15:41.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.771+0000 7fafbfe75700 1 -- 172.21.15.12:0/622257081 wait complete. 2023-07-07T18:15:41.785 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:41.786 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.913+0000 7f4f57e5a700 1 Processor -- start 2023-07-07T18:15:41.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.913+0000 7f4f57e5a700 1 -- start start 2023-07-07T18:15:41.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.914+0000 7f4f57e5a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf590 0x7f4f500d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.914+0000 7f4f57e5a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4f500cd1d0 0x7f4f5015d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.914+0000 7f4f57e5a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f5015d7c0 con 0x7f4f500cf960 2023-07-07T18:15:41.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.914+0000 7f4f57e5a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f500cd9b0 con 0x7f4f500cd1d0 2023-07-07T18:15:41.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.914+0000 7f4f57e5a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500b55b0 con 0x7f4f500cf590 2023-07-07T18:15:41.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.914+0000 7f4f563f7700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4f500cf960 0x7f4f500d0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55636/0 (socket says 172.21.15.12:55636) 2023-07-07T18:15:41.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.914+0000 7f4f563f7700 1 -- 172.21.15.12:0/4188312316 learned_addr learned my addr 172.21.15.12:0/4188312316 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:41.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f55bf6700 1 --2- 172.21.15.12:0/4188312316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf590 0x7f4f500d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f553f5700 1 --2- 172.21.15.12:0/4188312316 >> v2:172.21.15.160:3300/0 conn(0x7f4f500cd1d0 0x7f4f5015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f54bf4700 1 -- 172.21.15.12:0/4188312316 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206444322 0 0) 0x7f4f5015d7c0 con 0x7f4f500cf960 2023-07-07T18:15:41.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f54bf4700 1 -- 172.21.15.12:0/4188312316 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f3c0035b0 con 0x7f4f500cf960 2023-07-07T18:15:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f54bf4700 1 -- 172.21.15.12:0/4188312316 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4102925074 0 0) 0x7f4f3c0035b0 con 0x7f4f500cf960 2023-07-07T18:15:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f55bf6700 1 -- 172.21.15.12:0/4188312316 >> v2:172.21.15.160:3300/0 conn(0x7f4f500cd1d0 msgr2=0x7f4f5015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f55bf6700 1 --2- 172.21.15.12:0/4188312316 >> v2:172.21.15.160:3300/0 conn(0x7f4f500cd1d0 0x7f4f5015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f55bf6700 1 -- 172.21.15.12:0/4188312316 >> v1:172.21.15.12:6789/0 conn(0x7f4f500cf960 legacy=0x7f4f500d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f55bf6700 1 -- 172.21.15.12:0/4188312316 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f500cd6d0 con 0x7f4f500cf590 2023-07-07T18:15:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f553f5700 1 --2- 172.21.15.12:0/4188312316 >> v2:172.21.15.160:3300/0 conn(0x7f4f500cd1d0 0x7f4f5015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f55bf6700 1 --2- 172.21.15.12:0/4188312316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf590 0x7f4f500d3600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009840 tx=0x7f4f4c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8840102e2d615a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:41.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f54bf4700 1 -- 172.21.15.12:0/4188312316 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f480019f0 con 0x7f4f500cf590 2023-07-07T18:15:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f54bf4700 1 -- 172.21.15.12:0/4188312316 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c004030 con 0x7f4f500cf590 2023-07-07T18:15:41.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.915+0000 7f4f54bf4700 1 -- 172.21.15.12:0/4188312316 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0043a0 con 0x7f4f500cf590 2023-07-07T18:15:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.916+0000 7f4f57e5a700 1 -- 172.21.15.12:0/4188312316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf590 msgr2=0x7f4f500d3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.916+0000 7f4f57e5a700 1 --2- 172.21.15.12:0/4188312316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf590 0x7f4f500d3600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009840 tx=0x7f4f4c009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.916+0000 7f4f57e5a700 1 -- 172.21.15.12:0/4188312316 shutdown_connections 2023-07-07T18:15:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.916+0000 7f4f57e5a700 1 --2- 172.21.15.12:0/4188312316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf590 0x7f4f500d3600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.916+0000 7f4f57e5a700 1 --2- 172.21.15.12:0/4188312316 >> v2:172.21.15.160:3300/0 conn(0x7f4f500cd1d0 0x7f4f5015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.916+0000 7f4f57e5a700 1 -- 172.21.15.12:0/4188312316 >> 172.21.15.12:0/4188312316 conn(0x7f4f5006b3b0 msgr2=0x7f4f5006b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.916+0000 7f4f57e5a700 1 -- 172.21.15.12:0/4188312316 shutdown_connections 2023-07-07T18:15:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.916+0000 7f4f57e5a700 1 -- 172.21.15.12:0/4188312316 wait complete. 2023-07-07T18:15:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.917+0000 7f4f57e5a700 1 Processor -- start 2023-07-07T18:15:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.917+0000 7f4f57e5a700 1 -- start start 2023-07-07T18:15:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f57e5a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f500cd1d0 0x7f4f50154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f57e5a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f500cf590 0x7f4f501f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f57e5a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf960 0x7f4f501f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f57e5a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500cb250 con 0x7f4f500cd1d0 2023-07-07T18:15:41.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f57e5a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500ca660 con 0x7f4f500cf590 2023-07-07T18:15:41.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f57e5a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f500ca920 con 0x7f4f500cf960 2023-07-07T18:15:41.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f55bf6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f500cd1d0 0x7f4f50154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f55bf6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f500cd1d0 0x7f4f50154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58440/0 (socket says 172.21.15.12:58440) 2023-07-07T18:15:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f55bf6700 1 -- 172.21.15.12:0/1541441986 learned_addr learned my addr 172.21.15.12:0/1541441986 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f553f5700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f500cf590 0x7f4f501f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f563f7700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf960 0x7f4f501f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f55bf6700 1 -- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf960 msgr2=0x7f4f501f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f55bf6700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf960 0x7f4f501f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f55bf6700 1 -- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f500cf590 msgr2=0x7f4f501f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f55bf6700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f500cf590 0x7f4f501f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:41.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f55bf6700 1 -- 172.21.15.12:0/1541441986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f400094a0 con 0x7f4f500cd1d0 2023-07-07T18:15:41.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.918+0000 7f4f563f7700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf960 0x7f4f501f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:41.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.919+0000 7f4f55bf6700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f500cd1d0 0x7f4f50154df0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00a010 tx=0x7f4f4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:41.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.919+0000 7f4f467fc700 1 -- 172.21.15.12:0/1541441986 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c004570 con 0x7f4f500cd1d0 2023-07-07T18:15:41.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.919+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c0094a0 con 0x7f4f500cd1d0 2023-07-07T18:15:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.919+0000 7f4f467fc700 1 -- 172.21.15.12:0/1541441986 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c01f070 con 0x7f4f500cd1d0 2023-07-07T18:15:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.919+0000 7f4f467fc700 1 -- 172.21.15.12:0/1541441986 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c011870 con 0x7f4f500cd1d0 2023-07-07T18:15:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.919+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f500caee0 con 0x7f4f500cd1d0 2023-07-07T18:15:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.920+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5004ea20 con 0x7f4f500cd1d0 2023-07-07T18:15:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.920+0000 7f4f467fc700 1 -- 172.21.15.12:0/1541441986 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f4c0119d0 con 0x7f4f500cd1d0 2023-07-07T18:15:41.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.921+0000 7f4f467fc700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4f3406ace0 0x7f4f3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:41.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.921+0000 7f4f467fc700 1 -- 172.21.15.12:0/1541441986 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f4c021070 con 0x7f4f500cd1d0 2023-07-07T18:15:41.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.921+0000 7f4f553f5700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4f3406ace0 0x7f4f3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:41.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.921+0000 7f4f553f5700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4f3406ace0 0x7f4f3406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4f500b7b50 tx=0x7f4f40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:41.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:41.925+0000 7f4f467fc700 1 -- 172.21.15.12:0/1541441986 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f4c055ee0 con 0x7f4f500cd1d0 2023-07-07T18:15:42.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.120+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f500b22c0 con 0x7f4f500cd1d0 2023-07-07T18:15:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.121+0000 7f4f467fc700 1 -- 172.21.15.12:0/1541441986 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f4c059500 con 0x7f4f500cd1d0 2023-07-07T18:15:42.123 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4f3406ace0 msgr2=0x7f4f3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4f3406ace0 0x7f4f3406d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4f500b7b50 tx=0x7f4f40008040 comp rx=0 tx=0).stop 2023-07-07T18:15:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f500cd1d0 msgr2=0x7f4f50154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f500cd1d0 0x7f4f50154df0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00a010 tx=0x7f4f4c004750 comp rx=0 tx=0).stop 2023-07-07T18:15:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 shutdown_connections 2023-07-07T18:15:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4f3406ace0 0x7f4f3406d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f500cf960 0x7f4f501f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f500cd1d0 0x7f4f50154df0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 --2- 172.21.15.12:0/1541441986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f500cf590 0x7f4f501f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 >> 172.21.15.12:0/1541441986 conn(0x7f4f5006b3b0 msgr2=0x7f4f500d1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 shutdown_connections 2023-07-07T18:15:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.123+0000 7f4f57e5a700 1 -- 172.21.15.12:0/1541441986 wait complete. 2023-07-07T18:15:42.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:42.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.264+0000 7fe000a57700 1 Processor -- start 2023-07-07T18:15:42.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.264+0000 7fe000a57700 1 -- start start 2023-07-07T18:15:42.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fe000a57700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdffc0d3600 0x7fdffc15d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fe000a57700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc15d7c0 con 0x7fdffc0cd1d0 2023-07-07T18:15:42.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fe000a57700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdffc0cd6d0 con 0x7fdffc0cf590 2023-07-07T18:15:42.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fe000a57700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0cd9b0 con 0x7fdffc0d3600 2023-07-07T18:15:42.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fdff9d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdffc0cd1d0 0x7fdffc0d0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55644/0 (socket says 172.21.15.12:55644) 2023-07-07T18:15:42.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fdff9d9b700 1 -- 172.21.15.12:0/1196797448 learned_addr learned my addr 172.21.15.12:0/1196797448 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:42.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fdffad9d700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdffc0d3600 0x7fdffc15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270115663 0 0) 0x7fdffc15d7c0 con 0x7fdffc0cd1d0 2023-07-07T18:15:42.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfe40035b0 con 0x7fdffc0cd1d0 2023-07-07T18:15:42.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661868954 0 0) 0x7fdffc0cd6d0 con 0x7fdffc0cf590 2023-07-07T18:15:42.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdffc15d7c0 con 0x7fdffc0cf590 2023-07-07T18:15:42.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.265+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847531207 0 0) 0x7fdfe40035b0 con 0x7fdffc0cd1d0 2023-07-07T18:15:42.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdffc0d3600 msgr2=0x7fdffc15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:42.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdffc0d3600 0x7fdffc15d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 >> v1:172.21.15.160:6789/0 conn(0x7fdffc0cf590 legacy=0x7fdffc0cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0d2b20 con 0x7fdffc0cd1d0 2023-07-07T18:15:42.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fdff0001670 con 0x7fdffc0cd1d0 2023-07-07T18:15:42.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 >> v1:172.21.15.12:6789/0 conn(0x7fdffc0cd1d0 legacy=0x7fdffc0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe4003bc0 0x7fdfe4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfe4004850 0x7fdfe4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdffc0d3600 0x7fdfe4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0cd9b0 con 0x7fdfe4003bc0 2023-07-07T18:15:42.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe400bac0 con 0x7fdfe4004850 2023-07-07T18:15:42.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe400bc80 con 0x7fdffc0d3600 2023-07-07T18:15:42.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdffa59c700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe4003bc0 0x7fdfe4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff9d9b700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfe4004850 0x7fdfe4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdffad9d700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdffc0d3600 0x7fdfe4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdffa59c700 1 -- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdffc0d3600 msgr2=0x7fdfe4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:42.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdffa59c700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdffc0d3600 0x7fdfe4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdffa59c700 1 -- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfe4004850 msgr2=0x7fdfe4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:42.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdffa59c700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfe4004850 0x7fdfe4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdffa59c700 1 -- 172.21.15.12:0/1196797448 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe40035b0 con 0x7fdfe4003bc0 2023-07-07T18:15:42.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdffa59c700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe4003bc0 0x7fdfe4003fb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdfec007fd0 tx=0x7fdfe4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70ab0a5817f1cff server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:42.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec001d80 con 0x7fdfe4003bc0 2023-07-07T18:15:42.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec0052d0 con 0x7fdfe4003bc0 2023-07-07T18:15:42.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.266+0000 7fdff959a700 1 -- 172.21.15.12:0/1196797448 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec001470 con 0x7fdfe4003bc0 2023-07-07T18:15:42.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.267+0000 7fe000a57700 1 -- 172.21.15.12:0/1196797448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe4003bc0 msgr2=0x7fdfe4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.267+0000 7fe000a57700 1 --2- 172.21.15.12:0/1196797448 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdfe4003bc0 0x7fdfe4003fb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdfec007fd0 tx=0x7fdfe4005880 comp rx=0 tx=0).stop 2023-07-07T18:15:42.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.267+0000 7fdffad9d700 1 -- 172.21.15.12:0/1196797448 reap_dead start 2023-07-07T18:15:42.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.267+0000 7fe000a57700 1 -- 172.21.15.12:0/1196797448 shutdown_connections 2023-07-07T18:15:42.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.267+0000 7fe000a57700 1 -- 172.21.15.12:0/1196797448 >> 172.21.15.12:0/1196797448 conn(0x7fdffc06b3b0 msgr2=0x7fdffc06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:42.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.267+0000 7fe000a57700 1 -- 172.21.15.12:0/1196797448 shutdown_connections 2023-07-07T18:15:42.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.267+0000 7fe000a57700 1 -- 172.21.15.12:0/1196797448 wait complete. 2023-07-07T18:15:42.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.268+0000 7fe000a57700 1 Processor -- start 2023-07-07T18:15:42.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.268+0000 7fe000a57700 1 -- start start 2023-07-07T18:15:42.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fe000a57700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfe4003bc0 0x7fdffc142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fe000a57700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdffc150790 0x7fdffc0c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fe000a57700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdffc0d0880 0x7fdffc0d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fe000a57700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0d1240 con 0x7fdffc150790 2023-07-07T18:15:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fe000a57700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc0c91c0 con 0x7fdffc0d0880 2023-07-07T18:15:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fe000a57700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc1433f0 con 0x7fdfe4003bc0 2023-07-07T18:15:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fdff9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdffc150790 0x7fdffc0c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fdff9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdffc150790 0x7fdffc0c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58460/0 (socket says 172.21.15.12:58460) 2023-07-07T18:15:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fdff9d9b700 1 -- 172.21.15.12:0/3693154362 learned_addr learned my addr 172.21.15.12:0/3693154362 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fdffad9d700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdffc0d0880 0x7fdffc0d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.269+0000 7fdffa59c700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfe4003bc0 0x7fdffc142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fdff9d9b700 1 -- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfe4003bc0 msgr2=0x7fdffc142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fdff9d9b700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfe4003bc0 0x7fdffc142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fdff9d9b700 1 -- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdffc0d0880 msgr2=0x7fdffc0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fdff9d9b700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdffc0d0880 0x7fdffc0d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fdff9d9b700 1 -- 172.21.15.12:0/3693154362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdffc0c8ee0 con 0x7fdffc150790 2023-07-07T18:15:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fdff9d9b700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdffc150790 0x7fdffc0c8570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdff0004f60 tx=0x7fdff0004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fdfeaffd700 1 -- 172.21.15.12:0/3693154362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0012560 con 0x7fdffc150790 2023-07-07T18:15:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fdfeaffd700 1 -- 172.21.15.12:0/3693154362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff0012720 con 0x7fdffc150790 2023-07-07T18:15:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc0b5ae0 con 0x7fdffc150790 2023-07-07T18:15:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fdfeaffd700 1 -- 172.21.15.12:0/3693154362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff0012ad0 con 0x7fdffc150790 2023-07-07T18:15:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.270+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc0b60a0 con 0x7fdffc150790 2023-07-07T18:15:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.271+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc04ea20 con 0x7fdffc150790 2023-07-07T18:15:42.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.271+0000 7fdfeaffd700 1 -- 172.21.15.12:0/3693154362 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdff0012c30 con 0x7fdffc150790 2023-07-07T18:15:42.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.272+0000 7fdfeaffd700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfdc06ace0 0x7fdfdc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.272+0000 7fdfeaffd700 1 -- 172.21.15.12:0/3693154362 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdff00896a0 con 0x7fdffc150790 2023-07-07T18:15:42.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.272+0000 7fdffa59c700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfdc06ace0 0x7fdfdc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.272+0000 7fdffa59c700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfdc06ace0 0x7fdfdc06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfec005040 tx=0x7fdfec00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:42.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.276+0000 7fdfeaffd700 1 -- 172.21.15.12:0/3693154362 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdff00544b0 con 0x7fdffc150790 2023-07-07T18:15:42.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.476+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdffc0b22c0 con 0x7fdffc150790 2023-07-07T18:15:42.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.476+0000 7fdfeaffd700 1 -- 172.21.15.12:0/3693154362 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdff0057ad0 con 0x7fdffc150790 2023-07-07T18:15:42.478 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:42.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfdc06ace0 msgr2=0x7fdfdc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfdc06ace0 0x7fdfdc06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfec005040 tx=0x7fdfec00a000 comp rx=0 tx=0).stop 2023-07-07T18:15:42.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdffc150790 msgr2=0x7fdffc0c8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdffc150790 0x7fdffc0c8570 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdff0004f60 tx=0x7fdff0004f90 comp rx=0 tx=0).stop 2023-07-07T18:15:42.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 shutdown_connections 2023-07-07T18:15:42.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdfdc06ace0 0x7fdfdc06d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdffc0d0880 0x7fdffc0d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfe4003bc0 0x7fdffc142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 --2- 172.21.15.12:0/3693154362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdffc150790 0x7fdffc0c8570 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 >> 172.21.15.12:0/3693154362 conn(0x7fdffc06b3b0 msgr2=0x7fdffc15c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:42.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 shutdown_connections 2023-07-07T18:15:42.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.478+0000 7fe000a57700 1 -- 172.21.15.12:0/3693154362 wait complete. 2023-07-07T18:15:42.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:42.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.617+0000 7f5558313700 1 Processor -- start 2023-07-07T18:15:42.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.617+0000 7f5558313700 1 -- start start 2023-07-07T18:15:42.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.618+0000 7f5558313700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5550158960 0x7f5550158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.618+0000 7f5558313700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5550070dc0 0x7f555015cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.618+0000 7f5558313700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f555015d100 0x7f555006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.618+0000 7f5558313700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555006b8f0 con 0x7f5550158960 2023-07-07T18:15:42.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.618+0000 7f5558313700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555015c450 con 0x7f5550070dc0 2023-07-07T18:15:42.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.618+0000 7f5558313700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5550159640 con 0x7f555015d100 2023-07-07T18:15:42.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55560af700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5550158960 0x7f5550158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55560af700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5550158960 0x7f5550158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58466/0 (socket says 172.21.15.12:58466) 2023-07-07T18:15:42.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55560af700 1 -- 172.21.15.12:0/375728846 learned_addr learned my addr 172.21.15.12:0/375728846 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55568b0700 1 --2- 172.21.15.12:0/375728846 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f555015d100 0x7f555006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55560af700 1 -- 172.21.15.12:0/375728846 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f555015d100 msgr2=0x7f555006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55558ae700 1 --2- 172.21.15.12:0/375728846 >> v2:172.21.15.160:3300/0 conn(0x7f5550070dc0 0x7f555015cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55560af700 1 --2- 172.21.15.12:0/375728846 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f555015d100 0x7f555006ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55560af700 1 -- 172.21.15.12:0/375728846 >> v2:172.21.15.160:3300/0 conn(0x7f5550070dc0 msgr2=0x7f555015cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55560af700 1 --2- 172.21.15.12:0/375728846 >> v2:172.21.15.160:3300/0 conn(0x7f5550070dc0 0x7f555015cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55560af700 1 -- 172.21.15.12:0/375728846 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5550159920 con 0x7f5550158960 2023-07-07T18:15:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55560af700 1 --2- 172.21.15.12:0/375728846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5550158960 0x7f5550158d30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5550072260 tx=0x7f554c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925f18a2f91ae9cd server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55550ad700 1 -- 172.21.15.12:0/375728846 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00b870 con 0x7f5550158960 2023-07-07T18:15:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55550ad700 1 -- 172.21.15.12:0/375728846 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c00b9d0 con 0x7f5550158960 2023-07-07T18:15:42.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.619+0000 7f55550ad700 1 -- 172.21.15.12:0/375728846 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c00bd60 con 0x7f5550158960 2023-07-07T18:15:42.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.620+0000 7f5558313700 1 -- 172.21.15.12:0/375728846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5550158960 msgr2=0x7f5550158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.620+0000 7f5558313700 1 --2- 172.21.15.12:0/375728846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5550158960 0x7f5550158d30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5550072260 tx=0x7f554c009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.620+0000 7f5558313700 1 -- 172.21.15.12:0/375728846 shutdown_connections 2023-07-07T18:15:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.620+0000 7f5558313700 1 --2- 172.21.15.12:0/375728846 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f555015d100 0x7f555006ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.620+0000 7f5558313700 1 --2- 172.21.15.12:0/375728846 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5550158960 0x7f5550158d30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.620+0000 7f5558313700 1 --2- 172.21.15.12:0/375728846 >> v2:172.21.15.160:3300/0 conn(0x7f5550070dc0 0x7f555015cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.620+0000 7f5558313700 1 -- 172.21.15.12:0/375728846 >> 172.21.15.12:0/375728846 conn(0x7f55500b1990 msgr2=0x7f55500cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.620+0000 7f5558313700 1 -- 172.21.15.12:0/375728846 shutdown_connections 2023-07-07T18:15:42.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.620+0000 7f5558313700 1 -- 172.21.15.12:0/375728846 wait complete. 2023-07-07T18:15:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.621+0000 7f5558313700 1 Processor -- start 2023-07-07T18:15:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.621+0000 7f5558313700 1 -- start start 2023-07-07T18:15:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f5558313700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5550070dc0 0x7f555014fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f5558313700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5550158960 0x7f55501526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f5558313700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f555015d100 0x7f55501506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f5558313700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555014ef80 con 0x7f555015d100 2023-07-07T18:15:42.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f5558313700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555014f1f0 con 0x7f5550070dc0 2023-07-07T18:15:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f5558313700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555014f4d0 con 0x7f5550158960 2023-07-07T18:15:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55568b0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f555015d100 0x7f55501506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55568b0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f555015d100 0x7f55501506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58476/0 (socket says 172.21.15.12:58476) 2023-07-07T18:15:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55568b0700 1 -- 172.21.15.12:0/2065388386 learned_addr learned my addr 172.21.15.12:0/2065388386 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55560af700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5550070dc0 0x7f555014fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55558ae700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5550158960 0x7f55501526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55568b0700 1 -- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5550158960 msgr2=0x7f55501526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55568b0700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5550158960 0x7f55501526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55568b0700 1 -- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5550070dc0 msgr2=0x7f555014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55568b0700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5550070dc0 0x7f555014fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.622+0000 7f55568b0700 1 -- 172.21.15.12:0/2065388386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c009550 con 0x7f555015d100 2023-07-07T18:15:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.623+0000 7f55568b0700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f555015d100 0x7f55501506a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f554800c5e0 tx=0x7f554800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.623+0000 7f5542ffd700 1 -- 172.21.15.12:0/2065388386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548004220 con 0x7f555015d100 2023-07-07T18:15:42.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.623+0000 7f5542ffd700 1 -- 172.21.15.12:0/2065388386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55480043a0 con 0x7f555015d100 2023-07-07T18:15:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.623+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555014f7b0 con 0x7f555015d100 2023-07-07T18:15:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.623+0000 7f5542ffd700 1 -- 172.21.15.12:0/2065388386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55480038e0 con 0x7f555015d100 2023-07-07T18:15:42.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.623+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5550151080 con 0x7f555015d100 2023-07-07T18:15:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.624+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555014f9d0 con 0x7f555015d100 2023-07-07T18:15:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.624+0000 7f5542ffd700 1 -- 172.21.15.12:0/2065388386 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5548003a40 con 0x7f555015d100 2023-07-07T18:15:42.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.625+0000 7f5542ffd700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f553406ace0 0x7f553406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.625+0000 7f5542ffd700 1 -- 172.21.15.12:0/2065388386 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5548089240 con 0x7f555015d100 2023-07-07T18:15:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.625+0000 7f55560af700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f553406ace0 0x7f553406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.626+0000 7f55560af700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f553406ace0 0x7f553406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f554c000c00 tx=0x7f554c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:42.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.629+0000 7f5542ffd700 1 -- 172.21.15.12:0/2065388386 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5548053f20 con 0x7f555015d100 2023-07-07T18:15:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.826+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f555004ea20 con 0x7f555015d100 2023-07-07T18:15:42.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.826+0000 7f5542ffd700 1 -- 172.21.15.12:0/2065388386 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5548057540 con 0x7f555015d100 2023-07-07T18:15:42.828 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f553406ace0 msgr2=0x7f553406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f553406ace0 0x7f553406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f554c000c00 tx=0x7f554c008030 comp rx=0 tx=0).stop 2023-07-07T18:15:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f555015d100 msgr2=0x7f55501506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f555015d100 0x7f55501506a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f554800c5e0 tx=0x7f554800c8f0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 shutdown_connections 2023-07-07T18:15:42.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f553406ace0 0x7f553406d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f555015d100 0x7f55501506a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5550070dc0 0x7f555014fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 --2- 172.21.15.12:0/2065388386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5550158960 0x7f55501526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 >> 172.21.15.12:0/2065388386 conn(0x7f55500b1990 msgr2=0x7f555006a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 shutdown_connections 2023-07-07T18:15:42.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.829+0000 7f5558313700 1 -- 172.21.15.12:0/2065388386 wait complete. 2023-07-07T18:15:42.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:42.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.969+0000 7fdcd2956700 1 Processor -- start 2023-07-07T18:15:42.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.969+0000 7fdcd2956700 1 -- start start 2023-07-07T18:15:42.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdcd2956700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc15fc60 0x7fdccc06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdcd2956700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdccc06e970 0x7fdccc0ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdcd2956700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0ce620 con 0x7fdccc0aecc0 2023-07-07T18:15:42.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdcd2956700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc160580 con 0x7fdccc06e970 2023-07-07T18:15:42.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdcd2956700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc160860 con 0x7fdccc15fc60 2023-07-07T18:15:42.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdccbfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc15fc60 0x7fdccc06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdcd0ef3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdccc06e970 0x7fdccc0ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdccb7fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fdccc0aecc0 0x7fdccc06e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:48918/0 (socket says 172.21.15.12:48918) 2023-07-07T18:15:42.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdccb7fe700 1 -- 172.21.15.12:0/230242451 learned_addr learned my addr 172.21.15.12:0/230242451 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:42.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdccbfff700 1 -- 172.21.15.12:0/230242451 >> v2:172.21.15.160:3300/0 conn(0x7fdccc06e970 msgr2=0x7fdccc0ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:42.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdccbfff700 1 --2- 172.21.15.12:0/230242451 >> v2:172.21.15.160:3300/0 conn(0x7fdccc06e970 0x7fdccc0ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdccbfff700 1 -- 172.21.15.12:0/230242451 >> v1:172.21.15.160:6789/0 conn(0x7fdccc0aecc0 legacy=0x7fdccc06e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdccbfff700 1 -- 172.21.15.12:0/230242451 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc160b40 con 0x7fdccc15fc60 2023-07-07T18:15:42.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.970+0000 7fdcd0ef3700 1 --2- 172.21.15.12:0/230242451 >> v2:172.21.15.160:3300/0 conn(0x7fdccc06e970 0x7fdccc0ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:42.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdccbfff700 1 --2- 172.21.15.12:0/230242451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc15fc60 0x7fdccc06a900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009820 tx=0x7fdcbc009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b537902750d6a8fe server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:42.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdccaffd700 1 -- 172.21.15.12:0/230242451 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc005e30 con 0x7fdccc15fc60 2023-07-07T18:15:42.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdccaffd700 1 -- 172.21.15.12:0/230242451 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc006030 con 0x7fdccc15fc60 2023-07-07T18:15:42.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdccaffd700 1 -- 172.21.15.12:0/230242451 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0063c0 con 0x7fdccc15fc60 2023-07-07T18:15:42.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdcd2956700 1 -- 172.21.15.12:0/230242451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc15fc60 msgr2=0x7fdccc06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdcd2956700 1 --2- 172.21.15.12:0/230242451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc15fc60 0x7fdccc06a900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009820 tx=0x7fdcbc009b30 comp rx=0 tx=0).stop 2023-07-07T18:15:42.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdcd2956700 1 -- 172.21.15.12:0/230242451 shutdown_connections 2023-07-07T18:15:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdcd2956700 1 --2- 172.21.15.12:0/230242451 >> v2:172.21.15.160:3300/0 conn(0x7fdccc06e970 0x7fdccc0ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdcd2956700 1 --2- 172.21.15.12:0/230242451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc15fc60 0x7fdccc06a900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdcd2956700 1 -- 172.21.15.12:0/230242451 >> 172.21.15.12:0/230242451 conn(0x7fdccc06b920 msgr2=0x7fdccc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdcd2956700 1 -- 172.21.15.12:0/230242451 shutdown_connections 2023-07-07T18:15:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.971+0000 7fdcd2956700 1 -- 172.21.15.12:0/230242451 wait complete. 2023-07-07T18:15:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.973+0000 7fdcd2956700 1 Processor -- start 2023-07-07T18:15:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.973+0000 7fdcd2956700 1 -- start start 2023-07-07T18:15:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd2956700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc06e970 0x7fdccc0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd2956700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdccc0aecc0 0x7fdccc1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd2956700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdccc15fc60 0x7fdccc0b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd2956700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0ca9d0 con 0x7fdccc15fc60 2023-07-07T18:15:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd2956700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b47a0 con 0x7fdccc0aecc0 2023-07-07T18:15:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd2956700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b40d0 con 0x7fdccc06e970 2023-07-07T18:15:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd0ef3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdccc15fc60 0x7fdccc0b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd0ef3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdccc15fc60 0x7fdccc0b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58488/0 (socket says 172.21.15.12:58488) 2023-07-07T18:15:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdccb7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdccc0aecc0 0x7fdccc1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdccbfff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc06e970 0x7fdccc0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd0ef3700 1 -- 172.21.15.12:0/3993500347 learned_addr learned my addr 172.21.15.12:0/3993500347 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd0ef3700 1 -- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc06e970 msgr2=0x7fdccc0b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd0ef3700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc06e970 0x7fdccc0b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd0ef3700 1 -- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdccc0aecc0 msgr2=0x7fdccc1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd0ef3700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdccc0aecc0 0x7fdccc1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd0ef3700 1 -- 172.21.15.12:0/3993500347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4009a70 con 0x7fdccc15fc60 2023-07-07T18:15:42.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdccb7fe700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdccc0aecc0 0x7fdccc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcd0ef3700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdccc15fc60 0x7fdccc0b4c10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400efb0 tx=0x7fdcc400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.974+0000 7fdcc8ff9700 1 -- 172.21.15.12:0/3993500347 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400cc90 con 0x7fdccc15fc60 2023-07-07T18:15:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.975+0000 7fdcc8ff9700 1 -- 172.21.15.12:0/3993500347 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc400f040 con 0x7fdccc15fc60 2023-07-07T18:15:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.975+0000 7fdcc8ff9700 1 -- 172.21.15.12:0/3993500347 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4014480 con 0x7fdccc15fc60 2023-07-07T18:15:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.975+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc009430 con 0x7fdccc15fc60 2023-07-07T18:15:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.975+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc0ca380 con 0x7fdccc15fc60 2023-07-07T18:15:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.976+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc06e790 con 0x7fdccc15fc60 2023-07-07T18:15:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.976+0000 7fdcc8ff9700 1 -- 172.21.15.12:0/3993500347 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdcc40145e0 con 0x7fdccc15fc60 2023-07-07T18:15:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.976+0000 7fdcc8ff9700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcb806ace0 0x7fdcb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.976+0000 7fdcc8ff9700 1 -- 172.21.15.12:0/3993500347 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdcc408a350 con 0x7fdccc15fc60 2023-07-07T18:15:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.977+0000 7fdccbfff700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcb806ace0 0x7fdcb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.977+0000 7fdccbfff700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcb806ace0 0x7fdcb806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:42.981+0000 7fdcc8ff9700 1 -- 172.21.15.12:0/3993500347 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdcc4058bf0 con 0x7fdccc15fc60 2023-07-07T18:15:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.176+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdccc04ea20 con 0x7fdccc15fc60 2023-07-07T18:15:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.177+0000 7fdcc8ff9700 1 -- 172.21.15.12:0/3993500347 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdcc4009d50 con 0x7fdccc15fc60 2023-07-07T18:15:43.179 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.178+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcb806ace0 msgr2=0x7fdcb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.178+0000 7fdcd2956700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcb806ace0 0x7fdcb806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc000c00 tx=0x7fdcbc008070 comp rx=0 tx=0).stop 2023-07-07T18:15:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdccc15fc60 msgr2=0x7fdccc0b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdccc15fc60 0x7fdccc0b4c10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400efb0 tx=0x7fdcc400c3a0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 shutdown_connections 2023-07-07T18:15:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcb806ace0 0x7fdcb806d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdccc15fc60 0x7fdccc0b4c10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdccc06e970 0x7fdccc0b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 --2- 172.21.15.12:0/3993500347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdccc0aecc0 0x7fdccc1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 >> 172.21.15.12:0/3993500347 conn(0x7fdccc06b920 msgr2=0x7fdccc0af450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 shutdown_connections 2023-07-07T18:15:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.179+0000 7fdcd2956700 1 -- 172.21.15.12:0/3993500347 wait complete. 2023-07-07T18:15:43.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:43.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.319+0000 7f45b365b700 1 Processor -- start 2023-07-07T18:15:43.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.319+0000 7f45b365b700 1 -- start start 2023-07-07T18:15:43.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.319+0000 7f45b365b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cf590 0x7f45ac0d3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b365b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45ac0cd1d0 0x7f45ac15d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b365b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac15d7c0 con 0x7f45ac0cf960 2023-07-07T18:15:43.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b365b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac0cd9b0 con 0x7f45ac0cd1d0 2023-07-07T18:15:43.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b365b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0b55b0 con 0x7f45ac0cf590 2023-07-07T18:15:43.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b0bf6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45ac0cd1d0 0x7f45ac15d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b0bf6700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45ac0cd1d0 0x7f45ac15d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58492/0 (socket says 172.21.15.12:58492) 2023-07-07T18:15:43.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b0bf6700 1 -- 172.21.15.12:0/1130497114 learned_addr learned my addr 172.21.15.12:0/1130497114 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:43.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b13f7700 1 --2- 172.21.15.12:0/1130497114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cf590 0x7f45ac0d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b0bf6700 1 -- 172.21.15.12:0/1130497114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cf590 msgr2=0x7f45ac0d3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:43.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b0bf6700 1 --2- 172.21.15.12:0/1130497114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cf590 0x7f45ac0d3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b0bf6700 1 -- 172.21.15.12:0/1130497114 >> v1:172.21.15.160:6789/0 conn(0x7f45ac0cf960 legacy=0x7f45ac0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b0bf6700 1 -- 172.21.15.12:0/1130497114 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac0cd6d0 con 0x7f45ac0cd1d0 2023-07-07T18:15:43.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45b0bf6700 1 --2- 172.21.15.12:0/1130497114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cd1d0 0x7f45ac15d280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f459c0098f0 tx=0x7f459c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94054ce7ffe55670 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:43.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45a3fff700 1 -- 172.21.15.12:0/1130497114 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c011830 con 0x7f45ac0cd1d0 2023-07-07T18:15:43.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45a3fff700 1 -- 172.21.15.12:0/1130497114 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c011990 con 0x7f45ac0cd1d0 2023-07-07T18:15:43.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.320+0000 7f45a3fff700 1 -- 172.21.15.12:0/1130497114 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c011d20 con 0x7f45ac0cd1d0 2023-07-07T18:15:43.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.321+0000 7f45b365b700 1 -- 172.21.15.12:0/1130497114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cd1d0 msgr2=0x7f45ac15d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.321+0000 7f45b365b700 1 --2- 172.21.15.12:0/1130497114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cd1d0 0x7f45ac15d280 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f459c0098f0 tx=0x7f459c009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:43.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.321+0000 7f45b365b700 1 -- 172.21.15.12:0/1130497114 shutdown_connections 2023-07-07T18:15:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.321+0000 7f45b365b700 1 --2- 172.21.15.12:0/1130497114 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cf590 0x7f45ac0d3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.321+0000 7f45b365b700 1 --2- 172.21.15.12:0/1130497114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cd1d0 0x7f45ac15d280 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.321+0000 7f45b365b700 1 -- 172.21.15.12:0/1130497114 >> 172.21.15.12:0/1130497114 conn(0x7f45ac06b3b0 msgr2=0x7f45ac06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.321+0000 7f45b365b700 1 -- 172.21.15.12:0/1130497114 shutdown_connections 2023-07-07T18:15:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.321+0000 7f45b365b700 1 -- 172.21.15.12:0/1130497114 wait complete. 2023-07-07T18:15:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.322+0000 7f45b365b700 1 Processor -- start 2023-07-07T18:15:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.322+0000 7f45b365b700 1 -- start start 2023-07-07T18:15:43.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b365b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cd1d0 0x7f45ac1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b365b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ac0cf590 0x7f45ac0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b365b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cf960 0x7f45ac1e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b365b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac155f10 con 0x7f45ac0cf960 2023-07-07T18:15:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b365b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0b6630 con 0x7f45ac0cf590 2023-07-07T18:15:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b365b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac0b6300 con 0x7f45ac0cd1d0 2023-07-07T18:15:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b1bf8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cf960 0x7f45ac1e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b1bf8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cf960 0x7f45ac1e4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58502/0 (socket says 172.21.15.12:58502) 2023-07-07T18:15:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b1bf8700 1 -- 172.21.15.12:0/1285997977 learned_addr learned my addr 172.21.15.12:0/1285997977 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b0bf6700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ac0cf590 0x7f45ac0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b13f7700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cd1d0 0x7f45ac1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b1bf8700 1 -- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cd1d0 msgr2=0x7f45ac1559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b1bf8700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cd1d0 0x7f45ac1559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b1bf8700 1 -- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ac0cf590 msgr2=0x7f45ac0c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b1bf8700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ac0cf590 0x7f45ac0c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.323+0000 7f45b1bf8700 1 -- 172.21.15.12:0/1285997977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c009550 con 0x7f45ac0cf960 2023-07-07T18:15:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.324+0000 7f45b1bf8700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cf960 0x7f45ac1e4ac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45a400cc50 tx=0x7f45a400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.324+0000 7f45a1ffb700 1 -- 172.21.15.12:0/1285997977 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4003c00 con 0x7f45ac0cf960 2023-07-07T18:15:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.324+0000 7f45a1ffb700 1 -- 172.21.15.12:0/1285997977 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a4003d60 con 0x7f45ac0cf960 2023-07-07T18:15:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.324+0000 7f45a1ffb700 1 -- 172.21.15.12:0/1285997977 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a400ab60 con 0x7f45ac0cf960 2023-07-07T18:15:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.324+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac0c85a0 con 0x7f45ac0cf960 2023-07-07T18:15:43.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.324+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac0c8b60 con 0x7f45ac0cf960 2023-07-07T18:15:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.325+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ac0b67c0 con 0x7f45ac0cf960 2023-07-07T18:15:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.325+0000 7f45a1ffb700 1 -- 172.21.15.12:0/1285997977 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45a400acc0 con 0x7f45ac0cf960 2023-07-07T18:15:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.326+0000 7f45a1ffb700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f459006ace0 0x7f459006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.326+0000 7f45a1ffb700 1 -- 172.21.15.12:0/1285997977 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f45a40897f0 con 0x7f45ac0cf960 2023-07-07T18:15:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.326+0000 7f45b13f7700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f459006ace0 0x7f459006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.327+0000 7f45b13f7700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f459006ace0 0x7f459006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009b70 tx=0x7f45a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:43.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.330+0000 7f45a1ffb700 1 -- 172.21.15.12:0/1285997977 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45a4054570 con 0x7f45ac0cf960 2023-07-07T18:15:43.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.526+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f45ac04ea20 con 0x7f45ac0cf960 2023-07-07T18:15:43.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.526+0000 7f45a1ffb700 1 -- 172.21.15.12:0/1285997977 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f45a4057b90 con 0x7f45ac0cf960 2023-07-07T18:15:43.528 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:43.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f459006ace0 msgr2=0x7f459006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f459006ace0 0x7f459006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009b70 tx=0x7f45a8008040 comp rx=0 tx=0).stop 2023-07-07T18:15:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cf960 msgr2=0x7f45ac1e4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cf960 0x7f45ac1e4ac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45a400cc50 tx=0x7f45a400cf60 comp rx=0 tx=0).stop 2023-07-07T18:15:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 shutdown_connections 2023-07-07T18:15:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f459006ace0 0x7f459006d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45ac0cf960 0x7f45ac1e4ac0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45ac0cd1d0 0x7f45ac1559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 --2- 172.21.15.12:0/1285997977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45ac0cf590 0x7f45ac0c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 >> 172.21.15.12:0/1285997977 conn(0x7f45ac06b3b0 msgr2=0x7f45ac0cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:43.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 shutdown_connections 2023-07-07T18:15:43.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.528+0000 7f45b365b700 1 -- 172.21.15.12:0/1285997977 wait complete. 2023-07-07T18:15:43.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-07T18:15:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.666+0000 7f2b2de4e700 1 Processor -- start 2023-07-07T18:15:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.666+0000 7f2b2de4e700 1 -- start start 2023-07-07T18:15:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.667+0000 7f2b2de4e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 0x7f2b28069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.667+0000 7f2b2de4e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2b280aed30 0x7f2b28160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.667+0000 7f2b2de4e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b280cee80 con 0x7f2b280cc1d0 2023-07-07T18:15:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.667+0000 7f2b2de4e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b280cf100 con 0x7f2b280aed30 2023-07-07T18:15:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.667+0000 7f2b2de4e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280cf3e0 con 0x7f2b28156880 2023-07-07T18:15:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.667+0000 7f2b26ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2b280aed30 0x7f2b28160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.667+0000 7f2b27fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2b280cc1d0 0x7f2b2815cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55708/0 (socket says 172.21.15.12:55708) 2023-07-07T18:15:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.667+0000 7f2b27fff700 1 -- 172.21.15.12:0/1363660334 learned_addr learned my addr 172.21.15.12:0/1363660334 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.667+0000 7f2b277fe700 1 --2- 172.21.15.12:0/1363660334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 0x7f2b28069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.668+0000 7f2b26ffd700 1 -- 172.21.15.12:0/1363660334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 msgr2=0x7f2b28069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.668+0000 7f2b26ffd700 1 --2- 172.21.15.12:0/1363660334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 0x7f2b28069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.668+0000 7f2b26ffd700 1 -- 172.21.15.12:0/1363660334 >> v1:172.21.15.12:6789/0 conn(0x7f2b280cc1d0 legacy=0x7f2b2815cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.668+0000 7f2b267fc700 1 -- 172.21.15.12:0/1363660334 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390801150 0 0) 0x7f2b280cee80 con 0x7f2b280cc1d0 2023-07-07T18:15:43.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.668+0000 7f2b26ffd700 1 -- 172.21.15.12:0/1363660334 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b280cd390 con 0x7f2b280aed30 2023-07-07T18:15:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.668+0000 7f2b26ffd700 1 --2- 172.21.15.12:0/1363660334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280aed30 0x7f2b28160580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009840 tx=0x7f2b10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265d7b8e6d404d58 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.668+0000 7f2b267fc700 1 -- 172.21.15.12:0/1363660334 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10011830 con 0x7f2b280aed30 2023-07-07T18:15:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.668+0000 7f2b267fc700 1 -- 172.21.15.12:0/1363660334 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b10011990 con 0x7f2b280aed30 2023-07-07T18:15:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.668+0000 7f2b267fc700 1 -- 172.21.15.12:0/1363660334 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10011d20 con 0x7f2b280aed30 2023-07-07T18:15:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.669+0000 7f2b2de4e700 1 -- 172.21.15.12:0/1363660334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280aed30 msgr2=0x7f2b28160580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.669+0000 7f2b2de4e700 1 --2- 172.21.15.12:0/1363660334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280aed30 0x7f2b28160580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009840 tx=0x7f2b10009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.669+0000 7f2b2de4e700 1 -- 172.21.15.12:0/1363660334 shutdown_connections 2023-07-07T18:15:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.669+0000 7f2b2de4e700 1 --2- 172.21.15.12:0/1363660334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 0x7f2b28069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.669+0000 7f2b2de4e700 1 --2- 172.21.15.12:0/1363660334 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280aed30 0x7f2b28160580 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.669+0000 7f2b2de4e700 1 -- 172.21.15.12:0/1363660334 >> 172.21.15.12:0/1363660334 conn(0x7f2b2806d4a0 msgr2=0x7f2b2806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.669+0000 7f2b2de4e700 1 -- 172.21.15.12:0/1363660334 shutdown_connections 2023-07-07T18:15:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.669+0000 7f2b2de4e700 1 -- 172.21.15.12:0/1363660334 wait complete. 2023-07-07T18:15:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.670+0000 7f2b2de4e700 1 Processor -- start 2023-07-07T18:15:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.670+0000 7f2b2de4e700 1 -- start start 2023-07-07T18:15:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b2de4e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b280aed30 0x7f2b28154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b2de4e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280cc1d0 0x7f2b280c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b2de4e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 0x7f2b280c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b2de4e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280c5250 con 0x7f2b280cc1d0 2023-07-07T18:15:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b2de4e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280c32f0 con 0x7f2b280aed30 2023-07-07T18:15:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b2de4e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28154da0 con 0x7f2b28156880 2023-07-07T18:15:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b26ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280cc1d0 0x7f2b280c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b26ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280cc1d0 0x7f2b280c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58514/0 (socket says 172.21.15.12:58514) 2023-07-07T18:15:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b26ffd700 1 -- 172.21.15.12:0/3179571600 learned_addr learned my addr 172.21.15.12:0/3179571600 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b277fe700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b280aed30 0x7f2b28154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b27fff700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 0x7f2b280c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b26ffd700 1 -- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 msgr2=0x7f2b280c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b26ffd700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 0x7f2b280c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b26ffd700 1 -- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b280aed30 msgr2=0x7f2b28154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b26ffd700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b280aed30 0x7f2b28154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b26ffd700 1 -- 172.21.15.12:0/3179571600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b100094a0 con 0x7f2b280cc1d0 2023-07-07T18:15:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b277fe700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b280aed30 0x7f2b28154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.671+0000 7f2b26ffd700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280cc1d0 0x7f2b280c5590 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009b90 tx=0x7f2b10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.672+0000 7f2b1ffff700 1 -- 172.21.15.12:0/3179571600 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b100038a0 con 0x7f2b280cc1d0 2023-07-07T18:15:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.672+0000 7f2b1ffff700 1 -- 172.21.15.12:0/3179571600 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1001e070 con 0x7f2b280cc1d0 2023-07-07T18:15:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.672+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b281f1b90 con 0x7f2b280cc1d0 2023-07-07T18:15:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.672+0000 7f2b1ffff700 1 -- 172.21.15.12:0/3179571600 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b10003c40 con 0x7f2b280cc1d0 2023-07-07T18:15:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.672+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b281f2110 con 0x7f2b280cc1d0 2023-07-07T18:15:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.673+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b28073910 con 0x7f2b280cc1d0 2023-07-07T18:15:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.673+0000 7f2b1ffff700 1 -- 172.21.15.12:0/3179571600 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b1002d450 con 0x7f2b280cc1d0 2023-07-07T18:15:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.673+0000 7f2b1ffff700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2b0806ace0 0x7f2b0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.674+0000 7f2b1ffff700 1 -- 172.21.15.12:0/3179571600 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2b1008a8a0 con 0x7f2b280cc1d0 2023-07-07T18:15:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.674+0000 7f2b277fe700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2b0806ace0 0x7f2b0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.674+0000 7f2b277fe700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2b0806ace0 0x7f2b0806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009c30 tx=0x7f2b18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:43.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.678+0000 7f2b1ffff700 1 -- 172.21.15.12:0/3179571600 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2b10055590 con 0x7f2b280cc1d0 2023-07-07T18:15:43.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.892+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2b28071cf0 con 0x7f2b280cc1d0 2023-07-07T18:15:43.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.893+0000 7f2b1ffff700 1 -- 172.21.15.12:0/3179571600 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2b10058bb0 con 0x7f2b280cc1d0 2023-07-07T18:15:43.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2b0806ace0 msgr2=0x7f2b0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2b0806ace0 0x7f2b0806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009c30 tx=0x7f2b18008040 comp rx=0 tx=0).stop 2023-07-07T18:15:43.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280cc1d0 msgr2=0x7f2b280c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:43.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280cc1d0 0x7f2b280c5590 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009b90 tx=0x7f2b10004750 comp rx=0 tx=0).stop 2023-07-07T18:15:43.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 shutdown_connections 2023-07-07T18:15:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2b0806ace0 0x7f2b0806d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2b28156880 0x7f2b280c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b280aed30 0x7f2b28154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 --2- 172.21.15.12:0/3179571600 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b280cc1d0 0x7f2b280c5590 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 >> 172.21.15.12:0/3179571600 conn(0x7f2b2806d4a0 msgr2=0x7f2b2806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 shutdown_connections 2023-07-07T18:15:43.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:43.895+0000 7f2b2de4e700 1 -- 172.21.15.12:0/3179571600 wait complete. 2023-07-07T18:15:43.899 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-07-07T18:15:43.909 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-07T18:15:43.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:43.910 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-07T18:15:43.961 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T18:15:43.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:43.962 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-07T18:15:43.980 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:15:43.981 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:44.001 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:15:44.002 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:44.061 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:15:44.061 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:44.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.243+0000 7f504359e700 1 Processor -- start 2023-07-07T18:15:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.243+0000 7f504359e700 1 -- start start 2023-07-07T18:15:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.244+0000 7f504359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f503c0709f0 0x7f503c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.244+0000 7f504359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503c0c9510 con 0x7f503c158ef0 2023-07-07T18:15:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.244+0000 7f504359e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503c0cd6a0 con 0x7f503c06c060 2023-07-07T18:15:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.244+0000 7f504359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503c0cd980 con 0x7f503c0709f0 2023-07-07T18:15:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.244+0000 7f5040b39700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f503c0709f0 0x7f503c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.244+0000 7f504133a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f503c158ef0 0x7f503c0702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55718/0 (socket says 172.21.15.12:55718) 2023-07-07T18:15:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.244+0000 7f504133a700 1 -- 172.21.15.12:0/1991581839 learned_addr learned my addr 172.21.15.12:0/1991581839 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f5040b39700 1 -- 172.21.15.12:0/1991581839 >> v1:172.21.15.160:6789/0 conn(0x7f503c06c060 legacy=0x7f503c0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f5040b39700 1 -- 172.21.15.12:0/1991581839 >> v1:172.21.15.12:6789/0 conn(0x7f503c158ef0 legacy=0x7f503c0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f5033fff700 1 -- 172.21.15.12:0/1991581839 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041054163 0 0) 0x7f503c0c9510 con 0x7f503c158ef0 2023-07-07T18:15:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f5040b39700 1 -- 172.21.15.12:0/1991581839 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c0c97b0 con 0x7f503c0709f0 2023-07-07T18:15:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f5040b39700 1 --2- 172.21.15.12:0/1991581839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 0x7f503c0cf1e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5038009840 tx=0x7f5038009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c653a94723d19f72 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f5033fff700 1 -- 172.21.15.12:0/1991581839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038004230 con 0x7f503c0709f0 2023-07-07T18:15:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f5033fff700 1 -- 172.21.15.12:0/1991581839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5038004390 con 0x7f503c0709f0 2023-07-07T18:15:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f5033fff700 1 -- 172.21.15.12:0/1991581839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50380036a0 con 0x7f503c0709f0 2023-07-07T18:15:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f504359e700 1 -- 172.21.15.12:0/1991581839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 msgr2=0x7f503c0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f504359e700 1 --2- 172.21.15.12:0/1991581839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 0x7f503c0cf1e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5038009840 tx=0x7f5038009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f504359e700 1 -- 172.21.15.12:0/1991581839 shutdown_connections 2023-07-07T18:15:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f504359e700 1 --2- 172.21.15.12:0/1991581839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 0x7f503c0cf1e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.245+0000 7f504359e700 1 -- 172.21.15.12:0/1991581839 >> 172.21.15.12:0/1991581839 conn(0x7f503c0b0ef0 msgr2=0x7f503c0ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:44.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.246+0000 7f504359e700 1 -- 172.21.15.12:0/1991581839 shutdown_connections 2023-07-07T18:15:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.246+0000 7f504359e700 1 -- 172.21.15.12:0/1991581839 wait complete. 2023-07-07T18:15:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.247+0000 7f504359e700 1 Processor -- start 2023-07-07T18:15:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.247+0000 7f504359e700 1 -- start start 2023-07-07T18:15:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.247+0000 7f504359e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f503c06c060 0x7f503c1f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.247+0000 7f504359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 0x7f503c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.247+0000 7f504359e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f503c158ef0 0x7f503c0ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.247+0000 7f504359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0ac820 con 0x7f503c0709f0 2023-07-07T18:15:44.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.247+0000 7f504359e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0c7470 con 0x7f503c06c060 2023-07-07T18:15:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.247+0000 7f504359e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0c6b80 con 0x7f503c158ef0 2023-07-07T18:15:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5040b39700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 0x7f503c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5040b39700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 0x7f503c152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58528/0 (socket says 172.21.15.12:58528) 2023-07-07T18:15:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5040b39700 1 -- 172.21.15.12:0/1720761386 learned_addr learned my addr 172.21.15.12:0/1720761386 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f504133a700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f503c06c060 0x7f503c1f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5041b3b700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f503c158ef0 0x7f503c0ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5040b39700 1 -- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f503c158ef0 msgr2=0x7f503c0ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5040b39700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f503c158ef0 0x7f503c0ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5040b39700 1 -- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f503c06c060 msgr2=0x7f503c1f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5040b39700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f503c06c060 0x7f503c1f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5040b39700 1 -- 172.21.15.12:0/1720761386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380094a0 con 0x7f503c0709f0 2023-07-07T18:15:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5041b3b700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f503c158ef0 0x7f503c0ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5040b39700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 0x7f503c152ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f50380090b0 tx=0x7f5038004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:44.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5031ffb700 1 -- 172.21.15.12:0/1720761386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038011630 con 0x7f503c0709f0 2023-07-07T18:15:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5031ffb700 1 -- 172.21.15.12:0/1720761386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503801e070 con 0x7f503c0709f0 2023-07-07T18:15:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c0aca30 con 0x7f503c0709f0 2023-07-07T18:15:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f5031ffb700 1 -- 172.21.15.12:0/1720761386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50380119b0 con 0x7f503c0709f0 2023-07-07T18:15:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.248+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c0c7100 con 0x7f503c0709f0 2023-07-07T18:15:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.249+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503c0c75e0 con 0x7f503c0709f0 2023-07-07T18:15:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.250+0000 7f5031ffb700 1 -- 172.21.15.12:0/1720761386 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5038011b10 con 0x7f503c0709f0 2023-07-07T18:15:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.250+0000 7f5031ffb700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f502006ad10 0x7f502006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.250+0000 7f5031ffb700 1 -- 172.21.15.12:0/1720761386 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f503808aa00 con 0x7f503c0709f0 2023-07-07T18:15:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.251+0000 7f504133a700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f502006ad10 0x7f502006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.251+0000 7f504133a700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f502006ad10 0x7f502006d1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f502c000f60 tx=0x7f502c007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:44.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.255+0000 7f5031ffb700 1 -- 172.21.15.12:0/1720761386 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5038055810 con 0x7f503c0709f0 2023-07-07T18:15:44.443 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:15:44.446 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:15:44.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.457+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f503c073910 con 0x7f503c0709f0 2023-07-07T18:15:44.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.458+0000 7f5031ffb700 1 -- 172.21.15.12:0/1720761386 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f5038058e30 con 0x7f503c0709f0 2023-07-07T18:15:44.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:44.461 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:44.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f502006ad10 msgr2=0x7f502006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f502006ad10 0x7f502006d1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f502c000f60 tx=0x7f502c007e70 comp rx=0 tx=0).stop 2023-07-07T18:15:44.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 msgr2=0x7f503c152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 0x7f503c152ce0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f50380090b0 tx=0x7f5038004750 comp rx=0 tx=0).stop 2023-07-07T18:15:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 shutdown_connections 2023-07-07T18:15:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f502006ad10 0x7f502006d1c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f503c158ef0 0x7f503c0ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f503c06c060 0x7f503c1f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 --2- 172.21.15.12:0/1720761386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f503c0709f0 0x7f503c152ce0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 >> 172.21.15.12:0/1720761386 conn(0x7f503c0b0ef0 msgr2=0x7f503c0aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:44.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 shutdown_connections 2023-07-07T18:15:44.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.460+0000 7f504359e700 1 -- 172.21.15.12:0/1720761386 wait complete. 2023-07-07T18:15:44.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:44.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.654+0000 7fdea9820700 1 Processor -- start 2023-07-07T18:15:44.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.654+0000 7fdea9820700 1 -- start start 2023-07-07T18:15:44.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.654+0000 7fdea9820700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdea406b000 0x7fdea406b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.654+0000 7fdea9820700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea40adbb0 0x7fdea40ae030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.654+0000 7fdea9820700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea40b1670 con 0x7fdea40b0af0 2023-07-07T18:15:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.654+0000 7fdea9820700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea406b910 con 0x7fdea406b000 2023-07-07T18:15:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.654+0000 7fdea9820700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40b1900 con 0x7fdea40adbb0 2023-07-07T18:15:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea2ffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdea406b000 0x7fdea406b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea37fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea40adbb0 0x7fdea40ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea27fc700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fdea40b0af0 0x7fdea40b0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:48972/0 (socket says 172.21.15.12:48972) 2023-07-07T18:15:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea37fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea40adbb0 0x7fdea40ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:47628/0 (socket says 172.21.15.12:47628) 2023-07-07T18:15:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea27fc700 1 -- 172.21.15.12:0/2050154806 learned_addr learned my addr 172.21.15.12:0/2050154806 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea2ffd700 1 -- 172.21.15.12:0/2050154806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea40adbb0 msgr2=0x7fdea40ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea2ffd700 1 --2- 172.21.15.12:0/2050154806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea40adbb0 0x7fdea40ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea2ffd700 1 -- 172.21.15.12:0/2050154806 >> v1:172.21.15.160:6789/0 conn(0x7fdea40b0af0 legacy=0x7fdea40b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea2ffd700 1 -- 172.21.15.12:0/2050154806 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea40b1be0 con 0x7fdea406b000 2023-07-07T18:15:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea37fe700 1 --2- 172.21.15.12:0/2050154806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea40adbb0 0x7fdea40ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea2ffd700 1 --2- 172.21.15.12:0/2050154806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdea406b000 0x7fdea406b3d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde94009840 tx=0x7fde94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d746e4c481921b9c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.655+0000 7fdea1ffb700 1 -- 172.21.15.12:0/2050154806 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011830 con 0x7fdea406b000 2023-07-07T18:15:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea1ffb700 1 -- 172.21.15.12:0/2050154806 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94011990 con 0x7fdea406b000 2023-07-07T18:15:44.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea1ffb700 1 -- 172.21.15.12:0/2050154806 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94011d20 con 0x7fdea406b000 2023-07-07T18:15:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea9820700 1 -- 172.21.15.12:0/2050154806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdea406b000 msgr2=0x7fdea406b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea9820700 1 --2- 172.21.15.12:0/2050154806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdea406b000 0x7fdea406b3d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde94009840 tx=0x7fde94009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea9820700 1 -- 172.21.15.12:0/2050154806 shutdown_connections 2023-07-07T18:15:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea9820700 1 --2- 172.21.15.12:0/2050154806 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea40adbb0 0x7fdea40ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea9820700 1 --2- 172.21.15.12:0/2050154806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdea406b000 0x7fdea406b3d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea9820700 1 -- 172.21.15.12:0/2050154806 >> 172.21.15.12:0/2050154806 conn(0x7fdea4099d30 msgr2=0x7fdea40d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea9820700 1 -- 172.21.15.12:0/2050154806 shutdown_connections 2023-07-07T18:15:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.656+0000 7fdea9820700 1 -- 172.21.15.12:0/2050154806 wait complete. 2023-07-07T18:15:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.657+0000 7fdea9820700 1 Processor -- start 2023-07-07T18:15:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea9820700 1 -- start start 2023-07-07T18:15:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea9820700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea406b000 0x7fdea41f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea9820700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdea40adbb0 0x7fdea41f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea9820700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea40b0af0 0x7fdea41f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea9820700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40b4980 con 0x7fdea40b0af0 2023-07-07T18:15:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea9820700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea40cd7f0 con 0x7fdea40adbb0 2023-07-07T18:15:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea9820700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea41f1df0 con 0x7fdea406b000 2023-07-07T18:15:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea40b0af0 0x7fdea41f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea40b0af0 0x7fdea41f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58544/0 (socket says 172.21.15.12:58544) 2023-07-07T18:15:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.658+0000 7fdea37fe700 1 -- 172.21.15.12:0/914113559 learned_addr learned my addr 172.21.15.12:0/914113559 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea27fc700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdea40adbb0 0x7fdea41f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea2ffd700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea406b000 0x7fdea41f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea37fe700 1 -- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea406b000 msgr2=0x7fdea41f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea37fe700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea406b000 0x7fdea41f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea37fe700 1 -- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdea40adbb0 msgr2=0x7fdea41f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea37fe700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdea40adbb0 0x7fdea41f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea37fe700 1 -- 172.21.15.12:0/914113559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c009a70 con 0x7fdea40b0af0 2023-07-07T18:15:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea37fe700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea40b0af0 0x7fdea41f5810 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00efc0 tx=0x7fde9c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fde8bfff700 1 -- 172.21.15.12:0/914113559 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00ca90 con 0x7fdea40b0af0 2023-07-07T18:15:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fde8bfff700 1 -- 172.21.15.12:0/914113559 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c00f040 con 0x7fdea40b0af0 2023-07-07T18:15:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde940094a0 con 0x7fdea40b0af0 2023-07-07T18:15:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fde8bfff700 1 -- 172.21.15.12:0/914113559 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00ce10 con 0x7fdea40b0af0 2023-07-07T18:15:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.659+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea40cda00 con 0x7fdea40b0af0 2023-07-07T18:15:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.660+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea40b4ac0 con 0x7fdea40b0af0 2023-07-07T18:15:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.660+0000 7fde8bfff700 1 -- 172.21.15.12:0/914113559 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde9c014480 con 0x7fdea40b0af0 2023-07-07T18:15:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.661+0000 7fde8bfff700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fde9006ace0 0x7fde9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.661+0000 7fde8bfff700 1 -- 172.21.15.12:0/914113559 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fde9c089d60 con 0x7fdea40b0af0 2023-07-07T18:15:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.661+0000 7fdea2ffd700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fde9006ace0 0x7fde9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.662+0000 7fdea2ffd700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fde9006ace0 0x7fde9006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde940090b0 tx=0x7fde94008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.665+0000 7fde8bfff700 1 -- 172.21.15.12:0/914113559 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fde9c058600 con 0x7fdea40b0af0 2023-07-07T18:15:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.861+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdea404ea20 con 0x7fdea40b0af0 2023-07-07T18:15:44.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.862+0000 7fde8bfff700 1 -- 172.21.15.12:0/914113559 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde9c009d70 con 0x7fdea40b0af0 2023-07-07T18:15:44.864 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fde9006ace0 msgr2=0x7fde9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fde9006ace0 0x7fde9006d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fde940090b0 tx=0x7fde94008030 comp rx=0 tx=0).stop 2023-07-07T18:15:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea40b0af0 msgr2=0x7fdea41f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea40b0af0 0x7fdea41f5810 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00efc0 tx=0x7fde9c00c3a0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 shutdown_connections 2023-07-07T18:15:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fde9006ace0 0x7fde9006d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea40b0af0 0x7fdea41f5810 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdea406b000 0x7fdea41f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 --2- 172.21.15.12:0/914113559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdea40adbb0 0x7fdea41f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 >> 172.21.15.12:0/914113559 conn(0x7fdea4099d30 msgr2=0x7fdea40d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 shutdown_connections 2023-07-07T18:15:44.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:44.864+0000 7fdea9820700 1 -- 172.21.15.12:0/914113559 wait complete. 2023-07-07T18:15:44.878 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:45.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.004+0000 7f51d16fc700 1 Processor -- start 2023-07-07T18:15:45.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.004+0000 7f51d16fc700 1 -- start start 2023-07-07T18:15:45.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.004+0000 7f51d16fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f51cc06b000 0x7f51cc06b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.004+0000 7f51d16fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f51cc0b0af0 0x7f51cc0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51d16fc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc06b910 con 0x7f51cc160100 2023-07-07T18:15:45.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51d16fc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc0b1900 con 0x7f51cc06b000 2023-07-07T18:15:45.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51d16fc700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc0b1be0 con 0x7f51cc0b0af0 2023-07-07T18:15:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51caffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f51cc06b000 0x7f51cc06b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51caffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f51cc06b000 0x7f51cc06b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58548/0 (socket says 172.21.15.12:58548) 2023-07-07T18:15:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51caffd700 1 -- 172.21.15.12:0/1112845618 learned_addr learned my addr 172.21.15.12:0/1112845618 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51ca7fc700 1 --2- 172.21.15.12:0/1112845618 >> v2:172.21.15.160:3300/0 conn(0x7f51cc0b0af0 0x7f51cc0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51caffd700 1 -- 172.21.15.12:0/1112845618 >> v2:172.21.15.160:3300/0 conn(0x7f51cc0b0af0 msgr2=0x7f51cc0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51caffd700 1 --2- 172.21.15.12:0/1112845618 >> v2:172.21.15.160:3300/0 conn(0x7f51cc0b0af0 0x7f51cc0b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51caffd700 1 -- 172.21.15.12:0/1112845618 >> v1:172.21.15.160:6789/0 conn(0x7f51cc160100 legacy=0x7f51cc160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51caffd700 1 -- 172.21.15.12:0/1112845618 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0b1ec0 con 0x7f51cc06b000 2023-07-07T18:15:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51ca7fc700 1 --2- 172.21.15.12:0/1112845618 >> v2:172.21.15.160:3300/0 conn(0x7f51cc0b0af0 0x7f51cc0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51caffd700 1 --2- 172.21.15.12:0/1112845618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc06b000 0x7f51cc06b3d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0b3570 tx=0x7f51c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7157fccc49cd751f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51c9ffb700 1 -- 172.21.15.12:0/1112845618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0004230 con 0x7f51cc06b000 2023-07-07T18:15:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51c9ffb700 1 -- 172.21.15.12:0/1112845618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0004390 con 0x7f51cc06b000 2023-07-07T18:15:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.005+0000 7f51c9ffb700 1 -- 172.21.15.12:0/1112845618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c00036a0 con 0x7f51cc06b000 2023-07-07T18:15:45.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.006+0000 7f51d16fc700 1 -- 172.21.15.12:0/1112845618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc06b000 msgr2=0x7f51cc06b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.006+0000 7f51d16fc700 1 --2- 172.21.15.12:0/1112845618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc06b000 0x7f51cc06b3d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0b3570 tx=0x7f51c0009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.006+0000 7f51d16fc700 1 -- 172.21.15.12:0/1112845618 shutdown_connections 2023-07-07T18:15:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.006+0000 7f51d16fc700 1 --2- 172.21.15.12:0/1112845618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc06b000 0x7f51cc06b3d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.006+0000 7f51d16fc700 1 --2- 172.21.15.12:0/1112845618 >> v2:172.21.15.160:3300/0 conn(0x7f51cc0b0af0 0x7f51cc0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.006+0000 7f51d16fc700 1 -- 172.21.15.12:0/1112845618 >> 172.21.15.12:0/1112845618 conn(0x7f51cc099d30 msgr2=0x7f51cc0d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.006+0000 7f51d16fc700 1 -- 172.21.15.12:0/1112845618 shutdown_connections 2023-07-07T18:15:45.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.006+0000 7f51d16fc700 1 -- 172.21.15.12:0/1112845618 wait complete. 2023-07-07T18:15:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.007+0000 7f51d16fc700 1 Processor -- start 2023-07-07T18:15:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.007+0000 7f51d16fc700 1 -- start start 2023-07-07T18:15:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51d16fc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51cc06b000 0x7f51cc0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51d16fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51cc0b0af0 0x7f51cc157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51d16fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc160100 0x7f51cc0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51d16fc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc157790 con 0x7f51cc160100 2023-07-07T18:15:45.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51d16fc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc0cb570 con 0x7f51cc0b0af0 2023-07-07T18:15:45.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51d16fc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc0cb850 con 0x7f51cc06b000 2023-07-07T18:15:45.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc160100 0x7f51cc0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc160100 0x7f51cc0b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58558/0 (socket says 172.21.15.12:58558) 2023-07-07T18:15:45.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51cb7fe700 1 -- 172.21.15.12:0/797778911 learned_addr learned my addr 172.21.15.12:0/797778911 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:45.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51ca7fc700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51cc0b0af0 0x7f51cc157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51caffd700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51cc06b000 0x7f51cc0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51cb7fe700 1 -- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51cc06b000 msgr2=0x7f51cc0caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.008+0000 7f51cb7fe700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51cc06b000 0x7f51cc0caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51cb7fe700 1 -- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51cc0b0af0 msgr2=0x7f51cc157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51cb7fe700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51cc0b0af0 0x7f51cc157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51cb7fe700 1 -- 172.21.15.12:0/797778911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0009550 con 0x7f51cc160100 2023-07-07T18:15:45.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51caffd700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51cc06b000 0x7f51cc0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:45.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51ca7fc700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51cc0b0af0 0x7f51cc157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:45.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51cb7fe700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc160100 0x7f51cc0b3f70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f51c400cc10 tx=0x7f51c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:45.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51b37fe700 1 -- 172.21.15.12:0/797778911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c400abb0 con 0x7f51cc160100 2023-07-07T18:15:45.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51b37fe700 1 -- 172.21.15.12:0/797778911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c400ad10 con 0x7f51cc160100 2023-07-07T18:15:45.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc0cbb30 con 0x7f51cc160100 2023-07-07T18:15:45.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51b37fe700 1 -- 172.21.15.12:0/797778911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4012660 con 0x7f51cc160100 2023-07-07T18:15:45.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.009+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc0cc0f0 con 0x7f51cc160100 2023-07-07T18:15:45.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.010+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc0cc310 con 0x7f51cc160100 2023-07-07T18:15:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.010+0000 7f51b37fe700 1 -- 172.21.15.12:0/797778911 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51c40127c0 con 0x7f51cc160100 2023-07-07T18:15:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.011+0000 7f51b37fe700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f51b806ace0 0x7f51b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.011+0000 7f51b37fe700 1 -- 172.21.15.12:0/797778911 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f51c4089ea0 con 0x7f51cc160100 2023-07-07T18:15:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.011+0000 7f51caffd700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f51b806ace0 0x7f51b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.012+0000 7f51caffd700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f51b806ace0 0x7f51b806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009840 tx=0x7f51c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:45.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.015+0000 7f51b37fe700 1 -- 172.21.15.12:0/797778911 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f51c4054cb0 con 0x7f51cc160100 2023-07-07T18:15:45.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.212+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51cc04ea20 con 0x7f51cc160100 2023-07-07T18:15:45.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.213+0000 7f51b37fe700 1 -- 172.21.15.12:0/797778911 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f51c4016020 con 0x7f51cc160100 2023-07-07T18:15:45.215 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f51b806ace0 msgr2=0x7f51b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f51b806ace0 0x7f51b806d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009840 tx=0x7f51c0008030 comp rx=0 tx=0).stop 2023-07-07T18:15:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc160100 msgr2=0x7f51cc0b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc160100 0x7f51cc0b3f70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f51c400cc10 tx=0x7f51c400a060 comp rx=0 tx=0).stop 2023-07-07T18:15:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 shutdown_connections 2023-07-07T18:15:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f51b806ace0 0x7f51b806d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51cc160100 0x7f51cc0b3f70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51cc06b000 0x7f51cc0caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 --2- 172.21.15.12:0/797778911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51cc0b0af0 0x7f51cc157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 >> 172.21.15.12:0/797778911 conn(0x7f51cc099d30 msgr2=0x7f51cc06e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 shutdown_connections 2023-07-07T18:15:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.215+0000 7f51d16fc700 1 -- 172.21.15.12:0/797778911 wait complete. 2023-07-07T18:15:45.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:45.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.355+0000 7fa522dcc700 1 Processor -- start 2023-07-07T18:15:45.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.355+0000 7fa522dcc700 1 -- start start 2023-07-07T18:15:45.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa522dcc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa51c0cd5e0 0x7fa51c0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa522dcc700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c06f0e0 con 0x7fa51c06e030 2023-07-07T18:15:45.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa522dcc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c15dd90 con 0x7fa51c0adf40 2023-07-07T18:15:45.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa522dcc700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c0ce2c0 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa520b68700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa51c0cd5e0 0x7fa51c0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa520b68700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa51c0cd5e0 0x7fa51c0cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58562/0 (socket says 172.21.15.12:58562) 2023-07-07T18:15:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa520b68700 1 -- 172.21.15.12:0/1428754789 learned_addr learned my addr 172.21.15.12:0/1428754789 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa51bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa51c06e030 0x7fa51c15cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55760/0 (socket says 172.21.15.12:55760) 2023-07-07T18:15:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa520b68700 1 -- 172.21.15.12:0/1428754789 >> v1:172.21.15.160:6789/0 conn(0x7fa51c0adf40 legacy=0x7fa51c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa520b68700 1 -- 172.21.15.12:0/1428754789 >> v1:172.21.15.12:6789/0 conn(0x7fa51c06e030 legacy=0x7fa51c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa520b68700 1 -- 172.21.15.12:0/1428754789 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c0cdef0 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa51b7fe700 1 -- 172.21.15.12:0/1428754789 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425241646 0 0) 0x7fa51c06f0e0 con 0x7fa51c06e030 2023-07-07T18:15:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.356+0000 7fa520b68700 1 --2- 172.21.15.12:0/1428754789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 0x7fa51c0cd9b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa510006fd0 tx=0x7fa510009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a60a5b074d4b19 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa51b7fe700 1 -- 172.21.15.12:0/1428754789 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510005e30 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa51b7fe700 1 -- 172.21.15.12:0/1428754789 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa510004030 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa51b7fe700 1 -- 172.21.15.12:0/1428754789 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100043e0 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa522dcc700 1 -- 172.21.15.12:0/1428754789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 msgr2=0x7fa51c0cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa522dcc700 1 --2- 172.21.15.12:0/1428754789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 0x7fa51c0cd9b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa510006fd0 tx=0x7fa510009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa522dcc700 1 -- 172.21.15.12:0/1428754789 shutdown_connections 2023-07-07T18:15:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa522dcc700 1 --2- 172.21.15.12:0/1428754789 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 0x7fa51c0cd9b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa522dcc700 1 -- 172.21.15.12:0/1428754789 >> 172.21.15.12:0/1428754789 conn(0x7fa51c06b920 msgr2=0x7fa51c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa522dcc700 1 -- 172.21.15.12:0/1428754789 shutdown_connections 2023-07-07T18:15:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.357+0000 7fa522dcc700 1 -- 172.21.15.12:0/1428754789 wait complete. 2023-07-07T18:15:45.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.358+0000 7fa522dcc700 1 Processor -- start 2023-07-07T18:15:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.358+0000 7fa522dcc700 1 -- start start 2023-07-07T18:15:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.359+0000 7fa522dcc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa51c06e030 0x7fa51c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.359+0000 7fa522dcc700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa51c0adf40 0x7fa51c1f2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.359+0000 7fa522dcc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 0x7fa51c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.359+0000 7fa522dcc700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0cc720 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.359+0000 7fa522dcc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1f2ca0 con 0x7fa51c06e030 2023-07-07T18:15:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.359+0000 7fa522dcc700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1f2f80 con 0x7fa51c0adf40 2023-07-07T18:15:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.359+0000 7fa521369700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 0x7fa51c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.359+0000 7fa521369700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 0x7fa51c0ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58572/0 (socket says 172.21.15.12:58572) 2023-07-07T18:15:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.359+0000 7fa521369700 1 -- 172.21.15.12:0/839246200 learned_addr learned my addr 172.21.15.12:0/839246200 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa520b68700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa51c06e030 0x7fa51c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa51bfff700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa51c0adf40 0x7fa51c1f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa521369700 1 -- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa51c0adf40 msgr2=0x7fa51c1f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa521369700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa51c0adf40 0x7fa51c1f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa521369700 1 -- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa51c06e030 msgr2=0x7fa51c1536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa521369700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa51c06e030 0x7fa51c1536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa521369700 1 -- 172.21.15.12:0/839246200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510009500 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa521369700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 0x7fa51c0ccbb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa51400cc50 tx=0x7fa51400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa5197fa700 1 -- 172.21.15.12:0/839246200 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa514003c00 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa5197fa700 1 -- 172.21.15.12:0/839246200 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa514003d60 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa5197fa700 1 -- 172.21.15.12:0/839246200 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51400aaf0 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c1f3260 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.360+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c1f2890 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.361+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c0cc210 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.362+0000 7fa5197fa700 1 -- 172.21.15.12:0/839246200 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa51400ac50 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.362+0000 7fa5197fa700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa50006ace0 0x7fa50006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.362+0000 7fa5197fa700 1 -- 172.21.15.12:0/839246200 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa514089750 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.362+0000 7fa520b68700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa50006ace0 0x7fa50006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.363+0000 7fa520b68700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa50006ace0 0x7fa50006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa510000c00 tx=0x7fa510008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:45.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.366+0000 7fa5197fa700 1 -- 172.21.15.12:0/839246200 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa51c0cc210 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.562+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa51c0cc210 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.562+0000 7fa5197fa700 1 -- 172.21.15.12:0/839246200 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa51c0cc210 con 0x7fa51c0cd5e0 2023-07-07T18:15:45.565 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa50006ace0 msgr2=0x7fa50006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa50006ace0 0x7fa50006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa510000c00 tx=0x7fa510008070 comp rx=0 tx=0).stop 2023-07-07T18:15:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 msgr2=0x7fa51c0ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 0x7fa51c0ccbb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa51400cc50 tx=0x7fa51400cf60 comp rx=0 tx=0).stop 2023-07-07T18:15:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 shutdown_connections 2023-07-07T18:15:45.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa50006ace0 0x7fa50006d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa51c0cd5e0 0x7fa51c0ccbb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa51c06e030 0x7fa51c1536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 --2- 172.21.15.12:0/839246200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa51c0adf40 0x7fa51c1f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 >> 172.21.15.12:0/839246200 conn(0x7fa51c06b920 msgr2=0x7fa51c0b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:45.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 shutdown_connections 2023-07-07T18:15:45.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.565+0000 7fa522dcc700 1 -- 172.21.15.12:0/839246200 wait complete. 2023-07-07T18:15:45.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:45.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.705+0000 7f564d3d8700 1 Processor -- start 2023-07-07T18:15:45.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.705+0000 7f564d3d8700 1 -- start start 2023-07-07T18:15:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f564d3d8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f56480b5a70 0x7f56480b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f564d3d8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480b5ec0 con 0x7f56480d0a60 2023-07-07T18:15:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f564d3d8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480cd9d0 con 0x7f56480cf910 2023-07-07T18:15:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f564d3d8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56480d0060 con 0x7f56480b5a70 2023-07-07T18:15:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f56467fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f56480b5a70 0x7f56480b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f5646ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f56480d0a60 0x7f56480d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55774/0 (socket says 172.21.15.12:55774) 2023-07-07T18:15:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f5646ffd700 1 -- 172.21.15.12:0/4077397409 learned_addr learned my addr 172.21.15.12:0/4077397409 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f56467fc700 1 -- 172.21.15.12:0/4077397409 >> v1:172.21.15.160:6789/0 conn(0x7f56480cf910 legacy=0x7f56480d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f56467fc700 1 -- 172.21.15.12:0/4077397409 >> v1:172.21.15.12:6789/0 conn(0x7f56480d0a60 legacy=0x7f56480d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f56467fc700 1 -- 172.21.15.12:0/4077397409 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480cd410 con 0x7f56480b5a70 2023-07-07T18:15:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f5645ffb700 1 -- 172.21.15.12:0/4077397409 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162780173 0 0) 0x7f56480b5ec0 con 0x7f56480d0a60 2023-07-07T18:15:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.706+0000 7f56467fc700 1 --2- 172.21.15.12:0/4077397409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480b5a70 0x7f56480b51d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5638009840 tx=0x7f5638009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb755c6f1e56abf server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f5645ffb700 1 -- 172.21.15.12:0/4077397409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638004230 con 0x7f56480b5a70 2023-07-07T18:15:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f5645ffb700 1 -- 172.21.15.12:0/4077397409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638004390 con 0x7f56480b5a70 2023-07-07T18:15:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f5645ffb700 1 -- 172.21.15.12:0/4077397409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56380036a0 con 0x7f56480b5a70 2023-07-07T18:15:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f564d3d8700 1 -- 172.21.15.12:0/4077397409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480b5a70 msgr2=0x7f56480b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f564d3d8700 1 --2- 172.21.15.12:0/4077397409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480b5a70 0x7f56480b51d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5638009840 tx=0x7f5638009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f564d3d8700 1 -- 172.21.15.12:0/4077397409 shutdown_connections 2023-07-07T18:15:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f564d3d8700 1 --2- 172.21.15.12:0/4077397409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480b5a70 0x7f56480b51d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f564d3d8700 1 -- 172.21.15.12:0/4077397409 >> 172.21.15.12:0/4077397409 conn(0x7f5648071620 msgr2=0x7f56480719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f564d3d8700 1 -- 172.21.15.12:0/4077397409 shutdown_connections 2023-07-07T18:15:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.707+0000 7f564d3d8700 1 -- 172.21.15.12:0/4077397409 wait complete. 2023-07-07T18:15:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f564d3d8700 1 Processor -- start 2023-07-07T18:15:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f564d3d8700 1 -- start start 2023-07-07T18:15:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f564d3d8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56480cf910 0x7f564815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f564d3d8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480d0a60 0x7f564815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f564d3d8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f564815eae0 0x7f564815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f564d3d8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564815ef60 con 0x7f56480d0a60 2023-07-07T18:15:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f564d3d8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564815b810 con 0x7f56480cf910 2023-07-07T18:15:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f564d3d8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480c67d0 con 0x7f564815eae0 2023-07-07T18:15:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f56467fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480d0a60 0x7f564815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f56467fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480d0a60 0x7f564815e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58584/0 (socket says 172.21.15.12:58584) 2023-07-07T18:15:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.709+0000 7f56467fc700 1 -- 172.21.15.12:0/4079781056 learned_addr learned my addr 172.21.15.12:0/4079781056 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f5646ffd700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56480cf910 0x7f564815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f56477fe700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f564815eae0 0x7f564815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f56467fc700 1 -- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f564815eae0 msgr2=0x7f564815cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f56467fc700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f564815eae0 0x7f564815cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f56467fc700 1 -- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56480cf910 msgr2=0x7f564815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f56467fc700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56480cf910 0x7f564815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f56467fc700 1 -- 172.21.15.12:0/4079781056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56380094a0 con 0x7f56480d0a60 2023-07-07T18:15:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f5646ffd700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56480cf910 0x7f564815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f56467fc700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480d0a60 0x7f564815e5a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5638004000 tx=0x7f5638004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f562f7fe700 1 -- 172.21.15.12:0/4079781056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638003e90 con 0x7f56480d0a60 2023-07-07T18:15:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f562f7fe700 1 -- 172.21.15.12:0/4079781056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563801e070 con 0x7f56480d0a60 2023-07-07T18:15:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f562f7fe700 1 -- 172.21.15.12:0/4079781056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638011850 con 0x7f56480d0a60 2023-07-07T18:15:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564815d8d0 con 0x7f56480d0a60 2023-07-07T18:15:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.710+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564815de90 con 0x7f56480d0a60 2023-07-07T18:15:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.711+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56480c69d0 con 0x7f56480d0a60 2023-07-07T18:15:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.712+0000 7f562f7fe700 1 -- 172.21.15.12:0/4079781056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56380119b0 con 0x7f56480d0a60 2023-07-07T18:15:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.712+0000 7f562f7fe700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f563406ace0 0x7f563406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.712+0000 7f562f7fe700 1 -- 172.21.15.12:0/4079781056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f563808aa70 con 0x7f56480d0a60 2023-07-07T18:15:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.712+0000 7f5646ffd700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f563406ace0 0x7f563406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.713+0000 7f5646ffd700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f563406ace0 0x7f563406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f563c000f60 tx=0x7f563c007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.717+0000 7f562f7fe700 1 -- 172.21.15.12:0/4079781056 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56480c69d0 con 0x7f56480d0a60 2023-07-07T18:15:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.913+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56480c69d0 con 0x7f56480d0a60 2023-07-07T18:15:45.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.913+0000 7f562f7fe700 1 -- 172.21.15.12:0/4079781056 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56480c69d0 con 0x7f56480d0a60 2023-07-07T18:15:45.916 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:45.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f563406ace0 msgr2=0x7f563406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f563406ace0 0x7f563406d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f563c000f60 tx=0x7f563c007e50 comp rx=0 tx=0).stop 2023-07-07T18:15:45.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480d0a60 msgr2=0x7f564815e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:45.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480d0a60 0x7f564815e5a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5638004000 tx=0x7f5638004750 comp rx=0 tx=0).stop 2023-07-07T18:15:45.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 shutdown_connections 2023-07-07T18:15:45.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f563406ace0 0x7f563406d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f564815eae0 0x7f564815cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56480cf910 0x7f564815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 --2- 172.21.15.12:0/4079781056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56480d0a60 0x7f564815e5a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:45.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 >> 172.21.15.12:0/4079781056 conn(0x7f5648071620 msgr2=0x7f56480d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:45.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 shutdown_connections 2023-07-07T18:15:45.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:45.915+0000 7f564d3d8700 1 -- 172.21.15.12:0/4079781056 wait complete. 2023-07-07T18:15:45.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:46.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.055+0000 7ff7c81c3700 1 Processor -- start 2023-07-07T18:15:46.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.055+0000 7ff7c81c3700 1 -- start start 2023-07-07T18:15:46.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.056+0000 7ff7c81c3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c006e4d0 0x7ff7c00ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.056+0000 7ff7c81c3700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c006f0e0 con 0x7ff7c006e030 2023-07-07T18:15:46.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.056+0000 7ff7c81c3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c006eb20 con 0x7ff7c00cd5e0 2023-07-07T18:15:46.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.056+0000 7ff7c81c3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00ce2c0 con 0x7ff7c006e4d0 2023-07-07T18:15:46.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.056+0000 7ff7c575e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff7c006e030 0x7ff7c00acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55790/0 (socket says 172.21.15.12:55790) 2023-07-07T18:15:46.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.056+0000 7ff7c575e700 1 -- 172.21.15.12:0/3010407662 learned_addr learned my addr 172.21.15.12:0/3010407662 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:46.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.056+0000 7ff7c6760700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c006e4d0 0x7ff7c00ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.056+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555747827 0 0) 0x7ff7c006f0e0 con 0x7ff7c006e030 2023-07-07T18:15:46.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.056+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7ac0035b0 con 0x7ff7c006e030 2023-07-07T18:15:46.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 984673581 0 0) 0x7ff7ac0035b0 con 0x7ff7c006e030 2023-07-07T18:15:46.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c006e4d0 msgr2=0x7ff7c00ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:46.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c006e4d0 0x7ff7c00ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 >> v1:172.21.15.160:6789/0 conn(0x7ff7c00cd5e0 legacy=0x7ff7c00cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c006ee00 con 0x7ff7c006e030 2023-07-07T18:15:46.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7ff7bc001670 con 0x7ff7c006e030 2023-07-07T18:15:46.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 >> v1:172.21.15.12:6789/0 conn(0x7ff7c006e030 legacy=0x7ff7c00acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7ac003a30 0x7ff7ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c006e4d0 0x7ff7ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7ac004d90 0x7ff7ac005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00ce2c0 con 0x7ff7ac004d90 2023-07-07T18:15:46.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac00bac0 con 0x7ff7ac003a30 2023-07-07T18:15:46.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac00bc50 con 0x7ff7c006e4d0 2023-07-07T18:15:46.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c6760700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7ac004d90 0x7ff7ac005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c575e700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c006e4d0 0x7ff7ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c5f5f700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7ac003a30 0x7ff7ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c6760700 1 -- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c006e4d0 msgr2=0x7ff7ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:46.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c6760700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c006e4d0 0x7ff7ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c6760700 1 -- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7ac003a30 msgr2=0x7ff7ac003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:46.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c6760700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7ac003a30 0x7ff7ac003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c6760700 1 -- 172.21.15.12:0/3010407662 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac0035b0 con 0x7ff7ac004d90 2023-07-07T18:15:46.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c6760700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7ac004d90 0x7ff7ac005200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009fc0 tx=0x7ff7ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff57408f7545f008 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:46.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.057+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b800ec30 con 0x7ff7ac004d90 2023-07-07T18:15:46.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.058+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b800f040 con 0x7ff7ac004d90 2023-07-07T18:15:46.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.058+0000 7ff7c4f5d700 1 -- 172.21.15.12:0/3010407662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8014480 con 0x7ff7ac004d90 2023-07-07T18:15:46.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.058+0000 7ff7c81c3700 1 -- 172.21.15.12:0/3010407662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7ac004d90 msgr2=0x7ff7ac005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.058+0000 7ff7c81c3700 1 --2- 172.21.15.12:0/3010407662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7ac004d90 0x7ff7ac005200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8009fc0 tx=0x7ff7ac005880 comp rx=0 tx=0).stop 2023-07-07T18:15:46.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.058+0000 7ff7c6760700 1 -- 172.21.15.12:0/3010407662 reap_dead start 2023-07-07T18:15:46.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.058+0000 7ff7c81c3700 1 -- 172.21.15.12:0/3010407662 shutdown_connections 2023-07-07T18:15:46.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.058+0000 7ff7c81c3700 1 -- 172.21.15.12:0/3010407662 >> 172.21.15.12:0/3010407662 conn(0x7ff7c006b920 msgr2=0x7ff7c00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:46.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.058+0000 7ff7c81c3700 1 -- 172.21.15.12:0/3010407662 shutdown_connections 2023-07-07T18:15:46.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.058+0000 7ff7c81c3700 1 -- 172.21.15.12:0/3010407662 wait complete. 2023-07-07T18:15:46.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.060+0000 7ff7c81c3700 1 Processor -- start 2023-07-07T18:15:46.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.060+0000 7ff7c81c3700 1 -- start start 2023-07-07T18:15:46.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c81c3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7c0148dd0 0x7ff7c01f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c81c3700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c01491a0 0x7ff7c00b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c81c3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7c00b0a00 0x7ff7c009aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c81c3700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c0155370 con 0x7ff7c0148dd0 2023-07-07T18:15:46.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c81c3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c00b0ea0 con 0x7ff7c00b0a00 2023-07-07T18:15:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c81c3700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c01f0840 con 0x7ff7c01491a0 2023-07-07T18:15:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c5f5f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7c0148dd0 0x7ff7c01f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c5f5f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7c0148dd0 0x7ff7c01f0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58602/0 (socket says 172.21.15.12:58602) 2023-07-07T18:15:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c5f5f700 1 -- 172.21.15.12:0/107002357 learned_addr learned my addr 172.21.15.12:0/107002357 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c575e700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c01491a0 0x7ff7c00b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c6760700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7c00b0a00 0x7ff7c009aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c5f5f700 1 -- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c01491a0 msgr2=0x7ff7c00b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c5f5f700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c01491a0 0x7ff7c00b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c5f5f700 1 -- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7c00b0a00 msgr2=0x7ff7c009aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c5f5f700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7c00b0a00 0x7ff7c009aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c5f5f700 1 -- 172.21.15.12:0/107002357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c009b840 con 0x7ff7c0148dd0 2023-07-07T18:15:46.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c575e700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c01491a0 0x7ff7c00b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:46.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7c5f5f700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7c0148dd0 0x7ff7c01f0300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000f850 tx=0x7ff7b000fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:46.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7b67fc700 1 -- 172.21.15.12:0/107002357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000fe50 con 0x7ff7c0148dd0 2023-07-07T18:15:46.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.061+0000 7ff7b67fc700 1 -- 172.21.15.12:0/107002357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b00052e0 con 0x7ff7c0148dd0 2023-07-07T18:15:46.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.062+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c009bb20 con 0x7ff7c0148dd0 2023-07-07T18:15:46.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.062+0000 7ff7b67fc700 1 -- 172.21.15.12:0/107002357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b00036d0 con 0x7ff7c0148dd0 2023-07-07T18:15:46.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.062+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c009c0e0 con 0x7ff7c0148dd0 2023-07-07T18:15:46.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.062+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c004ea20 con 0x7ff7c0148dd0 2023-07-07T18:15:46.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.063+0000 7ff7b67fc700 1 -- 172.21.15.12:0/107002357 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7b0003830 con 0x7ff7c0148dd0 2023-07-07T18:15:46.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.063+0000 7ff7b67fc700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff7a406ad10 0x7ff7a406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.063+0000 7ff7b67fc700 1 -- 172.21.15.12:0/107002357 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff7b0089860 con 0x7ff7c0148dd0 2023-07-07T18:15:46.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.064+0000 7ff7c575e700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff7a406ad10 0x7ff7a406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.064+0000 7ff7c575e700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff7a406ad10 0x7ff7a406d1c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00ae6c0 tx=0x7ff7bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:46.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.068+0000 7ff7b67fc700 1 -- 172.21.15.12:0/107002357 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff7b00544b0 con 0x7ff7c0148dd0 2023-07-07T18:15:46.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.264+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff7c00b5990 con 0x7ff7c0148dd0 2023-07-07T18:15:46.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.265+0000 7ff7b67fc700 1 -- 172.21.15.12:0/107002357 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff7b0057ad0 con 0x7ff7c0148dd0 2023-07-07T18:15:46.267 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:46.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff7a406ad10 msgr2=0x7ff7a406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff7a406ad10 0x7ff7a406d1c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00ae6c0 tx=0x7ff7bc009040 comp rx=0 tx=0).stop 2023-07-07T18:15:46.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7c0148dd0 msgr2=0x7ff7c01f0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7c0148dd0 0x7ff7c01f0300 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff7b000f850 tx=0x7ff7b000fc10 comp rx=0 tx=0).stop 2023-07-07T18:15:46.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 shutdown_connections 2023-07-07T18:15:46.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff7a406ad10 0x7ff7a406d1c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff7c00b0a00 0x7ff7c009aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7c0148dd0 0x7ff7c01f0300 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 --2- 172.21.15.12:0/107002357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff7c01491a0 0x7ff7c00b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 >> 172.21.15.12:0/107002357 conn(0x7ff7c006b920 msgr2=0x7ff7c00aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:46.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 shutdown_connections 2023-07-07T18:15:46.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.267+0000 7ff7c81c3700 1 -- 172.21.15.12:0/107002357 wait complete. 2023-07-07T18:15:46.282 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-07T18:15:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.406+0000 7f91d0654700 1 Processor -- start 2023-07-07T18:15:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.406+0000 7f91d0654700 1 -- start start 2023-07-07T18:15:46.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91d0654700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f91c8159080 0x7f91c80cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91d0654700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80cb850 0x7f91c80cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91d0654700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c80c9df0 con 0x7f91c80ae6d0 2023-07-07T18:15:46.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91d0654700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c80cddf0 con 0x7f91c8159080 2023-07-07T18:15:46.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91d0654700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80ca3b0 con 0x7f91c80cb850 2023-07-07T18:15:46.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91cdbef700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f91c80ae6d0 0x7f91c815cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55808/0 (socket says 172.21.15.12:55808) 2023-07-07T18:15:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91cdbef700 1 -- 172.21.15.12:0/1728868947 learned_addr learned my addr 172.21.15.12:0/1728868947 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91cebf1700 1 --2- 172.21.15.12:0/1728868947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80cb850 0x7f91c80cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91ce3f0700 1 --2- 172.21.15.12:0/1728868947 >> v2:172.21.15.160:3300/0 conn(0x7f91c8159080 0x7f91c80cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91cd3ee700 1 -- 172.21.15.12:0/1728868947 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093969062 0 0) 0x7f91c80c9df0 con 0x7f91c80ae6d0 2023-07-07T18:15:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.407+0000 7f91cd3ee700 1 -- 172.21.15.12:0/1728868947 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b40035b0 con 0x7f91c80ae6d0 2023-07-07T18:15:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91cd3ee700 1 -- 172.21.15.12:0/1728868947 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280819220 0 0) 0x7f91b40035b0 con 0x7f91c80ae6d0 2023-07-07T18:15:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91cebf1700 1 -- 172.21.15.12:0/1728868947 >> v2:172.21.15.160:3300/0 conn(0x7f91c8159080 msgr2=0x7f91c80cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91cebf1700 1 --2- 172.21.15.12:0/1728868947 >> v2:172.21.15.160:3300/0 conn(0x7f91c8159080 0x7f91c80cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91cebf1700 1 -- 172.21.15.12:0/1728868947 >> v1:172.21.15.12:6789/0 conn(0x7f91c80ae6d0 legacy=0x7f91c815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91cebf1700 1 -- 172.21.15.12:0/1728868947 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c80cf560 con 0x7f91c80cb850 2023-07-07T18:15:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91ce3f0700 1 --2- 172.21.15.12:0/1728868947 >> v2:172.21.15.160:3300/0 conn(0x7f91c8159080 0x7f91c80cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91cebf1700 1 --2- 172.21.15.12:0/1728868947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80cb850 0x7f91c80cd8b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009d90 tx=0x7f91c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48a57f18afe197b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91cd3ee700 1 -- 172.21.15.12:0/1728868947 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c000e070 con 0x7f91c80cb850 2023-07-07T18:15:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91cd3ee700 1 -- 172.21.15.12:0/1728868947 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0003a20 con 0x7f91c80cb850 2023-07-07T18:15:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.408+0000 7f91cd3ee700 1 -- 172.21.15.12:0/1728868947 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4001670 con 0x7f91c80cb850 2023-07-07T18:15:46.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.409+0000 7f91d0654700 1 -- 172.21.15.12:0/1728868947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80cb850 msgr2=0x7f91c80cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.409+0000 7f91d0654700 1 --2- 172.21.15.12:0/1728868947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80cb850 0x7f91c80cd8b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009d90 tx=0x7f91c000b330 comp rx=0 tx=0).stop 2023-07-07T18:15:46.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.409+0000 7f91d0654700 1 -- 172.21.15.12:0/1728868947 shutdown_connections 2023-07-07T18:15:46.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.409+0000 7f91d0654700 1 --2- 172.21.15.12:0/1728868947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80cb850 0x7f91c80cd8b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.409+0000 7f91d0654700 1 --2- 172.21.15.12:0/1728868947 >> v2:172.21.15.160:3300/0 conn(0x7f91c8159080 0x7f91c80cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.409+0000 7f91d0654700 1 -- 172.21.15.12:0/1728868947 >> 172.21.15.12:0/1728868947 conn(0x7f91c806b920 msgr2=0x7f91c80cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:46.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.409+0000 7f91d0654700 1 -- 172.21.15.12:0/1728868947 shutdown_connections 2023-07-07T18:15:46.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.409+0000 7f91d0654700 1 -- 172.21.15.12:0/1728868947 wait complete. 2023-07-07T18:15:46.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.410+0000 7f91d0654700 1 Processor -- start 2023-07-07T18:15:46.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.410+0000 7f91d0654700 1 -- start start 2023-07-07T18:15:46.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91d0654700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80ae6d0 0x7f91c80c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91d0654700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91c80cb850 0x7f91c80adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91d0654700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c8159080 0x7f91c80ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91d0654700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c81535b0 con 0x7f91c80cb850 2023-07-07T18:15:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91d0654700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80b0af0 con 0x7f91c8159080 2023-07-07T18:15:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91d0654700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c80b0dd0 con 0x7f91c80ae6d0 2023-07-07T18:15:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cdbef700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91c80cb850 0x7f91c80adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cdbef700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91c80cb850 0x7f91c80adac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58618/0 (socket says 172.21.15.12:58618) 2023-07-07T18:15:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cdbef700 1 -- 172.21.15.12:0/2523013272 learned_addr learned my addr 172.21.15.12:0/2523013272 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91ce3f0700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80ae6d0 0x7f91c80c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cebf1700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c8159080 0x7f91c80ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cdbef700 1 -- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80ae6d0 msgr2=0x7f91c80c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cdbef700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80ae6d0 0x7f91c80c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cdbef700 1 -- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c8159080 msgr2=0x7f91c80ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cdbef700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c8159080 0x7f91c80ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cdbef700 1 -- 172.21.15.12:0/2523013272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80094a0 con 0x7f91c80cb850 2023-07-07T18:15:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cebf1700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c8159080 0x7f91c80ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91ce3f0700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80ae6d0 0x7f91c80c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91cdbef700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91c80cb850 0x7f91c80adac0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f91c400c520 tx=0x7f91c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91beffd700 1 -- 172.21.15.12:0/2523013272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4004c80 con 0x7f91c80cb850 2023-07-07T18:15:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91beffd700 1 -- 172.21.15.12:0/2523013272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c4004e20 con 0x7f91c80cb850 2023-07-07T18:15:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c0009a70 con 0x7f91c80cb850 2023-07-07T18:15:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.411+0000 7f91beffd700 1 -- 172.21.15.12:0/2523013272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c4007310 con 0x7f91c80cb850 2023-07-07T18:15:46.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.412+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c80b1390 con 0x7f91c80cb850 2023-07-07T18:15:46.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.412+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c8073910 con 0x7f91c80cb850 2023-07-07T18:15:46.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.413+0000 7f91beffd700 1 -- 172.21.15.12:0/2523013272 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91c4007470 con 0x7f91c80cb850 2023-07-07T18:15:46.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.413+0000 7f91beffd700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f91ac06ace0 0x7f91ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:46.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.413+0000 7f91beffd700 1 -- 172.21.15.12:0/2523013272 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f91c40894e0 con 0x7f91c80cb850 2023-07-07T18:15:46.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.414+0000 7f91ce3f0700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f91ac06ace0 0x7f91ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:46.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.414+0000 7f91ce3f0700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f91ac06ace0 0x7f91ac06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f91c80ada70 tx=0x7f91b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:46.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.418+0000 7f91beffd700 1 -- 172.21.15.12:0/2523013272 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f91c40542f0 con 0x7f91c80cb850 2023-07-07T18:15:46.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.631+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f91c8158780 con 0x7f91c80cb850 2023-07-07T18:15:46.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.631+0000 7f91beffd700 1 -- 172.21.15.12:0/2523013272 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f91c4057910 con 0x7f91c80cb850 2023-07-07T18:15:46.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f91ac06ace0 msgr2=0x7f91ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f91ac06ace0 0x7f91ac06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f91c80ada70 tx=0x7f91b8008040 comp rx=0 tx=0).stop 2023-07-07T18:15:46.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91c80cb850 msgr2=0x7f91c80adac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:46.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91c80cb850 0x7f91c80adac0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f91c400c520 tx=0x7f91c400c8e0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 shutdown_connections 2023-07-07T18:15:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f91ac06ace0 0x7f91ac06d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91c8159080 0x7f91c80ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91c80ae6d0 0x7f91c80c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 --2- 172.21.15.12:0/2523013272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91c80cb850 0x7f91c80adac0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 >> 172.21.15.12:0/2523013272 conn(0x7f91c806b920 msgr2=0x7f91c806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:46.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 shutdown_connections 2023-07-07T18:15:46.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:46.633+0000 7f91d0654700 1 -- 172.21.15.12:0/2523013272 wait complete. 2023-07-07T18:15:46.637 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-07-07T18:15:46.647 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-07T18:15:46.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:46.648 DEBUG:teuthology.orchestra.run.smithi160:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-07T18:15:46.703 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T18:15:46.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:46.704 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-07T18:15:46.729 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:15:46.729 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:46.748 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:15:46.749 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:46.806 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:15:46.806 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:46.863 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:47.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.027+0000 7f845453a700 1 Processor -- start 2023-07-07T18:15:47.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.027+0000 7f845453a700 1 -- start start 2023-07-07T18:15:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f845453a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f844c0cda80 0x7f844c0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f845453a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c0c9df0 con 0x7f844c159080 2023-07-07T18:15:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f845453a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c0ca3b0 con 0x7f844c0ae6d0 2023-07-07T18:15:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f845453a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844c0cf560 con 0x7f844c0cda80 2023-07-07T18:15:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84522d6700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f844c159080 0x7f844c0cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55822/0 (socket says 172.21.15.12:55822) 2023-07-07T18:15:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84522d6700 1 -- 172.21.15.12:0/3610851074 learned_addr learned my addr 172.21.15.12:0/3610851074 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f8452ad7700 1 --2- 172.21.15.12:0/3610851074 >> v2:172.21.15.160:3300/0 conn(0x7f844c0cda80 0x7f844c0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2309279379 0 0) 0x7f844c0c9df0 con 0x7f844c159080 2023-07-07T18:15:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84380035b0 con 0x7f844c159080 2023-07-07T18:15:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3716416881 0 0) 0x7f84380035b0 con 0x7f844c159080 2023-07-07T18:15:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 >> v2:172.21.15.160:3300/0 conn(0x7f844c0cda80 msgr2=0x7f844c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 --2- 172.21.15.12:0/3610851074 >> v2:172.21.15.160:3300/0 conn(0x7f844c0cda80 0x7f844c0caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 >> v1:172.21.15.160:6789/0 conn(0x7f844c0ae6d0 legacy=0x7f844c0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c0ccc70 con 0x7f844c159080 2023-07-07T18:15:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f8448001670 con 0x7f844c159080 2023-07-07T18:15:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 >> v1:172.21.15.12:6789/0 conn(0x7f844c159080 legacy=0x7f844c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.028+0000 7f84512d4700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8438003a00 0x7f8438003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84512d4700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8438004850 0x7f8438004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84512d4700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f843800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0cf560 con 0x7f8438005200 2023-07-07T18:15:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843800c110 con 0x7f8438003a00 2023-07-07T18:15:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843800c2d0 con 0x7f8438004850 2023-07-07T18:15:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f8452ad7700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f843800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84522d6700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8438003a00 0x7f8438003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f8451ad5700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8438004850 0x7f8438004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f8452ad7700 1 -- 172.21.15.12:0/3610851074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8438004850 msgr2=0x7f8438004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f8452ad7700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8438004850 0x7f8438004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f8452ad7700 1 -- 172.21.15.12:0/3610851074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8438003a00 msgr2=0x7f8438003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:47.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f8452ad7700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8438003a00 0x7f8438003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f8452ad7700 1 -- 172.21.15.12:0/3610851074 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380035b0 con 0x7f8438005200 2023-07-07T18:15:47.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84522d6700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8438003a00 0x7f8438003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:47.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f8452ad7700 1 -- 172.21.15.12:0/3610851074 reap_dead start 2023-07-07T18:15:47.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f8452ad7700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f843800ba10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8444009fc0 tx=0x7f8438005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea21dd8482289819 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:47.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444003a20 con 0x7f8438005200 2023-07-07T18:15:47.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844400f040 con 0x7f8438005200 2023-07-07T18:15:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.029+0000 7f84512d4700 1 -- 172.21.15.12:0/3610851074 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444003de0 con 0x7f8438005200 2023-07-07T18:15:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.030+0000 7f845453a700 1 -- 172.21.15.12:0/3610851074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 msgr2=0x7f843800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.030+0000 7f845453a700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f843800ba10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8444009fc0 tx=0x7f8438005880 comp rx=0 tx=0).stop 2023-07-07T18:15:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.030+0000 7f845453a700 1 -- 172.21.15.12:0/3610851074 shutdown_connections 2023-07-07T18:15:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.030+0000 7f845453a700 1 --2- 172.21.15.12:0/3610851074 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f843800ba10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.030+0000 7f845453a700 1 -- 172.21.15.12:0/3610851074 >> 172.21.15.12:0/3610851074 conn(0x7f844c06b920 msgr2=0x7f844c0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.030+0000 7f845453a700 1 -- 172.21.15.12:0/3610851074 shutdown_connections 2023-07-07T18:15:47.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.030+0000 7f845453a700 1 -- 172.21.15.12:0/3610851074 wait complete. 2023-07-07T18:15:47.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.031+0000 7f845453a700 1 Processor -- start 2023-07-07T18:15:47.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.031+0000 7f845453a700 1 -- start start 2023-07-07T18:15:47.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f845453a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f844c1eef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f845453a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f844c15b800 0x7f844c15bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f845453a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f844c1f1d10 0x7f844c1f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f845453a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0ae560 con 0x7f8438005200 2023-07-07T18:15:47.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f845453a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c15c1b0 con 0x7f844c15b800 2023-07-07T18:15:47.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f845453a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c1ef490 con 0x7f844c1f1d10 2023-07-07T18:15:47.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f84522d6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f844c1eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f84522d6700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f844c1eef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58636/0 (socket says 172.21.15.12:58636) 2023-07-07T18:15:47.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f84522d6700 1 -- 172.21.15.12:0/3591394859 learned_addr learned my addr 172.21.15.12:0/3591394859 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f8452ad7700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f844c1f1d10 0x7f844c1f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f8451ad5700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f844c15b800 0x7f844c15bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f84522d6700 1 -- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f844c1f1d10 msgr2=0x7f844c1f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f84522d6700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f844c1f1d10 0x7f844c1f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f84522d6700 1 -- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f844c15b800 msgr2=0x7f844c15bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.032+0000 7f84522d6700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f844c15b800 0x7f844c15bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.033+0000 7f84522d6700 1 -- 172.21.15.12:0/3591394859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c0ac610 con 0x7f8438005200 2023-07-07T18:15:47.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.033+0000 7f84522d6700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f844c1eef50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f844800e7b0 tx=0x7f844800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.033+0000 7f8442ffd700 1 -- 172.21.15.12:0/3591394859 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448012590 con 0x7f8438005200 2023-07-07T18:15:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.033+0000 7f8442ffd700 1 -- 172.21.15.12:0/3591394859 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84480126f0 con 0x7f8438005200 2023-07-07T18:15:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.033+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c0ac8f0 con 0x7f8438005200 2023-07-07T18:15:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.033+0000 7f8442ffd700 1 -- 172.21.15.12:0/3591394859 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448012a80 con 0x7f8438005200 2023-07-07T18:15:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.033+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c0aceb0 con 0x7f8438005200 2023-07-07T18:15:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.034+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c073910 con 0x7f8438005200 2023-07-07T18:15:47.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.034+0000 7f8442ffd700 1 -- 172.21.15.12:0/3591394859 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8448012be0 con 0x7f8438005200 2023-07-07T18:15:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.035+0000 7f8442ffd700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f843006ace0 0x7f843006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.035+0000 7f8442ffd700 1 -- 172.21.15.12:0/3591394859 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8448089630 con 0x7f8438005200 2023-07-07T18:15:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.035+0000 7f8451ad5700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f843006ace0 0x7f843006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.036+0000 7f8451ad5700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f843006ace0 0x7f843006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f844c06d820 tx=0x7f843c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:47.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.039+0000 7f8442ffd700 1 -- 172.21.15.12:0/3591394859 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8448054310 con 0x7f8438005200 2023-07-07T18:15:47.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.236+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f844c0cb940 con 0x7f8438005200 2023-07-07T18:15:47.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.238+0000 7f8442ffd700 1 -- 172.21.15.12:0/3591394859 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f8448057930 con 0x7f8438005200 2023-07-07T18:15:47.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:47.240 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f843006ace0 msgr2=0x7f843006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f843006ace0 0x7f843006d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f844c06d820 tx=0x7f843c009040 comp rx=0 tx=0).stop 2023-07-07T18:15:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 msgr2=0x7f844c1eef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f844c1eef50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f844800e7b0 tx=0x7f844800eb70 comp rx=0 tx=0).stop 2023-07-07T18:15:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 shutdown_connections 2023-07-07T18:15:47.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f843006ace0 0x7f843006d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f844c1f1d10 0x7f844c1f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8438005200 0x7f844c1eef50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 --2- 172.21.15.12:0/3591394859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f844c15b800 0x7f844c15bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 >> 172.21.15.12:0/3591394859 conn(0x7f844c06b920 msgr2=0x7f844c06e770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 shutdown_connections 2023-07-07T18:15:47.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.240+0000 7f845453a700 1 -- 172.21.15.12:0/3591394859 wait complete. 2023-07-07T18:15:47.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:47.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:47.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.381+0000 7f679963b700 1 Processor -- start 2023-07-07T18:15:47.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.381+0000 7f679963b700 1 -- start start 2023-07-07T18:15:47.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f679963b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67940d0a60 0x7f67940b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f679963b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f67940cf910 0x7f67940d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f679963b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67940cd9d0 con 0x7f67940b51d0 2023-07-07T18:15:47.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f679963b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67940d0060 con 0x7f67940d0a60 2023-07-07T18:15:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f679963b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67940b5620 con 0x7f67940cf910 2023-07-07T18:15:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f6792ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67940d0a60 0x7f67940b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f6792ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67940d0a60 0x7f67940b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58644/0 (socket says 172.21.15.12:58644) 2023-07-07T18:15:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f6792ffd700 1 -- 172.21.15.12:0/3922099262 learned_addr learned my addr 172.21.15.12:0/3922099262 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f67937fe700 1 --2- 172.21.15.12:0/3922099262 >> v2:172.21.15.160:3300/0 conn(0x7f67940cf910 0x7f67940d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f6792ffd700 1 -- 172.21.15.12:0/3922099262 >> v2:172.21.15.160:3300/0 conn(0x7f67940cf910 msgr2=0x7f67940d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f6792ffd700 1 --2- 172.21.15.12:0/3922099262 >> v2:172.21.15.160:3300/0 conn(0x7f67940cf910 0x7f67940d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f6792ffd700 1 -- 172.21.15.12:0/3922099262 >> v1:172.21.15.160:6789/0 conn(0x7f67940b51d0 legacy=0x7f67940d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.382+0000 7f6792ffd700 1 -- 172.21.15.12:0/3922099262 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67940cd410 con 0x7f67940d0a60 2023-07-07T18:15:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f6792ffd700 1 --2- 172.21.15.12:0/3922099262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940d0a60 0x7f67940b5a70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f67940b2610 tx=0x7f6788009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db894998365bc143 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f6791ffb700 1 -- 172.21.15.12:0/3922099262 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788004230 con 0x7f67940d0a60 2023-07-07T18:15:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f6791ffb700 1 -- 172.21.15.12:0/3922099262 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6788004390 con 0x7f67940d0a60 2023-07-07T18:15:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f6791ffb700 1 -- 172.21.15.12:0/3922099262 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880036a0 con 0x7f67940d0a60 2023-07-07T18:15:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f679963b700 1 -- 172.21.15.12:0/3922099262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940d0a60 msgr2=0x7f67940b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f679963b700 1 --2- 172.21.15.12:0/3922099262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940d0a60 0x7f67940b5a70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f67940b2610 tx=0x7f6788009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f679963b700 1 -- 172.21.15.12:0/3922099262 shutdown_connections 2023-07-07T18:15:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f679963b700 1 --2- 172.21.15.12:0/3922099262 >> v2:172.21.15.160:3300/0 conn(0x7f67940cf910 0x7f67940d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f679963b700 1 --2- 172.21.15.12:0/3922099262 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940d0a60 0x7f67940b5a70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f679963b700 1 -- 172.21.15.12:0/3922099262 >> 172.21.15.12:0/3922099262 conn(0x7f6794071620 msgr2=0x7f67940719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f679963b700 1 -- 172.21.15.12:0/3922099262 shutdown_connections 2023-07-07T18:15:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.383+0000 7f679963b700 1 -- 172.21.15.12:0/3922099262 wait complete. 2023-07-07T18:15:47.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.385+0000 7f679963b700 1 Processor -- start 2023-07-07T18:15:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.385+0000 7f679963b700 1 -- start start 2023-07-07T18:15:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f679963b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67940b51d0 0x7f6794148ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f679963b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940cf910 0x7f67940c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f679963b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67940d0a60 0x7f67940b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f679963b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67940b5a70 con 0x7f67940cf910 2023-07-07T18:15:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f679963b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67940b5d50 con 0x7f67940b51d0 2023-07-07T18:15:47.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f679963b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940b6030 con 0x7f67940d0a60 2023-07-07T18:15:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67927fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940cf910 0x7f67940c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67927fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940cf910 0x7f67940c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58650/0 (socket says 172.21.15.12:58650) 2023-07-07T18:15:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67927fc700 1 -- 172.21.15.12:0/976518560 learned_addr learned my addr 172.21.15.12:0/976518560 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f6792ffd700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67940b51d0 0x7f6794148ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67937fe700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67940d0a60 0x7f67940b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67927fc700 1 -- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67940d0a60 msgr2=0x7f67940b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67927fc700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67940d0a60 0x7f67940b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67927fc700 1 -- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67940b51d0 msgr2=0x7f6794148ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67927fc700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67940b51d0 0x7f6794148ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67927fc700 1 -- 172.21.15.12:0/976518560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788009550 con 0x7f67940cf910 2023-07-07T18:15:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67937fe700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67940d0a60 0x7f67940b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f67927fc700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940cf910 0x7f67940c88b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f678400c4d0 tx=0x7f678400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f677b7fe700 1 -- 172.21.15.12:0/976518560 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784011790 con 0x7f67940cf910 2023-07-07T18:15:47.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f677b7fe700 1 -- 172.21.15.12:0/976518560 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67840118f0 con 0x7f67940cf910 2023-07-07T18:15:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67940b6310 con 0x7f67940cf910 2023-07-07T18:15:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f677b7fe700 1 -- 172.21.15.12:0/976518560 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784011ca0 con 0x7f67940cf910 2023-07-07T18:15:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.386+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67940b68d0 con 0x7f67940cf910 2023-07-07T18:15:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.387+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679404ea20 con 0x7f67940cf910 2023-07-07T18:15:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.388+0000 7f677b7fe700 1 -- 172.21.15.12:0/976518560 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f678401c460 con 0x7f67940cf910 2023-07-07T18:15:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.388+0000 7f677b7fe700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f678006ace0 0x7f678006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.388+0000 7f677b7fe700 1 -- 172.21.15.12:0/976518560 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6784089560 con 0x7f67940cf910 2023-07-07T18:15:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.389+0000 7f6792ffd700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f678006ace0 0x7f678006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.389+0000 7f6792ffd700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f678006ace0 0x7f678006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6788009130 tx=0x7f6788008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:47.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.392+0000 7f677b7fe700 1 -- 172.21.15.12:0/976518560 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67840542e0 con 0x7f67940cf910 2023-07-07T18:15:47.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.588+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f679415c310 con 0x7f67940cf910 2023-07-07T18:15:47.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.589+0000 7f677b7fe700 1 -- 172.21.15.12:0/976518560 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6784057900 con 0x7f67940cf910 2023-07-07T18:15:47.591 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f678006ace0 msgr2=0x7f678006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f678006ace0 0x7f678006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6788009130 tx=0x7f6788008030 comp rx=0 tx=0).stop 2023-07-07T18:15:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940cf910 msgr2=0x7f67940c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940cf910 0x7f67940c88b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f678400c4d0 tx=0x7f678400c7e0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 shutdown_connections 2023-07-07T18:15:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f678006ace0 0x7f678006d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67940d0a60 0x7f67940b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67940b51d0 0x7f6794148ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 --2- 172.21.15.12:0/976518560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67940cf910 0x7f67940c88b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 >> 172.21.15.12:0/976518560 conn(0x7f6794071620 msgr2=0x7f67940b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:47.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 shutdown_connections 2023-07-07T18:15:47.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.591+0000 7f679963b700 1 -- 172.21.15.12:0/976518560 wait complete. 2023-07-07T18:15:47.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.731+0000 7f374ee28700 1 Processor -- start 2023-07-07T18:15:47.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.731+0000 7f374ee28700 1 -- start start 2023-07-07T18:15:47.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f374ee28700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37480cd5e0 0x7f37480cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f374ee28700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f374806e030 0x7f374806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f374ee28700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374806f0e0 con 0x7f374815cf70 2023-07-07T18:15:47.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f374ee28700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37480ce2c0 con 0x7f374806e030 2023-07-07T18:15:47.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f374ee28700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37480cdef0 con 0x7f37480cd5e0 2023-07-07T18:15:47.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f3747fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f374806e030 0x7f374806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f3747fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f374806e030 0x7f374806e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58656/0 (socket says 172.21.15.12:58656) 2023-07-07T18:15:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f374d3c5700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f374815cf70 0x7f374815d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55858/0 (socket says 172.21.15.12:55858) 2023-07-07T18:15:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f3747fff700 1 -- 172.21.15.12:0/1580565630 learned_addr learned my addr 172.21.15.12:0/1580565630 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f374cbc4700 1 --2- 172.21.15.12:0/1580565630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37480cd5e0 0x7f37480cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f3747fff700 1 -- 172.21.15.12:0/1580565630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37480cd5e0 msgr2=0x7f37480cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f3747fff700 1 --2- 172.21.15.12:0/1580565630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37480cd5e0 0x7f37480cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f3747fff700 1 -- 172.21.15.12:0/1580565630 >> v1:172.21.15.12:6789/0 conn(0x7f374815cf70 legacy=0x7f374815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f3747fff700 1 -- 172.21.15.12:0/1580565630 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374806eb20 con 0x7f374806e030 2023-07-07T18:15:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f37477fe700 1 -- 172.21.15.12:0/1580565630 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151740682 0 0) 0x7f374806f0e0 con 0x7f374815cf70 2023-07-07T18:15:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f374cbc4700 1 --2- 172.21.15.12:0/1580565630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37480cd5e0 0x7f37480cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f3747fff700 1 --2- 172.21.15.12:0/1580565630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374806e030 0x7f374806e4a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f37340098f0 tx=0x7f3734009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6121994a455ce7f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:47.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f37477fe700 1 -- 172.21.15.12:0/1580565630 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373400b8a0 con 0x7f374806e030 2023-07-07T18:15:47.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f37477fe700 1 -- 172.21.15.12:0/1580565630 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373400ba00 con 0x7f374806e030 2023-07-07T18:15:47.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.732+0000 7f37477fe700 1 -- 172.21.15.12:0/1580565630 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373400bd90 con 0x7f374806e030 2023-07-07T18:15:47.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.733+0000 7f374ee28700 1 -- 172.21.15.12:0/1580565630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374806e030 msgr2=0x7f374806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.733+0000 7f374ee28700 1 --2- 172.21.15.12:0/1580565630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374806e030 0x7f374806e4a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f37340098f0 tx=0x7f3734009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:47.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.733+0000 7f374ee28700 1 -- 172.21.15.12:0/1580565630 shutdown_connections 2023-07-07T18:15:47.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.733+0000 7f374ee28700 1 --2- 172.21.15.12:0/1580565630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37480cd5e0 0x7f37480cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.733+0000 7f374ee28700 1 --2- 172.21.15.12:0/1580565630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374806e030 0x7f374806e4a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.733+0000 7f374ee28700 1 -- 172.21.15.12:0/1580565630 >> 172.21.15.12:0/1580565630 conn(0x7f374806b920 msgr2=0x7f37480cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:47.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.733+0000 7f374ee28700 1 -- 172.21.15.12:0/1580565630 shutdown_connections 2023-07-07T18:15:47.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.733+0000 7f374ee28700 1 -- 172.21.15.12:0/1580565630 wait complete. 2023-07-07T18:15:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.734+0000 7f374ee28700 1 Processor -- start 2023-07-07T18:15:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.734+0000 7f374ee28700 1 -- start start 2023-07-07T18:15:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374ee28700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f374806e030 0x7f37480b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374ee28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37480cd5e0 0x7f3748152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374ee28700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374815cf70 0x7f37480b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374ee28700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37480b5830 con 0x7f374815cf70 2023-07-07T18:15:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374ee28700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3748152fb0 con 0x7f37480cd5e0 2023-07-07T18:15:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374ee28700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37480b4250 con 0x7f374806e030 2023-07-07T18:15:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374d3c5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374815cf70 0x7f37480b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374d3c5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374815cf70 0x7f37480b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58666/0 (socket says 172.21.15.12:58666) 2023-07-07T18:15:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374d3c5700 1 -- 172.21.15.12:0/4114691289 learned_addr learned my addr 172.21.15.12:0/4114691289 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:47.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f374cbc4700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f374806e030 0x7f37480b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.735+0000 7f3747fff700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37480cd5e0 0x7f3748152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f374d3c5700 1 -- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f374806e030 msgr2=0x7f37480b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f374d3c5700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f374806e030 0x7f37480b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f374d3c5700 1 -- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37480cd5e0 msgr2=0x7f3748152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f374d3c5700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37480cd5e0 0x7f3748152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f374d3c5700 1 -- 172.21.15.12:0/4114691289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734009550 con 0x7f374815cf70 2023-07-07T18:15:47.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f3747fff700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37480cd5e0 0x7f3748152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:47.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f374cbc4700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f374806e030 0x7f37480b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:47.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f374d3c5700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374815cf70 0x7f37480b38e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3740002230 tx=0x7f374000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:47.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f37457fa700 1 -- 172.21.15.12:0/4114691289 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000ac20 con 0x7f374815cf70 2023-07-07T18:15:47.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f37457fa700 1 -- 172.21.15.12:0/4114691289 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374000ada0 con 0x7f374815cf70 2023-07-07T18:15:47.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37480b4530 con 0x7f374815cf70 2023-07-07T18:15:47.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f37457fa700 1 -- 172.21.15.12:0/4114691289 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740007310 con 0x7f374815cf70 2023-07-07T18:15:47.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.736+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37480b4af0 con 0x7f374815cf70 2023-07-07T18:15:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.737+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37480c3060 con 0x7f374815cf70 2023-07-07T18:15:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.737+0000 7f37457fa700 1 -- 172.21.15.12:0/4114691289 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3740007470 con 0x7f374815cf70 2023-07-07T18:15:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.738+0000 7f37457fa700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f372c06ad10 0x7f372c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.738+0000 7f37457fa700 1 -- 172.21.15.12:0/4114691289 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3740089610 con 0x7f374815cf70 2023-07-07T18:15:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.738+0000 7f374cbc4700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f372c06ad10 0x7f372c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:47.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.739+0000 7f374cbc4700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f372c06ad10 0x7f372c06d1c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f373c00aaf0 tx=0x7f373c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:47.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.742+0000 7f37457fa700 1 -- 172.21.15.12:0/4114691289 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3740054420 con 0x7f374815cf70 2023-07-07T18:15:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.936+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f374804ea20 con 0x7f374815cf70 2023-07-07T18:15:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.937+0000 7f37457fa700 1 -- 172.21.15.12:0/4114691289 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3740057a40 con 0x7f374815cf70 2023-07-07T18:15:47.939 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f372c06ad10 msgr2=0x7f372c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f372c06ad10 0x7f372c06d1c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f373c00aaf0 tx=0x7f373c008040 comp rx=0 tx=0).stop 2023-07-07T18:15:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374815cf70 msgr2=0x7f37480b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374815cf70 0x7f37480b38e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3740002230 tx=0x7f374000a060 comp rx=0 tx=0).stop 2023-07-07T18:15:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 shutdown_connections 2023-07-07T18:15:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f372c06ad10 0x7f372c06d1c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f374815cf70 0x7f37480b38e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f374806e030 0x7f37480b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 --2- 172.21.15.12:0/4114691289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37480cd5e0 0x7f3748152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 >> 172.21.15.12:0/4114691289 conn(0x7f374806b920 msgr2=0x7f37480b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 shutdown_connections 2023-07-07T18:15:47.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:47.939+0000 7f374ee28700 1 -- 172.21.15.12:0/4114691289 wait complete. 2023-07-07T18:15:47.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:48.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.080+0000 7f1eca935700 1 Processor -- start 2023-07-07T18:15:48.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.081+0000 7f1eca935700 1 -- start start 2023-07-07T18:15:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.081+0000 7f1eca935700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ec406e970 0x7f1ec406a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.081+0000 7f1eca935700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec40ce620 con 0x7f1ec40aecc0 2023-07-07T18:15:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.081+0000 7f1eca935700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec4160580 con 0x7f1ec415fc60 2023-07-07T18:15:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.081+0000 7f1eca935700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec4160860 con 0x7f1ec406e970 2023-07-07T18:15:48.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.081+0000 7f1ec8ed2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ec406e970 0x7f1ec406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec8ed2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ec406e970 0x7f1ec406a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58674/0 (socket says 172.21.15.12:58674) 2023-07-07T18:15:48.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec37fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1ec40aecc0 0x7f1ec40cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55870/0 (socket says 172.21.15.12:55870) 2023-07-07T18:15:48.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec8ed2700 1 -- 172.21.15.12:0/2329475831 learned_addr learned my addr 172.21.15.12:0/2329475831 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:48.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec8ed2700 1 -- 172.21.15.12:0/2329475831 >> v1:172.21.15.160:6789/0 conn(0x7f1ec415fc60 legacy=0x7f1ec406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec8ed2700 1 -- 172.21.15.12:0/2329475831 >> v1:172.21.15.12:6789/0 conn(0x7f1ec40aecc0 legacy=0x7f1ec40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec2ffd700 1 -- 172.21.15.12:0/2329475831 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304235022 0 0) 0x7f1ec40ce620 con 0x7f1ec40aecc0 2023-07-07T18:15:48.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec8ed2700 1 -- 172.21.15.12:0/2329475831 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec4160b40 con 0x7f1ec406e970 2023-07-07T18:15:48.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec8ed2700 1 --2- 172.21.15.12:0/2329475831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec406e970 0x7f1ec406a900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009e50 tx=0x7f1ebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb70a594334e5c6b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:48.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec2ffd700 1 -- 172.21.15.12:0/2329475831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00e070 con 0x7f1ec406e970 2023-07-07T18:15:48.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec2ffd700 1 -- 172.21.15.12:0/2329475831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc00b9c0 con 0x7f1ec406e970 2023-07-07T18:15:48.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.082+0000 7f1ec2ffd700 1 -- 172.21.15.12:0/2329475831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00bd70 con 0x7f1ec406e970 2023-07-07T18:15:48.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.083+0000 7f1eca935700 1 -- 172.21.15.12:0/2329475831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec406e970 msgr2=0x7f1ec406a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.083+0000 7f1eca935700 1 --2- 172.21.15.12:0/2329475831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec406e970 0x7f1ec406a900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009e50 tx=0x7f1ebc00b330 comp rx=0 tx=0).stop 2023-07-07T18:15:48.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.083+0000 7f1eca935700 1 -- 172.21.15.12:0/2329475831 shutdown_connections 2023-07-07T18:15:48.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.083+0000 7f1eca935700 1 --2- 172.21.15.12:0/2329475831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec406e970 0x7f1ec406a900 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.083+0000 7f1eca935700 1 -- 172.21.15.12:0/2329475831 >> 172.21.15.12:0/2329475831 conn(0x7f1ec406b920 msgr2=0x7f1ec40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.083+0000 7f1eca935700 1 -- 172.21.15.12:0/2329475831 shutdown_connections 2023-07-07T18:15:48.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.083+0000 7f1eca935700 1 -- 172.21.15.12:0/2329475831 wait complete. 2023-07-07T18:15:48.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.084+0000 7f1eca935700 1 Processor -- start 2023-07-07T18:15:48.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.084+0000 7f1eca935700 1 -- start start 2023-07-07T18:15:48.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1eca935700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec406e970 0x7f1ec415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1eca935700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec40aecc0 0x7f1ec40b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1eca935700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec415fc60 0x7f1ec40ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1eca935700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec41e5f10 con 0x7f1ec415fc60 2023-07-07T18:15:48.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1eca935700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec41e61f0 con 0x7f1ec40aecc0 2023-07-07T18:15:48.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1eca935700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec41e64d0 con 0x7f1ec406e970 2023-07-07T18:15:48.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec8ed2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec415fc60 0x7f1ec40ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec8ed2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec415fc60 0x7f1ec40ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58680/0 (socket says 172.21.15.12:58680) 2023-07-07T18:15:48.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec8ed2700 1 -- 172.21.15.12:0/2828423069 learned_addr learned my addr 172.21.15.12:0/2828423069 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:48.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec3fff700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec406e970 0x7f1ec415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec37fe700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec40aecc0 0x7f1ec40b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec8ed2700 1 -- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec406e970 msgr2=0x7f1ec415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec8ed2700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec406e970 0x7f1ec415c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec8ed2700 1 -- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec40aecc0 msgr2=0x7f1ec40b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec8ed2700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec40aecc0 0x7f1ec40b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.085+0000 7f1ec8ed2700 1 -- 172.21.15.12:0/2828423069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc009b30 con 0x7f1ec415fc60 2023-07-07T18:15:48.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.086+0000 7f1ec8ed2700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec415fc60 0x7f1ec40ca290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc012000 tx=0x7f1ebc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:48.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.086+0000 7f1ec0ff9700 1 -- 172.21.15.12:0/2828423069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc01c640 con 0x7f1ec415fc60 2023-07-07T18:15:48.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.086+0000 7f1ec0ff9700 1 -- 172.21.15.12:0/2828423069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc01c7a0 con 0x7f1ec415fc60 2023-07-07T18:15:48.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.086+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec41e67b0 con 0x7f1ec415fc60 2023-07-07T18:15:48.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.086+0000 7f1ec0ff9700 1 -- 172.21.15.12:0/2828423069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc01cb30 con 0x7f1ec415fc60 2023-07-07T18:15:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.086+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec41e6d70 con 0x7f1ec415fc60 2023-07-07T18:15:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.087+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec404ea20 con 0x7f1ec415fc60 2023-07-07T18:15:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.087+0000 7f1ec0ff9700 1 -- 172.21.15.12:0/2828423069 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ebc01cc90 con 0x7f1ec415fc60 2023-07-07T18:15:48.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.088+0000 7f1ec0ff9700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1ea406ace0 0x7f1ea406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.088+0000 7f1ec0ff9700 1 -- 172.21.15.12:0/2828423069 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1ebc08b180 con 0x7f1ec415fc60 2023-07-07T18:15:48.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.088+0000 7f1ec3fff700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1ea406ace0 0x7f1ea406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.088+0000 7f1ec3fff700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1ea406ace0 0x7f1ea406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4000fb0 tx=0x7f1eb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:48.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.092+0000 7f1ec0ff9700 1 -- 172.21.15.12:0/2828423069 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1ebc055f90 con 0x7f1ec415fc60 2023-07-07T18:15:48.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.291+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ec40b5990 con 0x7f1ec415fc60 2023-07-07T18:15:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.291+0000 7f1ec0ff9700 1 -- 172.21.15.12:0/2828423069 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ebc0595b0 con 0x7f1ec415fc60 2023-07-07T18:15:48.293 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1ea406ace0 msgr2=0x7f1ea406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1ea406ace0 0x7f1ea406d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4000fb0 tx=0x7f1eb4009040 comp rx=0 tx=0).stop 2023-07-07T18:15:48.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec415fc60 msgr2=0x7f1ec40ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec415fc60 0x7f1ec40ca290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc012000 tx=0x7f1ebc004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 shutdown_connections 2023-07-07T18:15:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1ea406ace0 0x7f1ea406d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ec415fc60 0x7f1ec40ca290 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ec406e970 0x7f1ec415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 --2- 172.21.15.12:0/2828423069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ec40aecc0 0x7f1ec40b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 >> 172.21.15.12:0/2828423069 conn(0x7f1ec406b920 msgr2=0x7f1ec40ac650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 shutdown_connections 2023-07-07T18:15:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.293+0000 7f1eca935700 1 -- 172.21.15.12:0/2828423069 wait complete. 2023-07-07T18:15:48.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:48.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.433+0000 7f8997620700 1 Processor -- start 2023-07-07T18:15:48.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.433+0000 7f8997620700 1 -- start start 2023-07-07T18:15:48.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8997620700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f899006ccd0 0x7f899015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8997620700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89900cfd80 0x7f899006d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8997620700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89900cb380 con 0x7f8990070dc0 2023-07-07T18:15:48.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8997620700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899015b7a0 con 0x7f89900cfd80 2023-07-07T18:15:48.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8997620700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900c97f0 con 0x7f899006ccd0 2023-07-07T18:15:48.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8994bbb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89900cfd80 0x7f899006d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8995bbd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8990070dc0 0x7f8990071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55886/0 (socket says 172.21.15.12:55886) 2023-07-07T18:15:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8995bbd700 1 -- 172.21.15.12:0/1045338405 learned_addr learned my addr 172.21.15.12:0/1045338405 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f89953bc700 1 --2- 172.21.15.12:0/1045338405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f899006ccd0 0x7f899015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8994bbb700 1 -- 172.21.15.12:0/1045338405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f899006ccd0 msgr2=0x7f899015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8994bbb700 1 --2- 172.21.15.12:0/1045338405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f899006ccd0 0x7f899015b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8994bbb700 1 -- 172.21.15.12:0/1045338405 >> v1:172.21.15.12:6789/0 conn(0x7f8990070dc0 legacy=0x7f8990071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8983fff700 1 -- 172.21.15.12:0/1045338405 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313257700 0 0) 0x7f89900cb380 con 0x7f8990070dc0 2023-07-07T18:15:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8994bbb700 1 -- 172.21.15.12:0/1045338405 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899006d5e0 con 0x7f89900cfd80 2023-07-07T18:15:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f89953bc700 1 --2- 172.21.15.12:0/1045338405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f899006ccd0 0x7f899015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8994bbb700 1 --2- 172.21.15.12:0/1045338405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89900cfd80 0x7f899006d0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8984009840 tx=0x7f8984009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f35bd5de59c85a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8983fff700 1 -- 172.21.15.12:0/1045338405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984011830 con 0x7f89900cfd80 2023-07-07T18:15:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8983fff700 1 -- 172.21.15.12:0/1045338405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8984011990 con 0x7f89900cfd80 2023-07-07T18:15:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.434+0000 7f8983fff700 1 -- 172.21.15.12:0/1045338405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984011d20 con 0x7f89900cfd80 2023-07-07T18:15:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.435+0000 7f8997620700 1 -- 172.21.15.12:0/1045338405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89900cfd80 msgr2=0x7f899006d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.435+0000 7f8997620700 1 --2- 172.21.15.12:0/1045338405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89900cfd80 0x7f899006d0a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8984009840 tx=0x7f8984009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.435+0000 7f8997620700 1 -- 172.21.15.12:0/1045338405 shutdown_connections 2023-07-07T18:15:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.435+0000 7f8997620700 1 --2- 172.21.15.12:0/1045338405 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f899006ccd0 0x7f899015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.435+0000 7f8997620700 1 --2- 172.21.15.12:0/1045338405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89900cfd80 0x7f899006d0a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.435+0000 7f8997620700 1 -- 172.21.15.12:0/1045338405 >> 172.21.15.12:0/1045338405 conn(0x7f89900b1990 msgr2=0x7f89900cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.435+0000 7f8997620700 1 -- 172.21.15.12:0/1045338405 shutdown_connections 2023-07-07T18:15:48.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.435+0000 7f8997620700 1 -- 172.21.15.12:0/1045338405 wait complete. 2023-07-07T18:15:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.436+0000 7f8997620700 1 Processor -- start 2023-07-07T18:15:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.436+0000 7f8997620700 1 -- start start 2023-07-07T18:15:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f8997620700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f899006ccd0 0x7f8990159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f8997620700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8990070dc0 0x7f89901569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f8997620700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89900cfd80 0x7f89901540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f8997620700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89901f3c10 con 0x7f899006ccd0 2023-07-07T18:15:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f8997620700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89901f2f90 con 0x7f8990070dc0 2023-07-07T18:15:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f8997620700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89901f3270 con 0x7f89900cfd80 2023-07-07T18:15:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f89953bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f899006ccd0 0x7f8990159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f89953bc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f899006ccd0 0x7f8990159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58690/0 (socket says 172.21.15.12:58690) 2023-07-07T18:15:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f89953bc700 1 -- 172.21.15.12:0/1707722745 learned_addr learned my addr 172.21.15.12:0/1707722745 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:48.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f89953bc700 1 -- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89900cfd80 msgr2=0x7f89901540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f89953bc700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89900cfd80 0x7f89901540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f89953bc700 1 -- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8990070dc0 msgr2=0x7f89901569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f89953bc700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8990070dc0 0x7f89901569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.437+0000 7f89953bc700 1 -- 172.21.15.12:0/1707722745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89840094a0 con 0x7f899006ccd0 2023-07-07T18:15:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.438+0000 7f89953bc700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f899006ccd0 0x7f8990159750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f898c00c750 tx=0x7f898c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.438+0000 7f8981ffb700 1 -- 172.21.15.12:0/1707722745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c011800 con 0x7f899006ccd0 2023-07-07T18:15:48.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.438+0000 7f8981ffb700 1 -- 172.21.15.12:0/1707722745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c011960 con 0x7f899006ccd0 2023-07-07T18:15:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.438+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89901f3550 con 0x7f899006ccd0 2023-07-07T18:15:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.438+0000 7f8981ffb700 1 -- 172.21.15.12:0/1707722745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c011cd0 con 0x7f899006ccd0 2023-07-07T18:15:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.438+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89901565d0 con 0x7f899006ccd0 2023-07-07T18:15:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.439+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89901f3d50 con 0x7f899006ccd0 2023-07-07T18:15:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.439+0000 7f8981ffb700 1 -- 172.21.15.12:0/1707722745 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f898c021350 con 0x7f899006ccd0 2023-07-07T18:15:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.440+0000 7f8981ffb700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f897406ace0 0x7f897406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.440+0000 7f8981ffb700 1 -- 172.21.15.12:0/1707722745 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f898c089700 con 0x7f899006ccd0 2023-07-07T18:15:48.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.440+0000 7f8994bbb700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f897406ace0 0x7f897406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.441+0000 7f8994bbb700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f897406ace0 0x7f897406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f89900c3410 tx=0x7f8984010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:48.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.444+0000 7f8981ffb700 1 -- 172.21.15.12:0/1707722745 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89901f3d50 con 0x7f899006ccd0 2023-07-07T18:15:48.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.641+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89901f3d50 con 0x7f899006ccd0 2023-07-07T18:15:48.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.642+0000 7f8981ffb700 1 -- 172.21.15.12:0/1707722745 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89901f3d50 con 0x7f899006ccd0 2023-07-07T18:15:48.644 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f897406ace0 msgr2=0x7f897406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f897406ace0 0x7f897406d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f89900c3410 tx=0x7f8984010000 comp rx=0 tx=0).stop 2023-07-07T18:15:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f899006ccd0 msgr2=0x7f8990159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f899006ccd0 0x7f8990159750 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f898c00c750 tx=0x7f898c00cb10 comp rx=0 tx=0).stop 2023-07-07T18:15:48.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 shutdown_connections 2023-07-07T18:15:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f897406ace0 0x7f897406d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89900cfd80 0x7f89901540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f899006ccd0 0x7f8990159750 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 --2- 172.21.15.12:0/1707722745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8990070dc0 0x7f89901569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 >> 172.21.15.12:0/1707722745 conn(0x7f89900b1990 msgr2=0x7f8990069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 shutdown_connections 2023-07-07T18:15:48.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.644+0000 7f8997620700 1 -- 172.21.15.12:0/1707722745 wait complete. 2023-07-07T18:15:48.658 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:48.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.785+0000 7fcf5e346700 1 Processor -- start 2023-07-07T18:15:48.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.785+0000 7fcf5e346700 1 -- start start 2023-07-07T18:15:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.785+0000 7fcf5e346700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 0x7fcf580cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.785+0000 7fcf5e346700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf5806e030 0x7fcf5806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.785+0000 7fcf5e346700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5806f0e0 con 0x7fcf5815cf70 2023-07-07T18:15:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.785+0000 7fcf5e346700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf580ce2c0 con 0x7fcf5806e030 2023-07-07T18:15:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.785+0000 7fcf5e346700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580cdef0 con 0x7fcf580cd5e0 2023-07-07T18:15:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf577fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf5806e030 0x7fcf5806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf5c8e3700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcf5815cf70 0x7fcf5815d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55900/0 (socket says 172.21.15.12:55900) 2023-07-07T18:15:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf5c8e3700 1 -- 172.21.15.12:0/2699584428 learned_addr learned my addr 172.21.15.12:0/2699584428 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf57fff700 1 --2- 172.21.15.12:0/2699584428 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 0x7fcf580cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf577fe700 1 -- 172.21.15.12:0/2699584428 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 msgr2=0x7fcf580cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf577fe700 1 --2- 172.21.15.12:0/2699584428 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 0x7fcf580cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf577fe700 1 -- 172.21.15.12:0/2699584428 >> v1:172.21.15.12:6789/0 conn(0x7fcf5815cf70 legacy=0x7fcf5815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf577fe700 1 -- 172.21.15.12:0/2699584428 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5806eb20 con 0x7fcf5806e030 2023-07-07T18:15:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf56ffd700 1 -- 172.21.15.12:0/2699584428 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072147423 0 0) 0x7fcf5806f0e0 con 0x7fcf5815cf70 2023-07-07T18:15:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf577fe700 1 --2- 172.21.15.12:0/2699584428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5806e030 0x7fcf5806e4a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009840 tx=0x7fcf48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6c552ca4e9257e server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf56ffd700 1 -- 172.21.15.12:0/2699584428 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48011830 con 0x7fcf5806e030 2023-07-07T18:15:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf56ffd700 1 -- 172.21.15.12:0/2699584428 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf48011990 con 0x7fcf5806e030 2023-07-07T18:15:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.786+0000 7fcf56ffd700 1 -- 172.21.15.12:0/2699584428 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48011d20 con 0x7fcf5806e030 2023-07-07T18:15:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.787+0000 7fcf5e346700 1 -- 172.21.15.12:0/2699584428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5806e030 msgr2=0x7fcf5806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.787+0000 7fcf5e346700 1 --2- 172.21.15.12:0/2699584428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5806e030 0x7fcf5806e4a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcf48009840 tx=0x7fcf48009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.787+0000 7fcf5e346700 1 -- 172.21.15.12:0/2699584428 shutdown_connections 2023-07-07T18:15:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.787+0000 7fcf5e346700 1 --2- 172.21.15.12:0/2699584428 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 0x7fcf580cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.787+0000 7fcf5e346700 1 --2- 172.21.15.12:0/2699584428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5806e030 0x7fcf5806e4a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.787+0000 7fcf5e346700 1 -- 172.21.15.12:0/2699584428 >> 172.21.15.12:0/2699584428 conn(0x7fcf5806b920 msgr2=0x7fcf580cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.787+0000 7fcf5e346700 1 -- 172.21.15.12:0/2699584428 shutdown_connections 2023-07-07T18:15:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.787+0000 7fcf5e346700 1 -- 172.21.15.12:0/2699584428 wait complete. 2023-07-07T18:15:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.788+0000 7fcf5e346700 1 Processor -- start 2023-07-07T18:15:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.789+0000 7fcf5e346700 1 -- start start 2023-07-07T18:15:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5e346700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf5806e030 0x7fcf5814e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5e346700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 0x7fcf58069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5e346700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5815cf70 0x7fcf5806a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5e346700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58151990 con 0x7fcf5815cf70 2023-07-07T18:15:48.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5e346700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf581508f0 con 0x7fcf5806e030 2023-07-07T18:15:48.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5e346700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58150bd0 con 0x7fcf580cd5e0 2023-07-07T18:15:48.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5c8e3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5815cf70 0x7fcf5806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5c8e3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5815cf70 0x7fcf5806a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58708/0 (socket says 172.21.15.12:58708) 2023-07-07T18:15:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5c8e3700 1 -- 172.21.15.12:0/2052095133 learned_addr learned my addr 172.21.15.12:0/2052095133 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf57fff700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf5806e030 0x7fcf5814e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf577fe700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 0x7fcf58069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5c8e3700 1 -- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 msgr2=0x7fcf58069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5c8e3700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 0x7fcf58069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5c8e3700 1 -- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf5806e030 msgr2=0x7fcf5814e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5c8e3700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf5806e030 0x7fcf5814e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5c8e3700 1 -- 172.21.15.12:0/2052095133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf480094a0 con 0x7fcf5815cf70 2023-07-07T18:15:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5c8e3700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5815cf70 0x7fcf5806a430 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcf50002230 tx=0x7fcf5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf54ff9700 1 -- 172.21.15.12:0/2052095133 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5000ac20 con 0x7fcf5815cf70 2023-07-07T18:15:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf54ff9700 1 -- 172.21.15.12:0/2052095133 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5000ada0 con 0x7fcf5815cf70 2023-07-07T18:15:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf58150eb0 con 0x7fcf5815cf70 2023-07-07T18:15:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf54ff9700 1 -- 172.21.15.12:0/2052095133 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50007310 con 0x7fcf5815cf70 2023-07-07T18:15:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.790+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58151470 con 0x7fcf5815cf70 2023-07-07T18:15:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.791+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf58151660 con 0x7fcf5815cf70 2023-07-07T18:15:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.792+0000 7fcf54ff9700 1 -- 172.21.15.12:0/2052095133 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf50007470 con 0x7fcf5815cf70 2023-07-07T18:15:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.792+0000 7fcf54ff9700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf4406ace0 0x7fcf4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.792+0000 7fcf54ff9700 1 -- 172.21.15.12:0/2052095133 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcf500897c0 con 0x7fcf5815cf70 2023-07-07T18:15:48.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.792+0000 7fcf57fff700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf4406ace0 0x7fcf4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:48.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.793+0000 7fcf57fff700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf4406ace0 0x7fcf4406d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009b50 tx=0x7fcf4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:48.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.797+0000 7fcf54ff9700 1 -- 172.21.15.12:0/2052095133 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf500544b0 con 0x7fcf5815cf70 2023-07-07T18:15:48.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.997+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcf5804ea20 con 0x7fcf5815cf70 2023-07-07T18:15:48.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.997+0000 7fcf54ff9700 1 -- 172.21.15.12:0/2052095133 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcf500180a0 con 0x7fcf5815cf70 2023-07-07T18:15:48.999 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:49.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf4406ace0 msgr2=0x7fcf4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf4406ace0 0x7fcf4406d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009b50 tx=0x7fcf4c008040 comp rx=0 tx=0).stop 2023-07-07T18:15:49.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5815cf70 msgr2=0x7fcf5806a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5815cf70 0x7fcf5806a430 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcf50002230 tx=0x7fcf5000a060 comp rx=0 tx=0).stop 2023-07-07T18:15:49.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 shutdown_connections 2023-07-07T18:15:49.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf4406ace0 0x7fcf4406d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5815cf70 0x7fcf5806a430 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf5806e030 0x7fcf5814e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 --2- 172.21.15.12:0/2052095133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf580cd5e0 0x7fcf58069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 >> 172.21.15.12:0/2052095133 conn(0x7fcf5806b920 msgr2=0x7fcf581588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:49.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 shutdown_connections 2023-07-07T18:15:49.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:48.999+0000 7fcf5e346700 1 -- 172.21.15.12:0/2052095133 wait complete. 2023-07-07T18:15:49.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-07T18:15:49.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.137+0000 7ff3250bd700 1 Processor -- start 2023-07-07T18:15:49.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.137+0000 7ff3250bd700 1 -- start start 2023-07-07T18:15:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff3250bd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff3200cd830 0x7ff320160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff3250bd700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3201610a0 con 0x7ff320160880 2023-07-07T18:15:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff3250bd700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32015da90 con 0x7ff32015c570 2023-07-07T18:15:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff3250bd700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32015d670 con 0x7ff3200cd830 2023-07-07T18:15:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31f59e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff320160880 0x7ff3200d0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55914/0 (socket says 172.21.15.12:55914) 2023-07-07T18:15:49.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31f59e700 1 -- 172.21.15.12:0/2402991063 learned_addr learned my addr 172.21.15.12:0/2402991063 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31e59c700 1 --2- 172.21.15.12:0/2402991063 >> v2:172.21.15.160:3300/0 conn(0x7ff3200cd830 0x7ff320160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950720401 0 0) 0x7ff3201610a0 con 0x7ff320160880 2023-07-07T18:15:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3080035b0 con 0x7ff320160880 2023-07-07T18:15:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503451128 0 0) 0x7ff3080035b0 con 0x7ff320160880 2023-07-07T18:15:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 >> v2:172.21.15.160:3300/0 conn(0x7ff3200cd830 msgr2=0x7ff320160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:49.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 --2- 172.21.15.12:0/2402991063 >> v2:172.21.15.160:3300/0 conn(0x7ff3200cd830 0x7ff320160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 >> v1:172.21.15.160:6789/0 conn(0x7ff32015c570 legacy=0x7ff3200cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32015ccd0 con 0x7ff320160880 2023-07-07T18:15:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7ff3180019f0 con 0x7ff320160880 2023-07-07T18:15:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31e59c700 1 --2- 172.21.15.12:0/2402991063 >> v2:172.21.15.160:3300/0 conn(0x7ff3200cd830 0x7ff320160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 >> v1:172.21.15.12:6789/0 conn(0x7ff320160880 legacy=0x7ff3200d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff308003a00 0x7ff308003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff308004850 0x7ff308004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff308005200 0x7ff30800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32015d670 con 0x7ff308005200 2023-07-07T18:15:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30800c080 con 0x7ff308003a00 2023-07-07T18:15:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.138+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30800c240 con 0x7ff308004850 2023-07-07T18:15:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31f59e700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff308005200 0x7ff30800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31e59c700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff308004850 0x7ff308004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31ed9d700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff308003a00 0x7ff308003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31f59e700 1 -- 172.21.15.12:0/2402991063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff308004850 msgr2=0x7ff308004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31f59e700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff308004850 0x7ff308004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31f59e700 1 -- 172.21.15.12:0/2402991063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff308003a00 msgr2=0x7ff308003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31f59e700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff308003a00 0x7ff308003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31f59e700 1 -- 172.21.15.12:0/2402991063 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3080035b0 con 0x7ff308005200 2023-07-07T18:15:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31f59e700 1 -- 172.21.15.12:0/2402991063 reap_dead start 2023-07-07T18:15:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31f59e700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff308005200 0x7ff30800ba10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff31800a820 tx=0x7ff308005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3628ac46f7eadc60 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:49.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31800a2f0 con 0x7ff308005200 2023-07-07T18:15:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff318012620 con 0x7ff308005200 2023-07-07T18:15:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.139+0000 7ff31dd9b700 1 -- 172.21.15.12:0/2402991063 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3180129d0 con 0x7ff308005200 2023-07-07T18:15:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.140+0000 7ff3250bd700 1 -- 172.21.15.12:0/2402991063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff308005200 msgr2=0x7ff30800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.140+0000 7ff3250bd700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff308005200 0x7ff30800ba10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff31800a820 tx=0x7ff308005880 comp rx=0 tx=0).stop 2023-07-07T18:15:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.140+0000 7ff3250bd700 1 -- 172.21.15.12:0/2402991063 shutdown_connections 2023-07-07T18:15:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.140+0000 7ff3250bd700 1 --2- 172.21.15.12:0/2402991063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff308005200 0x7ff30800ba10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.140+0000 7ff3250bd700 1 -- 172.21.15.12:0/2402991063 >> 172.21.15.12:0/2402991063 conn(0x7ff320071620 msgr2=0x7ff3200719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:49.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.140+0000 7ff3250bd700 1 -- 172.21.15.12:0/2402991063 shutdown_connections 2023-07-07T18:15:49.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.140+0000 7ff3250bd700 1 -- 172.21.15.12:0/2402991063 wait complete. 2023-07-07T18:15:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.141+0000 7ff3250bd700 1 Processor -- start 2023-07-07T18:15:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.141+0000 7ff3250bd700 1 -- start start 2023-07-07T18:15:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff3250bd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff308005200 0x7ff3200c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff3250bd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3201493a0 0x7ff3200cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff3250bd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3201f5810 0x7ff3201f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff3250bd700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200b73e0 con 0x7ff3201493a0 2023-07-07T18:15:49.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff3250bd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200b6bd0 con 0x7ff3201f5810 2023-07-07T18:15:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff3250bd700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3201f5380 con 0x7ff308005200 2023-07-07T18:15:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff31e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3201493a0 0x7ff3200cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff31e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3201493a0 0x7ff3200cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58726/0 (socket says 172.21.15.12:58726) 2023-07-07T18:15:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff31e59c700 1 -- 172.21.15.12:0/216172440 learned_addr learned my addr 172.21.15.12:0/216172440 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff31f59e700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3201f5810 0x7ff3201f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.142+0000 7ff31ed9d700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff308005200 0x7ff3200c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff31e59c700 1 -- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff308005200 msgr2=0x7ff3200c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff31e59c700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff308005200 0x7ff3200c9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff31e59c700 1 -- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3201f5810 msgr2=0x7ff3201f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff31e59c700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3201f5810 0x7ff3201f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff31e59c700 1 -- 172.21.15.12:0/216172440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3200b6e20 con 0x7ff3201493a0 2023-07-07T18:15:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff31e59c700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3201493a0 0x7ff3200cacb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff310011ca0 tx=0x7ff310009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:49.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff3077fe700 1 -- 172.21.15.12:0/216172440 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31000fa00 con 0x7ff3201493a0 2023-07-07T18:15:49.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff3077fe700 1 -- 172.21.15.12:0/216172440 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31000fb60 con 0x7ff3201493a0 2023-07-07T18:15:49.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3200b7100 con 0x7ff3201493a0 2023-07-07T18:15:49.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff3077fe700 1 -- 172.21.15.12:0/216172440 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff310004020 con 0x7ff3201493a0 2023-07-07T18:15:49.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.143+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3200cb1f0 con 0x7ff3201493a0 2023-07-07T18:15:49.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.144+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3201f5150 con 0x7ff3201493a0 2023-07-07T18:15:49.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.145+0000 7ff3077fe700 1 -- 172.21.15.12:0/216172440 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff310004180 con 0x7ff3201493a0 2023-07-07T18:15:49.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.145+0000 7ff3077fe700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff30c06ace0 0x7ff30c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.145+0000 7ff3077fe700 1 -- 172.21.15.12:0/216172440 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff310089ba0 con 0x7ff3201493a0 2023-07-07T18:15:49.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.145+0000 7ff31ed9d700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff30c06ace0 0x7ff30c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.146+0000 7ff31ed9d700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff30c06ace0 0x7ff30c06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b4be0 tx=0x7ff314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:49.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.150+0000 7ff3077fe700 1 -- 172.21.15.12:0/216172440 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3201f5150 con 0x7ff3201493a0 2023-07-07T18:15:49.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.364+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff3201f5150 con 0x7ff3201493a0 2023-07-07T18:15:49.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.364+0000 7ff3077fe700 1 -- 172.21.15.12:0/216172440 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff3201f5150 con 0x7ff3201493a0 2023-07-07T18:15:49.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.366+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff30c06ace0 msgr2=0x7ff30c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.366+0000 7ff3250bd700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff30c06ace0 0x7ff30c06d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3200b4be0 tx=0x7ff314009040 comp rx=0 tx=0).stop 2023-07-07T18:15:49.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.366+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3201493a0 msgr2=0x7ff3200cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.366+0000 7ff3250bd700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3201493a0 0x7ff3200cacb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff310011ca0 tx=0x7ff310009e80 comp rx=0 tx=0).stop 2023-07-07T18:15:49.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.367+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 shutdown_connections 2023-07-07T18:15:49.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.367+0000 7ff3250bd700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff30c06ace0 0x7ff30c06d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.367+0000 7ff3250bd700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3201f5810 0x7ff3201f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.367+0000 7ff3250bd700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff308005200 0x7ff3200c9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.367+0000 7ff3250bd700 1 --2- 172.21.15.12:0/216172440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3201493a0 0x7ff3200cacb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.367+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 >> 172.21.15.12:0/216172440 conn(0x7ff320071620 msgr2=0x7ff32015e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:49.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.367+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 shutdown_connections 2023-07-07T18:15:49.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.367+0000 7ff3250bd700 1 -- 172.21.15.12:0/216172440 wait complete. 2023-07-07T18:15:49.371 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-07-07T18:15:49.380 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-07T18:15:49.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:49.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-07T18:15:49.424 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T18:15:49.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:49.425 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-07T18:15:49.482 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:15:49.483 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:49.504 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:15:49.504 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:49.564 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T18:15:49.564 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:15:49.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:49.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.747+0000 7fb8d2b28700 1 Processor -- start 2023-07-07T18:15:49.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.747+0000 7fb8d2b28700 1 -- start start 2023-07-07T18:15:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d2b28700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8cc15a640 0x7fb8cc06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d2b28700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc0d05d0 0x7fb8cc0ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d2b28700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8cc0ae580 con 0x7fb8cc0ceab0 2023-07-07T18:15:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d2b28700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8cc0cef50 con 0x7fb8cc15a640 2023-07-07T18:15:49.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d2b28700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0adf70 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d08c4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8cc15a640 0x7fb8cc06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d08c4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8cc15a640 0x7fb8cc06fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58732/0 (socket says 172.21.15.12:58732) 2023-07-07T18:15:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d08c4700 1 -- 172.21.15.12:0/269945067 learned_addr learned my addr 172.21.15.12:0/269945067 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8cbfff700 1 --2- 172.21.15.12:0/269945067 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc0d05d0 0x7fb8cc0ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d08c4700 1 -- 172.21.15.12:0/269945067 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc0d05d0 msgr2=0x7fb8cc0ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.748+0000 7fb8d08c4700 1 --2- 172.21.15.12:0/269945067 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc0d05d0 0x7fb8cc0ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.749+0000 7fb8d08c4700 1 -- 172.21.15.12:0/269945067 >> v1:172.21.15.160:6789/0 conn(0x7fb8cc0ceab0 legacy=0x7fb8cc06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.749+0000 7fb8d08c4700 1 -- 172.21.15.12:0/269945067 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc06f860 con 0x7fb8cc15a640 2023-07-07T18:15:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.749+0000 7fb8d08c4700 1 --2- 172.21.15.12:0/269945067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc15a640 0x7fb8cc06fe80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00098f0 tx=0x7fb8c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70907ffc7b7bd10 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.749+0000 7fb8cb7fe700 1 -- 172.21.15.12:0/269945067 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0011830 con 0x7fb8cc15a640 2023-07-07T18:15:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.749+0000 7fb8cb7fe700 1 -- 172.21.15.12:0/269945067 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0011990 con 0x7fb8cc15a640 2023-07-07T18:15:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.749+0000 7fb8cb7fe700 1 -- 172.21.15.12:0/269945067 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0011d20 con 0x7fb8cc15a640 2023-07-07T18:15:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.749+0000 7fb8d2b28700 1 -- 172.21.15.12:0/269945067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc15a640 msgr2=0x7fb8cc06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.749+0000 7fb8d2b28700 1 --2- 172.21.15.12:0/269945067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc15a640 0x7fb8cc06fe80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00098f0 tx=0x7fb8c0009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.749+0000 7fb8d2b28700 1 -- 172.21.15.12:0/269945067 shutdown_connections 2023-07-07T18:15:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.750+0000 7fb8d2b28700 1 --2- 172.21.15.12:0/269945067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc15a640 0x7fb8cc06fe80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.750+0000 7fb8d2b28700 1 --2- 172.21.15.12:0/269945067 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc0d05d0 0x7fb8cc0ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.750+0000 7fb8d2b28700 1 -- 172.21.15.12:0/269945067 >> 172.21.15.12:0/269945067 conn(0x7fb8cc089fe0 msgr2=0x7fb8cc0d09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.750+0000 7fb8d2b28700 1 -- 172.21.15.12:0/269945067 shutdown_connections 2023-07-07T18:15:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.750+0000 7fb8d2b28700 1 -- 172.21.15.12:0/269945067 wait complete. 2023-07-07T18:15:49.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.751+0000 7fb8d2b28700 1 Processor -- start 2023-07-07T18:15:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.751+0000 7fb8d2b28700 1 -- start start 2023-07-07T18:15:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.752+0000 7fb8d2b28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8cc0ceab0 0x7fb8cc154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.752+0000 7fb8d2b28700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc0d05d0 0x7fb8cc0b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.752+0000 7fb8d2b28700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc15a640 0x7fb8cc15b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.752+0000 7fb8d2b28700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc1555e0 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.752+0000 7fb8d2b28700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0b1470 con 0x7fb8cc0ceab0 2023-07-07T18:15:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.752+0000 7fb8d2b28700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8cc0b1750 con 0x7fb8cc15a640 2023-07-07T18:15:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.752+0000 7fb8cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc0d05d0 0x7fb8cc0b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.752+0000 7fb8cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc0d05d0 0x7fb8cc0b2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58742/0 (socket says 172.21.15.12:58742) 2023-07-07T18:15:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.752+0000 7fb8cbfff700 1 -- 172.21.15.12:0/1652363285 learned_addr learned my addr 172.21.15.12:0/1652363285 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8d08c4700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8cc0ceab0 0x7fb8cc154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8d10c5700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc15a640 0x7fb8cc15b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8cbfff700 1 -- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc15a640 msgr2=0x7fb8cc15b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8cbfff700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc15a640 0x7fb8cc15b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8cbfff700 1 -- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8cc0ceab0 msgr2=0x7fb8cc154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8cbfff700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8cc0ceab0 0x7fb8cc154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8cbfff700 1 -- 172.21.15.12:0/1652363285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c0009550 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8d08c4700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8cc0ceab0 0x7fb8cc154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8d10c5700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc15a640 0x7fb8cc15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8cbfff700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc0d05d0 0x7fb8cc0b2510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800e9b0 tx=0x7fb8b800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8c97fa700 1 -- 172.21.15.12:0/1652363285 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8009710 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8c97fa700 1 -- 172.21.15.12:0/1652363285 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b800c850 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8cc0b1a30 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8c97fa700 1 -- 172.21.15.12:0/1652363285 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800cbc0 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.753+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8cc0b1ff0 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.754+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8cc073910 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.755+0000 7fb8c97fa700 1 -- 172.21.15.12:0/1652363285 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8b800cd20 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.755+0000 7fb8c97fa700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8b006ace0 0x7fb8b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.755+0000 7fb8c97fa700 1 -- 172.21.15.12:0/1652363285 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8b80898c0 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.755+0000 7fb8d08c4700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8b006ace0 0x7fb8b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:49.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.756+0000 7fb8d08c4700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8b006ace0 0x7fb8b006d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000c00 tx=0x7fb8c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:49.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.759+0000 7fb8c97fa700 1 -- 172.21.15.12:0/1652363285 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8b80580d0 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.959+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8cc0c44d0 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.960+0000 7fb8c97fa700 1 -- 172.21.15.12:0/1652363285 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7fb8b8057c60 con 0x7fb8cc0d05d0 2023-07-07T18:15:49.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:49.963 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:49.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8b006ace0 msgr2=0x7fb8b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8b006ace0 0x7fb8b006d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0000c00 tx=0x7fb8c0008030 comp rx=0 tx=0).stop 2023-07-07T18:15:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc0d05d0 msgr2=0x7fb8cc0b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc0d05d0 0x7fb8cc0b2510 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800e9b0 tx=0x7fb8b800ed70 comp rx=0 tx=0).stop 2023-07-07T18:15:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 shutdown_connections 2023-07-07T18:15:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fb8b006ace0 0x7fb8b006d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8cc15a640 0x7fb8cc15b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8cc0ceab0 0x7fb8cc154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 --2- 172.21.15.12:0/1652363285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8cc0d05d0 0x7fb8cc0b2510 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.962+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 >> 172.21.15.12:0/1652363285 conn(0x7fb8cc089fe0 msgr2=0x7fb8cc0c46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.963+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 shutdown_connections 2023-07-07T18:15:49.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:49.963+0000 7fb8d2b28700 1 -- 172.21.15.12:0/1652363285 wait complete. 2023-07-07T18:15:49.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:49.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:50.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.102+0000 7f34dcf22700 1 Processor -- start 2023-07-07T18:15:50.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.103+0000 7f34dcf22700 1 -- start start 2023-07-07T18:15:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.103+0000 7f34dcf22700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d815a330 0x7f34d8070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.103+0000 7f34dcf22700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80caf70 con 0x7f34d80cd330 2023-07-07T18:15:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.103+0000 7f34dcf22700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80cb210 con 0x7f34d80afc40 2023-07-07T18:15:50.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.103+0000 7f34dcf22700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d815e360 con 0x7f34d815a330 2023-07-07T18:15:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f34d80cd330 0x7f34d80cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55944/0 (socket says 172.21.15.12:55944) 2023-07-07T18:15:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d659c700 1 -- 172.21.15.12:0/2759571090 learned_addr learned my addr 172.21.15.12:0/2759571090 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d5d9b700 1 --2- 172.21.15.12:0/2759571090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d815a330 0x7f34d8070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d559a700 1 -- 172.21.15.12:0/2759571090 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412128812 0 0) 0x7f34d80caf70 con 0x7f34d80cd330 2023-07-07T18:15:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d559a700 1 -- 172.21.15.12:0/2759571090 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34c00035b0 con 0x7f34d80cd330 2023-07-07T18:15:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d559a700 1 -- 172.21.15.12:0/2759571090 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829208919 0 0) 0x7f34d80cb210 con 0x7f34d80afc40 2023-07-07T18:15:50.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d559a700 1 -- 172.21.15.12:0/2759571090 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d80caf70 con 0x7f34d80afc40 2023-07-07T18:15:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d5d9b700 1 -- 172.21.15.12:0/2759571090 >> v1:172.21.15.160:6789/0 conn(0x7f34d80afc40 legacy=0x7f34d815dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d5d9b700 1 -- 172.21.15.12:0/2759571090 >> v1:172.21.15.12:6789/0 conn(0x7f34d80cd330 legacy=0x7f34d80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d5d9b700 1 -- 172.21.15.12:0/2759571090 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d80ccc20 con 0x7f34d815a330 2023-07-07T18:15:50.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.104+0000 7f34d5d9b700 1 --2- 172.21.15.12:0/2759571090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d815a330 0x7f34d8070980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009870 tx=0x7f34c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79443d8a79396e2b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34d559a700 1 -- 172.21.15.12:0/2759571090 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8011830 con 0x7f34d815a330 2023-07-07T18:15:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34d559a700 1 -- 172.21.15.12:0/2759571090 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c8011990 con 0x7f34d815a330 2023-07-07T18:15:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34d559a700 1 -- 172.21.15.12:0/2759571090 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8011d00 con 0x7f34d815a330 2023-07-07T18:15:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34dcf22700 1 -- 172.21.15.12:0/2759571090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d815a330 msgr2=0x7f34d8070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34dcf22700 1 --2- 172.21.15.12:0/2759571090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d815a330 0x7f34d8070980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009870 tx=0x7f34c8009b80 comp rx=0 tx=0).stop 2023-07-07T18:15:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34dcf22700 1 -- 172.21.15.12:0/2759571090 shutdown_connections 2023-07-07T18:15:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34dcf22700 1 --2- 172.21.15.12:0/2759571090 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d815a330 0x7f34d8070980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34dcf22700 1 -- 172.21.15.12:0/2759571090 >> 172.21.15.12:0/2759571090 conn(0x7f34d806e5c0 msgr2=0x7f34d806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34dcf22700 1 -- 172.21.15.12:0/2759571090 shutdown_connections 2023-07-07T18:15:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.105+0000 7f34dcf22700 1 -- 172.21.15.12:0/2759571090 wait complete. 2023-07-07T18:15:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34dcf22700 1 Processor -- start 2023-07-07T18:15:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34dcf22700 1 -- start start 2023-07-07T18:15:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34dcf22700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d80afc40 0x7f34d814a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34dcf22700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d80cd330 0x7f34d80b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34dcf22700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d815a330 0x7f34d80b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34dcf22700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d815c2a0 con 0x7f34d80afc40 2023-07-07T18:15:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34dcf22700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d8159920 con 0x7f34d815a330 2023-07-07T18:15:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34dcf22700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d80b3b30 con 0x7f34d80cd330 2023-07-07T18:15:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34d659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d80afc40 0x7f34d814a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34d659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d80afc40 0x7f34d814a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58750/0 (socket says 172.21.15.12:58750) 2023-07-07T18:15:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.107+0000 7f34d659c700 1 -- 172.21.15.12:0/1100124036 learned_addr learned my addr 172.21.15.12:0/1100124036 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34d5d9b700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d80cd330 0x7f34d80b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34d6d9d700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d815a330 0x7f34d80b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34d659c700 1 -- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d80cd330 msgr2=0x7f34d80b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34d659c700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d80cd330 0x7f34d80b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34d659c700 1 -- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d815a330 msgr2=0x7f34d80b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34d659c700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d815a330 0x7f34d80b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34d659c700 1 -- 172.21.15.12:0/1100124036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c80094a0 con 0x7f34d80afc40 2023-07-07T18:15:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34d6d9d700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d815a330 0x7f34d80b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34d659c700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d80afc40 0x7f34d814a6e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c700 tx=0x7f34cc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34c6ffd700 1 -- 172.21.15.12:0/1100124036 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc005d70 con 0x7f34d80afc40 2023-07-07T18:15:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34c6ffd700 1 -- 172.21.15.12:0/1100124036 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc0070d0 con 0x7f34d80afc40 2023-07-07T18:15:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d815c4f0 con 0x7f34d80afc40 2023-07-07T18:15:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34c6ffd700 1 -- 172.21.15.12:0/1100124036 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc007480 con 0x7f34d80afc40 2023-07-07T18:15:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.108+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d815cab0 con 0x7f34d80afc40 2023-07-07T18:15:50.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.109+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d815ebb0 con 0x7f34d80afc40 2023-07-07T18:15:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.110+0000 7f34c6ffd700 1 -- 172.21.15.12:0/1100124036 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34cc0075e0 con 0x7f34d80afc40 2023-07-07T18:15:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.110+0000 7f34c6ffd700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f34b806ace0 0x7f34b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.111+0000 7f34c6ffd700 1 -- 172.21.15.12:0/1100124036 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f34cc089260 con 0x7f34d80afc40 2023-07-07T18:15:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.111+0000 7f34d5d9b700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f34b806ace0 0x7f34b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.111+0000 7f34d5d9b700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f34b806ace0 0x7f34b806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f34d815a720 tx=0x7f34c801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.114+0000 7f34c6ffd700 1 -- 172.21.15.12:0/1100124036 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f34cc053fd0 con 0x7f34d80afc40 2023-07-07T18:15:50.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.315+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34d804ea20 con 0x7f34d80afc40 2023-07-07T18:15:50.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.316+0000 7f34c6ffd700 1 -- 172.21.15.12:0/1100124036 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34cc0575f0 con 0x7f34d80afc40 2023-07-07T18:15:50.318 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:50.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f34b806ace0 msgr2=0x7f34b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f34b806ace0 0x7f34b806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f34d815a720 tx=0x7f34c801c040 comp rx=0 tx=0).stop 2023-07-07T18:15:50.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d80afc40 msgr2=0x7f34d814a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d80afc40 0x7f34d814a6e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00c700 tx=0x7f34cc00cac0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 shutdown_connections 2023-07-07T18:15:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f34b806ace0 0x7f34b806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d815a330 0x7f34d80b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34d80afc40 0x7f34d814a6e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 --2- 172.21.15.12:0/1100124036 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34d80cd330 0x7f34d80b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 >> 172.21.15.12:0/1100124036 conn(0x7f34d806e5c0 msgr2=0x7f34d80cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 shutdown_connections 2023-07-07T18:15:50.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.318+0000 7f34dcf22700 1 -- 172.21.15.12:0/1100124036 wait complete. 2023-07-07T18:15:50.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.457+0000 7f3cd2eb2700 1 Processor -- start 2023-07-07T18:15:50.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.457+0000 7f3cd2eb2700 1 -- start start 2023-07-07T18:15:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.458+0000 7f3cd2eb2700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3ccc0cd5e0 0x7f3ccc0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.458+0000 7f3cd2eb2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc06f0e0 con 0x7f3ccc0adf40 2023-07-07T18:15:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.458+0000 7f3cd2eb2700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc15dd90 con 0x7f3ccc06e030 2023-07-07T18:15:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.458+0000 7f3cd2eb2700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc0ce2c0 con 0x7f3ccc0cd5e0 2023-07-07T18:15:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.458+0000 7f3cd144f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3ccc0adf40 0x7f3ccc15d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55958/0 (socket says 172.21.15.12:55958) 2023-07-07T18:15:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.458+0000 7f3cd144f700 1 -- 172.21.15.12:0/2494443959 learned_addr learned my addr 172.21.15.12:0/2494443959 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.458+0000 7f3cd0c4e700 1 --2- 172.21.15.12:0/2494443959 >> v2:172.21.15.160:3300/0 conn(0x7f3ccc0cd5e0 0x7f3ccc0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.458+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970211766 0 0) 0x7f3ccc06f0e0 con 0x7f3ccc0adf40 2023-07-07T18:15:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.458+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cbc0057c0 con 0x7f3ccc0adf40 2023-07-07T18:15:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3375118913 0 0) 0x7f3cbc0057c0 con 0x7f3ccc0adf40 2023-07-07T18:15:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 >> v2:172.21.15.160:3300/0 conn(0x7f3ccc0cd5e0 msgr2=0x7f3ccc0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 --2- 172.21.15.12:0/2494443959 >> v2:172.21.15.160:3300/0 conn(0x7f3ccc0cd5e0 0x7f3ccc0cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 >> v1:172.21.15.160:6789/0 conn(0x7f3ccc06e030 legacy=0x7f3ccc15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0cdef0 con 0x7f3ccc0adf40 2023-07-07T18:15:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f3cc40019f0 con 0x7f3ccc0adf40 2023-07-07T18:15:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 >> v1:172.21.15.12:6789/0 conn(0x7f3ccc0adf40 legacy=0x7f3ccc15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cbc005c10 0x7f3cbc006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3cbc006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cbc007410 0x7f3cbc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0ce2c0 con 0x7f3cbc006a60 2023-07-07T18:15:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc00e320 con 0x7f3cbc007410 2023-07-07T18:15:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc00e4e0 con 0x7f3cbc005c10 2023-07-07T18:15:50.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccbfff700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3cbc006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3cd0c4e700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cbc005c10 0x7f3cbc006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3cd144f700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cbc007410 0x7f3cbc00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccbfff700 1 -- 172.21.15.12:0/2494443959 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cbc005c10 msgr2=0x7f3cbc006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccbfff700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3cbc005c10 0x7f3cbc006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccbfff700 1 -- 172.21.15.12:0/2494443959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cbc007410 msgr2=0x7f3cbc00dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccbfff700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3cbc007410 0x7f3cbc00dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3cd144f700 1 -- 172.21.15.12:0/2494443959 reap_dead start 2023-07-07T18:15:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccbfff700 1 -- 172.21.15.12:0/2494443959 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc0057c0 con 0x7f3cbc006a60 2023-07-07T18:15:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.459+0000 7f3ccbfff700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3cbc006ed0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8001800 tx=0x7f3cbc007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17ad4632832d0db server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80012f0 con 0x7f3cbc006a60 2023-07-07T18:15:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8005310 con 0x7f3cbc006a60 2023-07-07T18:15:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3ccb7fe700 1 -- 172.21.15.12:0/2494443959 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8006860 con 0x7f3cbc006a60 2023-07-07T18:15:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/2494443959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 msgr2=0x7f3cbc006ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3cd2eb2700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3cbc006ed0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8001800 tx=0x7f3cbc007a90 comp rx=0 tx=0).stop 2023-07-07T18:15:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/2494443959 shutdown_connections 2023-07-07T18:15:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3cd2eb2700 1 --2- 172.21.15.12:0/2494443959 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3cbc006ed0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/2494443959 >> 172.21.15.12:0/2494443959 conn(0x7f3ccc06b920 msgr2=0x7f3ccc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/2494443959 shutdown_connections 2023-07-07T18:15:50.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.460+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/2494443959 wait complete. 2023-07-07T18:15:50.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.461+0000 7f3cd2eb2700 1 Processor -- start 2023-07-07T18:15:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.461+0000 7f3cd2eb2700 1 -- start start 2023-07-07T18:15:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.462+0000 7f3cd2eb2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3ccc1f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.462+0000 7f3cd2eb2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc0b4850 0x7f3ccc0b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.462+0000 7f3cd2eb2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0c5880 0x7f3ccc0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.462+0000 7f3cd2eb2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc1f31d0 con 0x7f3cbc006a60 2023-07-07T18:15:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.462+0000 7f3cd2eb2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0c40f0 con 0x7f3ccc0c5880 2023-07-07T18:15:50.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.462+0000 7f3cd2eb2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc0b4450 con 0x7f3ccc0b4850 2023-07-07T18:15:50.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.462+0000 7f3cd0c4e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3ccc1f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.462+0000 7f3cd0c4e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3ccc1f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58768/0 (socket says 172.21.15.12:58768) 2023-07-07T18:15:50.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.462+0000 7f3cd0c4e700 1 -- 172.21.15.12:0/3777799003 learned_addr learned my addr 172.21.15.12:0/3777799003 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:50.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3ccbfff700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc0b4850 0x7f3ccc0b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd144f700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0c5880 0x7f3ccc0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd0c4e700 1 -- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc0b4850 msgr2=0x7f3ccc0b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd0c4e700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc0b4850 0x7f3ccc0b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd0c4e700 1 -- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0c5880 msgr2=0x7f3ccc0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd0c4e700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0c5880 0x7f3ccc0c3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd0c4e700 1 -- 172.21.15.12:0/3777799003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc0c47e0 con 0x7f3cbc006a60 2023-07-07T18:15:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3ccbfff700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc0b4850 0x7f3ccc0b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd144f700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0c5880 0x7f3ccc0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd0c4e700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3ccc1f2c90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0011ad0 tx=0x7f3cc0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cc97fa700 1 -- 172.21.15.12:0/3777799003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000f9a0 con 0x7f3cbc006a60 2023-07-07T18:15:50.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cc97fa700 1 -- 172.21.15.12:0/3777799003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc000fb20 con 0x7f3cbc006a60 2023-07-07T18:15:50.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc0c4ac0 con 0x7f3cbc006a60 2023-07-07T18:15:50.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cc97fa700 1 -- 172.21.15.12:0/3777799003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000fed0 con 0x7f3cbc006a60 2023-07-07T18:15:50.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.463+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc0c5080 con 0x7f3cbc006a60 2023-07-07T18:15:50.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.464+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc04ea20 con 0x7f3cbc006a60 2023-07-07T18:15:50.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.464+0000 7f3cc97fa700 1 -- 172.21.15.12:0/3777799003 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3cc0014440 con 0x7f3cbc006a60 2023-07-07T18:15:50.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.465+0000 7f3cc97fa700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3cb006ace0 0x7f3cb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.465+0000 7f3cc97fa700 1 -- 172.21.15.12:0/3777799003 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3cc0089f90 con 0x7f3cbc006a60 2023-07-07T18:15:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.465+0000 7f3ccbfff700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3cb006ace0 0x7f3cb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.466+0000 7f3ccbfff700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3cb006ace0 0x7f3cb006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8001800 tx=0x7f3cb8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.469+0000 7f3cc97fa700 1 -- 172.21.15.12:0/3777799003 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3cc00bc310 con 0x7f3cbc006a60 2023-07-07T18:15:50.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.666+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ccc067970 con 0x7f3cbc006a60 2023-07-07T18:15:50.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.666+0000 7f3cc97fa700 1 -- 172.21.15.12:0/3777799003 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3cc00587a0 con 0x7f3cbc006a60 2023-07-07T18:15:50.668 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:50.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.668+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3cb006ace0 msgr2=0x7f3cb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.668+0000 7f3cd2eb2700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3cb006ace0 0x7f3cb006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8001800 tx=0x7f3cb8009030 comp rx=0 tx=0).stop 2023-07-07T18:15:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.668+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 msgr2=0x7f3ccc1f2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.668+0000 7f3cd2eb2700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3ccc1f2c90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0011ad0 tx=0x7f3cc0011e90 comp rx=0 tx=0).stop 2023-07-07T18:15:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.668+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 shutdown_connections 2023-07-07T18:15:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.668+0000 7f3cd2eb2700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3cb006ace0 0x7f3cb006d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.668+0000 7f3cd2eb2700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ccc0c5880 0x7f3ccc0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.668+0000 7f3cd2eb2700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cbc006a60 0x7f3ccc1f2c90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.668+0000 7f3cd2eb2700 1 --2- 172.21.15.12:0/3777799003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ccc0b4850 0x7f3ccc0b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.669+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 >> 172.21.15.12:0/3777799003 conn(0x7f3ccc06b920 msgr2=0x7f3ccc0acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:50.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.669+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 shutdown_connections 2023-07-07T18:15:50.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.669+0000 7f3cd2eb2700 1 -- 172.21.15.12:0/3777799003 wait complete. 2023-07-07T18:15:50.682 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.808+0000 7f950feeb700 1 Processor -- start 2023-07-07T18:15:50.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.808+0000 7f950feeb700 1 -- start start 2023-07-07T18:15:50.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950feeb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f950815a430 0x7f950806e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950feeb700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95080acd10 0x7f950815e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950feeb700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95080aee00 con 0x7f95080ae8b0 2023-07-07T18:15:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950feeb700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95080af330 con 0x7f95080acd10 2023-07-07T18:15:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950feeb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950806e340 con 0x7f950815a430 2023-07-07T18:15:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950e488700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95080acd10 0x7f950815e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950d486700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f95080ae8b0 0x7f95080ac600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55974/0 (socket says 172.21.15.12:55974) 2023-07-07T18:15:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950d486700 1 -- 172.21.15.12:0/2588747818 learned_addr learned my addr 172.21.15.12:0/2588747818 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:50.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950dc87700 1 --2- 172.21.15.12:0/2588747818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f950815a430 0x7f950806e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950e488700 1 -- 172.21.15.12:0/2588747818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f950815a430 msgr2=0x7f950806e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950e488700 1 --2- 172.21.15.12:0/2588747818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f950815a430 0x7f950806e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950e488700 1 -- 172.21.15.12:0/2588747818 >> v1:172.21.15.12:6789/0 conn(0x7f95080ae8b0 legacy=0x7f95080ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950cc85700 1 -- 172.21.15.12:0/2588747818 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634402168 0 0) 0x7f95080aee00 con 0x7f95080ae8b0 2023-07-07T18:15:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950e488700 1 -- 172.21.15.12:0/2588747818 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95080af050 con 0x7f95080acd10 2023-07-07T18:15:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.809+0000 7f950dc87700 1 --2- 172.21.15.12:0/2588747818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f950815a430 0x7f950806e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:50.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950e488700 1 --2- 172.21.15.12:0/2588747818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080acd10 0x7f950815e040 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9500009d90 tx=0x7f950000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68efe80899171fd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950cc85700 1 -- 172.21.15.12:0/2588747818 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950000e070 con 0x7f95080acd10 2023-07-07T18:15:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950cc85700 1 -- 172.21.15.12:0/2588747818 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950000bbd0 con 0x7f95080acd10 2023-07-07T18:15:50.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950cc85700 1 -- 172.21.15.12:0/2588747818 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500012430 con 0x7f95080acd10 2023-07-07T18:15:50.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950feeb700 1 -- 172.21.15.12:0/2588747818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080acd10 msgr2=0x7f950815e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950feeb700 1 --2- 172.21.15.12:0/2588747818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080acd10 0x7f950815e040 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9500009d90 tx=0x7f950000b330 comp rx=0 tx=0).stop 2023-07-07T18:15:50.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950feeb700 1 -- 172.21.15.12:0/2588747818 shutdown_connections 2023-07-07T18:15:50.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950feeb700 1 --2- 172.21.15.12:0/2588747818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080acd10 0x7f950815e040 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950feeb700 1 --2- 172.21.15.12:0/2588747818 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f950815a430 0x7f950806e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950feeb700 1 -- 172.21.15.12:0/2588747818 >> 172.21.15.12:0/2588747818 conn(0x7f950806b920 msgr2=0x7f95080cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950feeb700 1 -- 172.21.15.12:0/2588747818 shutdown_connections 2023-07-07T18:15:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.810+0000 7f950feeb700 1 -- 172.21.15.12:0/2588747818 wait complete. 2023-07-07T18:15:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950feeb700 1 Processor -- start 2023-07-07T18:15:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950feeb700 1 -- start start 2023-07-07T18:15:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950feeb700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95080acd10 0x7f95080c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950feeb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080ae8b0 0x7f95081efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950feeb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f950815a430 0x7f95080c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950feeb700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95080c7c60 con 0x7f95080ae8b0 2023-07-07T18:15:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950feeb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95080c6fe0 con 0x7f950815a430 2023-07-07T18:15:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950feeb700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95080c72c0 con 0x7f95080acd10 2023-07-07T18:15:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950d486700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080ae8b0 0x7f95081efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950d486700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080ae8b0 0x7f95081efba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58784/0 (socket says 172.21.15.12:58784) 2023-07-07T18:15:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.812+0000 7f950d486700 1 -- 172.21.15.12:0/775526092 learned_addr learned my addr 172.21.15.12:0/775526092 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:50.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950dc87700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95080acd10 0x7f95080c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950e488700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f950815a430 0x7f95080c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950d486700 1 -- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95080acd10 msgr2=0x7f95080c5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950d486700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95080acd10 0x7f95080c5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950d486700 1 -- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f950815a430 msgr2=0x7f95080c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950d486700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f950815a430 0x7f95080c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950d486700 1 -- 172.21.15.12:0/775526092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500009a70 con 0x7f95080ae8b0 2023-07-07T18:15:50.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950e488700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f950815a430 0x7f95080c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950d486700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080ae8b0 0x7f95081efba0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f95040011e0 tx=0x7f950400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f94fe7fc700 1 -- 172.21.15.12:0/775526092 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9504004c80 con 0x7f95080ae8b0 2023-07-07T18:15:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f94fe7fc700 1 -- 172.21.15.12:0/775526092 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9504004de0 con 0x7f95080ae8b0 2023-07-07T18:15:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95080c75a0 con 0x7f95080ae8b0 2023-07-07T18:15:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f94fe7fc700 1 -- 172.21.15.12:0/775526092 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9504007310 con 0x7f95080ae8b0 2023-07-07T18:15:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.813+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95080c63b0 con 0x7f95080ae8b0 2023-07-07T18:15:50.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.814+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95080c7da0 con 0x7f95080ae8b0 2023-07-07T18:15:50.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.815+0000 7f94fe7fc700 1 -- 172.21.15.12:0/775526092 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9504007470 con 0x7f95080ae8b0 2023-07-07T18:15:50.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.815+0000 7f94fe7fc700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f94ec06acb0 0x7f94ec06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:50.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.815+0000 7f94fe7fc700 1 -- 172.21.15.12:0/775526092 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9504089490 con 0x7f95080ae8b0 2023-07-07T18:15:50.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.815+0000 7f950dc87700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f94ec06acb0 0x7f94ec06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:50.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.816+0000 7f950dc87700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f94ec06acb0 0x7f94ec06d160 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f94f800ab40 tx=0x7f94f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:50.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:50.820+0000 7f94fe7fc700 1 -- 172.21.15.12:0/775526092 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f95080c7da0 con 0x7f95080ae8b0 2023-07-07T18:15:51.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.016+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95080c7da0 con 0x7f95080ae8b0 2023-07-07T18:15:51.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.017+0000 7f94fe7fc700 1 -- 172.21.15.12:0/775526092 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95080c7da0 con 0x7f95080ae8b0 2023-07-07T18:15:51.019 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:51.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f94ec06acb0 msgr2=0x7f94ec06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f94ec06acb0 0x7f94ec06d160 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f94f800ab40 tx=0x7f94f8008040 comp rx=0 tx=0).stop 2023-07-07T18:15:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080ae8b0 msgr2=0x7f95081efba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080ae8b0 0x7f95081efba0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f95040011e0 tx=0x7f950400ca30 comp rx=0 tx=0).stop 2023-07-07T18:15:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 shutdown_connections 2023-07-07T18:15:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f94ec06acb0 0x7f94ec06d160 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f950815a430 0x7f95080c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95080acd10 0x7f95080c5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 --2- 172.21.15.12:0/775526092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95080ae8b0 0x7f95081efba0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 >> 172.21.15.12:0/775526092 conn(0x7f950806b920 msgr2=0x7f95080ccbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:51.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 shutdown_connections 2023-07-07T18:15:51.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.019+0000 7f950feeb700 1 -- 172.21.15.12:0/775526092 wait complete. 2023-07-07T18:15:51.033 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.158+0000 7fe1cfc76700 1 Processor -- start 2023-07-07T18:15:51.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.158+0000 7fe1cfc76700 1 -- start start 2023-07-07T18:15:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.159+0000 7fe1cfc76700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 0x7fe1c806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.159+0000 7fe1cfc76700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1c80aecc0 0x7fe1c80ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.159+0000 7fe1cfc76700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c80ce620 con 0x7fe1c806e260 2023-07-07T18:15:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.159+0000 7fe1cfc76700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c8160580 con 0x7fe1c80aecc0 2023-07-07T18:15:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.159+0000 7fe1cfc76700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8160860 con 0x7fe1c815fc60 2023-07-07T18:15:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.159+0000 7fe1cd211700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1c80aecc0 0x7fe1c80ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.159+0000 7fe1cd211700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe1c80aecc0 0x7fe1c80ac600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58790/0 (socket says 172.21.15.12:58790) 2023-07-07T18:15:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.159+0000 7fe1ce213700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe1c806e260 0x7fe1c80cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55992/0 (socket says 172.21.15.12:55992) 2023-07-07T18:15:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.159+0000 7fe1cd211700 1 -- 172.21.15.12:0/4179941388 learned_addr learned my addr 172.21.15.12:0/4179941388 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cda12700 1 --2- 172.21.15.12:0/4179941388 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 0x7fe1c806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cd211700 1 -- 172.21.15.12:0/4179941388 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 msgr2=0x7fe1c806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cd211700 1 --2- 172.21.15.12:0/4179941388 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 0x7fe1c806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cd211700 1 -- 172.21.15.12:0/4179941388 >> v1:172.21.15.12:6789/0 conn(0x7fe1c806e260 legacy=0x7fe1c80cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cd211700 1 -- 172.21.15.12:0/4179941388 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c8160b40 con 0x7fe1c80aecc0 2023-07-07T18:15:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cca10700 1 -- 172.21.15.12:0/4179941388 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987337272 0 0) 0x7fe1c80ce620 con 0x7fe1c806e260 2023-07-07T18:15:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cd211700 1 --2- 172.21.15.12:0/4179941388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c80aecc0 0x7fe1c80ac600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40098f0 tx=0x7fe1c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5c16ec305d1b77 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:51.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cca10700 1 -- 172.21.15.12:0/4179941388 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400b8a0 con 0x7fe1c80aecc0 2023-07-07T18:15:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cca10700 1 -- 172.21.15.12:0/4179941388 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c400ba00 con 0x7fe1c80aecc0 2023-07-07T18:15:51.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cca10700 1 -- 172.21.15.12:0/4179941388 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400bd90 con 0x7fe1c80aecc0 2023-07-07T18:15:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.160+0000 7fe1cfc76700 1 -- 172.21.15.12:0/4179941388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c80aecc0 msgr2=0x7fe1c80ac600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.161+0000 7fe1cfc76700 1 --2- 172.21.15.12:0/4179941388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c80aecc0 0x7fe1c80ac600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40098f0 tx=0x7fe1c4009c00 comp rx=0 tx=0).stop 2023-07-07T18:15:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.161+0000 7fe1cfc76700 1 -- 172.21.15.12:0/4179941388 shutdown_connections 2023-07-07T18:15:51.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.161+0000 7fe1cfc76700 1 --2- 172.21.15.12:0/4179941388 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 0x7fe1c806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.161+0000 7fe1cfc76700 1 --2- 172.21.15.12:0/4179941388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c80aecc0 0x7fe1c80ac600 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.161+0000 7fe1cfc76700 1 -- 172.21.15.12:0/4179941388 >> 172.21.15.12:0/4179941388 conn(0x7fe1c806b920 msgr2=0x7fe1c80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.161+0000 7fe1cfc76700 1 -- 172.21.15.12:0/4179941388 shutdown_connections 2023-07-07T18:15:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.161+0000 7fe1cfc76700 1 -- 172.21.15.12:0/4179941388 wait complete. 2023-07-07T18:15:51.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.162+0000 7fe1cfc76700 1 Processor -- start 2023-07-07T18:15:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.162+0000 7fe1cfc76700 1 -- start start 2023-07-07T18:15:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cfc76700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c806e260 0x7fe1c8157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cfc76700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1c80aecc0 0x7fe1c81584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cfc76700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 0x7fe1c81589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cfc76700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80b3560 con 0x7fe1c806e260 2023-07-07T18:15:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cfc76700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c815ace0 con 0x7fe1c80aecc0 2023-07-07T18:15:51.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cfc76700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80b28e0 con 0x7fe1c815fc60 2023-07-07T18:15:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cda12700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c806e260 0x7fe1c8157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cda12700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c806e260 0x7fe1c8157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58796/0 (socket says 172.21.15.12:58796) 2023-07-07T18:15:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cda12700 1 -- 172.21.15.12:0/1937061526 learned_addr learned my addr 172.21.15.12:0/1937061526 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cd211700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1c80aecc0 0x7fe1c81584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1ce213700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 0x7fe1c81589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cda12700 1 -- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 msgr2=0x7fe1c81589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cda12700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 0x7fe1c81589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cda12700 1 -- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1c80aecc0 msgr2=0x7fe1c81584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cda12700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1c80aecc0 0x7fe1c81584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cda12700 1 -- 172.21.15.12:0/1937061526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4009550 con 0x7fe1c806e260 2023-07-07T18:15:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1ce213700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 0x7fe1c81589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cda12700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c806e260 0x7fe1c8157f70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800d7d0 tx=0x7fe1b800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1be7fc700 1 -- 172.21.15.12:0/1937061526 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80125f0 con 0x7fe1c806e260 2023-07-07T18:15:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1be7fc700 1 -- 172.21.15.12:0/1937061526 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b8012750 con 0x7fe1c806e260 2023-07-07T18:15:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c80b2bc0 con 0x7fe1c806e260 2023-07-07T18:15:51.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1be7fc700 1 -- 172.21.15.12:0/1937061526 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8012b00 con 0x7fe1c806e260 2023-07-07T18:15:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.163+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c80b3180 con 0x7fe1c806e260 2023-07-07T18:15:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.164+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c80b37d0 con 0x7fe1c806e260 2023-07-07T18:15:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.165+0000 7fe1be7fc700 1 -- 172.21.15.12:0/1937061526 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1b8012c60 con 0x7fe1c806e260 2023-07-07T18:15:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.165+0000 7fe1be7fc700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe1ac06ace0 0x7fe1ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.165+0000 7fe1be7fc700 1 -- 172.21.15.12:0/1937061526 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe1b8089730 con 0x7fe1c806e260 2023-07-07T18:15:51.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.165+0000 7fe1cd211700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe1ac06ace0 0x7fe1ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.166+0000 7fe1cd211700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe1ac06ace0 0x7fe1ac06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80af090 tx=0x7fe1c4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:51.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.170+0000 7fe1be7fc700 1 -- 172.21.15.12:0/1937061526 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1b8054540 con 0x7fe1c806e260 2023-07-07T18:15:51.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.370+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1c804ea20 con 0x7fe1c806e260 2023-07-07T18:15:51.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.371+0000 7fe1be7fc700 1 -- 172.21.15.12:0/1937061526 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1b8057b60 con 0x7fe1c806e260 2023-07-07T18:15:51.373 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe1ac06ace0 msgr2=0x7fe1ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe1ac06ace0 0x7fe1ac06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80af090 tx=0x7fe1c4008030 comp rx=0 tx=0).stop 2023-07-07T18:15:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c806e260 msgr2=0x7fe1c8157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c806e260 0x7fe1c8157f70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800d7d0 tx=0x7fe1b800dae0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 shutdown_connections 2023-07-07T18:15:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe1ac06ace0 0x7fe1ac06d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1c815fc60 0x7fe1c81589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1c806e260 0x7fe1c8157f70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 --2- 172.21.15.12:0/1937061526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1c80aecc0 0x7fe1c81584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 >> 172.21.15.12:0/1937061526 conn(0x7fe1c806b920 msgr2=0x7fe1c80b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 shutdown_connections 2023-07-07T18:15:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.373+0000 7fe1cfc76700 1 -- 172.21.15.12:0/1937061526 wait complete. 2023-07-07T18:15:51.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.513+0000 7f2499612700 1 Processor -- start 2023-07-07T18:15:51.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.513+0000 7f2499612700 1 -- start start 2023-07-07T18:15:51.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.513+0000 7f2499612700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f249406ccd0 0x7f249415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.513+0000 7f2499612700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2494069ef0 0x7f249406a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.513+0000 7f2499612700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24940cb380 con 0x7f24940cfd80 2023-07-07T18:15:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.513+0000 7f2499612700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249415b7a0 con 0x7f2494069ef0 2023-07-07T18:15:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.513+0000 7f2499612700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24940c97f0 con 0x7f249406ccd0 2023-07-07T18:15:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f24937fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2494069ef0 0x7f249406a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f24937fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2494069ef0 0x7f249406a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58808/0 (socket says 172.21.15.12:58808) 2023-07-07T18:15:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f24927fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f24940cfd80 0x7f249406d0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56004/0 (socket says 172.21.15.12:56004) 2023-07-07T18:15:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f24937fe700 1 -- 172.21.15.12:0/1936688525 learned_addr learned my addr 172.21.15.12:0/1936688525 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f2492ffd700 1 --2- 172.21.15.12:0/1936688525 >> v2:172.21.15.160:3300/0 conn(0x7f249406ccd0 0x7f249415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f24937fe700 1 -- 172.21.15.12:0/1936688525 >> v2:172.21.15.160:3300/0 conn(0x7f249406ccd0 msgr2=0x7f249415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f24937fe700 1 --2- 172.21.15.12:0/1936688525 >> v2:172.21.15.160:3300/0 conn(0x7f249406ccd0 0x7f249415b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f24937fe700 1 -- 172.21.15.12:0/1936688525 >> v1:172.21.15.12:6789/0 conn(0x7f24940cfd80 legacy=0x7f249406d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f24937fe700 1 -- 172.21.15.12:0/1936688525 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940cb620 con 0x7f2494069ef0 2023-07-07T18:15:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f2492ffd700 1 --2- 172.21.15.12:0/1936688525 >> v2:172.21.15.160:3300/0 conn(0x7f249406ccd0 0x7f249415b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f2491ffb700 1 -- 172.21.15.12:0/1936688525 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514897214 0 0) 0x7f24940cb380 con 0x7f24940cfd80 2023-07-07T18:15:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f24937fe700 1 --2- 172.21.15.12:0/1936688525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2494069ef0 0x7f249406a370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f24940b1df0 tx=0x7f248c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281f9f8147c3cabe server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f2491ffb700 1 -- 172.21.15.12:0/1936688525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00e070 con 0x7f2494069ef0 2023-07-07T18:15:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f2491ffb700 1 -- 172.21.15.12:0/1936688525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c00b9c0 con 0x7f2494069ef0 2023-07-07T18:15:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.514+0000 7f2491ffb700 1 -- 172.21.15.12:0/1936688525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00bd70 con 0x7f2494069ef0 2023-07-07T18:15:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.515+0000 7f2499612700 1 -- 172.21.15.12:0/1936688525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2494069ef0 msgr2=0x7f249406a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.515+0000 7f2499612700 1 --2- 172.21.15.12:0/1936688525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2494069ef0 0x7f249406a370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f24940b1df0 tx=0x7f248c00b330 comp rx=0 tx=0).stop 2023-07-07T18:15:51.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.515+0000 7f2499612700 1 -- 172.21.15.12:0/1936688525 shutdown_connections 2023-07-07T18:15:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.515+0000 7f2499612700 1 --2- 172.21.15.12:0/1936688525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2494069ef0 0x7f249406a370 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.515+0000 7f2499612700 1 --2- 172.21.15.12:0/1936688525 >> v2:172.21.15.160:3300/0 conn(0x7f249406ccd0 0x7f249415b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.515+0000 7f2499612700 1 -- 172.21.15.12:0/1936688525 >> 172.21.15.12:0/1936688525 conn(0x7f24940b1990 msgr2=0x7f24940cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.515+0000 7f2499612700 1 -- 172.21.15.12:0/1936688525 shutdown_connections 2023-07-07T18:15:51.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.515+0000 7f2499612700 1 -- 172.21.15.12:0/1936688525 wait complete. 2023-07-07T18:15:51.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.516+0000 7f2499612700 1 Processor -- start 2023-07-07T18:15:51.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.516+0000 7f2499612700 1 -- start start 2023-07-07T18:15:51.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f2499612700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2494069ef0 0x7f24940af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f2499612700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f249406ccd0 0x7f2494155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f2499612700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24940cfd80 0x7f249415bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f2499612700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940afbf0 con 0x7f24940cfd80 2023-07-07T18:15:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f2499612700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24941f4180 con 0x7f2494069ef0 2023-07-07T18:15:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f2499612700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24941f3600 con 0x7f249406ccd0 2023-07-07T18:15:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24937fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24940cfd80 0x7f249415bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24937fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24940cfd80 0x7f249415bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58814/0 (socket says 172.21.15.12:58814) 2023-07-07T18:15:51.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24937fe700 1 -- 172.21.15.12:0/2985897197 learned_addr learned my addr 172.21.15.12:0/2985897197 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:51.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f2492ffd700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2494069ef0 0x7f24940af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24927fc700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f249406ccd0 0x7f2494155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24937fe700 1 -- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f249406ccd0 msgr2=0x7f2494155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24937fe700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f249406ccd0 0x7f2494155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24937fe700 1 -- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2494069ef0 msgr2=0x7f24940af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24937fe700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2494069ef0 0x7f24940af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24937fe700 1 -- 172.21.15.12:0/2985897197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c009b30 con 0x7f24940cfd80 2023-07-07T18:15:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f2492ffd700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2494069ef0 0x7f24940af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.517+0000 7f24937fe700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24940cfd80 0x7f249415bb50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2494070a30 tx=0x7f248c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.518+0000 7f248b7fe700 1 -- 172.21.15.12:0/2985897197 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c0092e0 con 0x7f24940cfd80 2023-07-07T18:15:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.518+0000 7f248b7fe700 1 -- 172.21.15.12:0/2985897197 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c01b430 con 0x7f24940cfd80 2023-07-07T18:15:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.518+0000 7f248b7fe700 1 -- 172.21.15.12:0/2985897197 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c01b7e0 con 0x7f24940cfd80 2023-07-07T18:15:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.518+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24941f38e0 con 0x7f24940cfd80 2023-07-07T18:15:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.518+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24941f3ea0 con 0x7f24940cfd80 2023-07-07T18:15:51.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.519+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249404ea20 con 0x7f24940cfd80 2023-07-07T18:15:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.519+0000 7f248b7fe700 1 -- 172.21.15.12:0/2985897197 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f248c01b940 con 0x7f24940cfd80 2023-07-07T18:15:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.519+0000 7f248b7fe700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f247406ace0 0x7f247406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.520+0000 7f248b7fe700 1 -- 172.21.15.12:0/2985897197 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f248c08b0d0 con 0x7f24940cfd80 2023-07-07T18:15:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.520+0000 7f2492ffd700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f247406ace0 0x7f247406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.520+0000 7f2492ffd700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f247406ace0 0x7f247406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2484009820 tx=0x7f2484008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:51.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.524+0000 7f248b7fe700 1 -- 172.21.15.12:0/2985897197 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f248c055ee0 con 0x7f24940cfd80 2023-07-07T18:15:51.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.721+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f24940cb8d0 con 0x7f24940cfd80 2023-07-07T18:15:51.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.721+0000 7f248b7fe700 1 -- 172.21.15.12:0/2985897197 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f248c059500 con 0x7f24940cfd80 2023-07-07T18:15:51.727 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f247406ace0 msgr2=0x7f247406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f247406ace0 0x7f247406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2484009820 tx=0x7f2484008040 comp rx=0 tx=0).stop 2023-07-07T18:15:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24940cfd80 msgr2=0x7f249415bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24940cfd80 0x7f249415bb50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2494070a30 tx=0x7f248c004ad0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 shutdown_connections 2023-07-07T18:15:51.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f247406ace0 0x7f247406d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f24940cfd80 0x7f249415bb50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2494069ef0 0x7f24940af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 --2- 172.21.15.12:0/2985897197 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f249406ccd0 0x7f2494155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 >> 172.21.15.12:0/2985897197 conn(0x7f24940b1990 msgr2=0x7f2494070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:51.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 shutdown_connections 2023-07-07T18:15:51.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.723+0000 7f2499612700 1 -- 172.21.15.12:0/2985897197 wait complete. 2023-07-07T18:15:51.737 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-07T18:15:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.861+0000 7f0d9a0ac700 1 Processor -- start 2023-07-07T18:15:51.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.861+0000 7f0d9a0ac700 1 -- start start 2023-07-07T18:15:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.862+0000 7f0d9a0ac700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0d940b08d0 0x7f0d940ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.862+0000 7f0d9a0ac700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d940cf2a0 con 0x7f0d9415c420 2023-07-07T18:15:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.862+0000 7f0d9a0ac700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d940ce690 con 0x7f0d9406a600 2023-07-07T18:15:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.862+0000 7f0d9a0ac700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d940ce970 con 0x7f0d940b08d0 2023-07-07T18:15:51.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.862+0000 7f0d937fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0d9415c420 0x7f0d94069ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56016/0 (socket says 172.21.15.12:56016) 2023-07-07T18:15:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.862+0000 7f0d937fe700 1 -- 172.21.15.12:0/2786337841 learned_addr learned my addr 172.21.15.12:0/2786337841 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.862+0000 7f0d93fff700 1 --2- 172.21.15.12:0/2786337841 >> v2:172.21.15.160:3300/0 conn(0x7f0d940b08d0 0x7f0d940ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.862+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963506538 0 0) 0x7f0d940cf2a0 con 0x7f0d9415c420 2023-07-07T18:15:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.862+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d800035b0 con 0x7f0d9415c420 2023-07-07T18:15:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 652877652 0 0) 0x7f0d800035b0 con 0x7f0d9415c420 2023-07-07T18:15:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 >> v2:172.21.15.160:3300/0 conn(0x7f0d940b08d0 msgr2=0x7f0d940ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 --2- 172.21.15.12:0/2786337841 >> v2:172.21.15.160:3300/0 conn(0x7f0d940b08d0 0x7f0d940ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 >> v1:172.21.15.160:6789/0 conn(0x7f0d9406a600 legacy=0x7f0d940c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d940cec50 con 0x7f0d9415c420 2023-07-07T18:15:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f0d84001670 con 0x7f0d9415c420 2023-07-07T18:15:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 >> v1:172.21.15.12:6789/0 conn(0x7f0d9415c420 legacy=0x7f0d94069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d80003a00 0x7f0d80003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d80004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d80005200 0x7f0d8000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d940ce970 con 0x7f0d80004850 2023-07-07T18:15:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8000c110 con 0x7f0d80003a00 2023-07-07T18:15:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8000c2d0 con 0x7f0d80005200 2023-07-07T18:15:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d92ffd700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d80004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d937fe700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d80003a00 0x7f0d80003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d93fff700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d80005200 0x7f0d8000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d92ffd700 1 -- 172.21.15.12:0/2786337841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d80005200 msgr2=0x7f0d8000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d92ffd700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d80005200 0x7f0d8000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d92ffd700 1 -- 172.21.15.12:0/2786337841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d80003a00 msgr2=0x7f0d80003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:51.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d92ffd700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d80003a00 0x7f0d80003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d92ffd700 1 -- 172.21.15.12:0/2786337841 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800035b0 con 0x7f0d80004850 2023-07-07T18:15:51.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d93fff700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d80005200 0x7f0d8000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:51.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d93fff700 1 -- 172.21.15.12:0/2786337841 reap_dead start 2023-07-07T18:15:51.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d92ffd700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d80004cc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0d9406a9f0 tx=0x7f0d80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6405de13ea58e1a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:51.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0052d0 con 0x7f0d80004850 2023-07-07T18:15:51.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.863+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c005430 con 0x7f0d80004850 2023-07-07T18:15:51.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.864+0000 7f0d927fc700 1 -- 172.21.15.12:0/2786337841 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0038c0 con 0x7f0d80004850 2023-07-07T18:15:51.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.864+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/2786337841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 msgr2=0x7f0d80004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.864+0000 7f0d9a0ac700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d80004cc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0d9406a9f0 tx=0x7f0d80005880 comp rx=0 tx=0).stop 2023-07-07T18:15:51.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.864+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/2786337841 shutdown_connections 2023-07-07T18:15:51.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.864+0000 7f0d9a0ac700 1 --2- 172.21.15.12:0/2786337841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d80004cc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.864+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/2786337841 >> 172.21.15.12:0/2786337841 conn(0x7f0d9406b920 msgr2=0x7f0d940cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:51.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.864+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/2786337841 shutdown_connections 2023-07-07T18:15:51.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.864+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/2786337841 wait complete. 2023-07-07T18:15:51.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.865+0000 7f0d9a0ac700 1 Processor -- start 2023-07-07T18:15:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d9a0ac700 1 -- start start 2023-07-07T18:15:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d9a0ac700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d941f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d9a0ac700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9415f5e0 0x7f0d941f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d9a0ac700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d9415dcc0 0x7f0d9415aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d9a0ac700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d940ac7e0 con 0x7f0d80004850 2023-07-07T18:15:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d9a0ac700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941f5120 con 0x7f0d9415f5e0 2023-07-07T18:15:51.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d9a0ac700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d941f2230 con 0x7f0d9415dcc0 2023-07-07T18:15:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d937fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d941f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d937fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d941f4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58828/0 (socket says 172.21.15.12:58828) 2023-07-07T18:15:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.866+0000 7f0d937fe700 1 -- 172.21.15.12:0/1726106573 learned_addr learned my addr 172.21.15.12:0/1726106573 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d93fff700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d9415dcc0 0x7f0d9415aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d92ffd700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9415f5e0 0x7f0d941f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d937fe700 1 -- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d9415dcc0 msgr2=0x7f0d9415aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d937fe700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d9415dcc0 0x7f0d9415aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d937fe700 1 -- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9415f5e0 msgr2=0x7f0d941f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:51.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d937fe700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9415f5e0 0x7f0d941f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:51.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d937fe700 1 -- 172.21.15.12:0/1726106573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d940ac490 con 0x7f0d80004850 2023-07-07T18:15:51.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d93fff700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d9415dcc0 0x7f0d9415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:51.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d92ffd700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9415f5e0 0x7f0d941f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:51.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d937fe700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d941f4be0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d840072f0 tx=0x7f0d840076b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:51.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d8bfff700 1 -- 172.21.15.12:0/1726106573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d840077d0 con 0x7f0d80004850 2023-07-07T18:15:51.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d8bfff700 1 -- 172.21.15.12:0/1726106573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8400f870 con 0x7f0d80004850 2023-07-07T18:15:51.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9415e4f0 con 0x7f0d80004850 2023-07-07T18:15:51.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d8bfff700 1 -- 172.21.15.12:0/1726106573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400fc20 con 0x7f0d80004850 2023-07-07T18:15:51.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.867+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9415eab0 con 0x7f0d80004850 2023-07-07T18:15:51.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.868+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9415ecd0 con 0x7f0d80004850 2023-07-07T18:15:51.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.868+0000 7f0d8bfff700 1 -- 172.21.15.12:0/1726106573 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d8400fd80 con 0x7f0d80004850 2023-07-07T18:15:51.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.869+0000 7f0d8bfff700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d7406ace0 0x7f0d7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:51.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.869+0000 7f0d8bfff700 1 -- 172.21.15.12:0/1726106573 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d84089210 con 0x7f0d80004850 2023-07-07T18:15:51.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.869+0000 7f0d92ffd700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d7406ace0 0x7f0d7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:51.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.870+0000 7f0d92ffd700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d7406ace0 0x7f0d7406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c000c00 tx=0x7f0d7c009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:51.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:51.873+0000 7f0d8bfff700 1 -- 172.21.15.12:0/1726106573 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d84053f90 con 0x7f0d80004850 2023-07-07T18:15:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.091+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0d94073910 con 0x7f0d80004850 2023-07-07T18:15:52.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.091+0000 7f0d8bfff700 1 -- 172.21.15.12:0/1726106573 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0d840575b0 con 0x7f0d80004850 2023-07-07T18:15:52.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d7406ace0 msgr2=0x7f0d7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d7406ace0 0x7f0d7406d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c000c00 tx=0x7f0d7c009030 comp rx=0 tx=0).stop 2023-07-07T18:15:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 msgr2=0x7f0d941f4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d941f4be0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d840072f0 tx=0x7f0d840076b0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 shutdown_connections 2023-07-07T18:15:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d7406ace0 0x7f0d7406d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d9415dcc0 0x7f0d9415aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d80004850 0x7f0d941f4be0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 --2- 172.21.15.12:0/1726106573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d9415f5e0 0x7f0d941f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.093+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 >> 172.21.15.12:0/1726106573 conn(0x7f0d9406b920 msgr2=0x7f0d9415bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.094+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 shutdown_connections 2023-07-07T18:15:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.094+0000 7f0d9a0ac700 1 -- 172.21.15.12:0/1726106573 wait complete. 2023-07-07T18:15:52.097 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-07-07T18:15:52.107 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-07T18:15:52.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:52.108 DEBUG:teuthology.orchestra.run.smithi160:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-07T18:15:52.151 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T18:15:52.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:15:52.152 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-07T18:15:52.211 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-07T18:15:52.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:15:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.334+0000 7fdce0a4c700 1 Processor -- start 2023-07-07T18:15:52.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.334+0000 7fdce0a4c700 1 -- start start 2023-07-07T18:15:52.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdce0a4c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdcdc159080 0x7fdcdc0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdce0a4c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0c9df0 con 0x7fdcdc0cb850 2023-07-07T18:15:52.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdce0a4c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0ca3b0 con 0x7fdcdc0ae6d0 2023-07-07T18:15:52.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdce0a4c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc15d9d0 con 0x7fdcdc159080 2023-07-07T18:15:52.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdcdad9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdcdc0cb850 0x7fdcdc15d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56038/0 (socket says 172.21.15.12:56038) 2023-07-07T18:15:52.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdcdad9d700 1 -- 172.21.15.12:0/3053844303 learned_addr learned my addr 172.21.15.12:0/3053844303 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:52.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdcda59c700 1 --2- 172.21.15.12:0/3053844303 >> v2:172.21.15.160:3300/0 conn(0x7fdcdc159080 0x7fdcdc0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628864 0 0) 0x7fdcdc0c9df0 con 0x7fdcdc0cb850 2023-07-07T18:15:52.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc40035b0 con 0x7fdcdc0cb850 2023-07-07T18:15:52.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3058196007 0 0) 0x7fdcc40035b0 con 0x7fdcdc0cb850 2023-07-07T18:15:52.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 >> v2:172.21.15.160:3300/0 conn(0x7fdcdc159080 msgr2=0x7fdcdc0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:52.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.335+0000 7fdcd959a700 1 --2- 172.21.15.12:0/3053844303 >> v2:172.21.15.160:3300/0 conn(0x7fdcdc159080 0x7fdcdc0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 >> v1:172.21.15.160:6789/0 conn(0x7fdcdc0ae6d0 legacy=0x7fdcdc15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0cf560 con 0x7fdcdc0cb850 2023-07-07T18:15:52.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fdcd40019f0 con 0x7fdcdc0cb850 2023-07-07T18:15:52.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 >> v1:172.21.15.12:6789/0 conn(0x7fdcdc0cb850 legacy=0x7fdcdc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc4003a00 0x7fdcc4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdcc4004850 0x7fdcc4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcc400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc15d9d0 con 0x7fdcc4005200 2023-07-07T18:15:52.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc400c110 con 0x7fdcc4003a00 2023-07-07T18:15:52.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc400c2d0 con 0x7fdcc4004850 2023-07-07T18:15:52.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcdad9d700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcc400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcda59c700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc4003a00 0x7fdcc4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd9d9b700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdcc4004850 0x7fdcc4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcdad9d700 1 -- 172.21.15.12:0/3053844303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdcc4004850 msgr2=0x7fdcc4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:52.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcdad9d700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdcc4004850 0x7fdcc4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcdad9d700 1 -- 172.21.15.12:0/3053844303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc4003a00 msgr2=0x7fdcc4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:52.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcdad9d700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcc4003a00 0x7fdcc4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcdad9d700 1 -- 172.21.15.12:0/3053844303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40035b0 con 0x7fdcc4005200 2023-07-07T18:15:52.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcdad9d700 1 -- 172.21.15.12:0/3053844303 reap_dead start 2023-07-07T18:15:52.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcdad9d700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcc400ba10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400a830 tx=0x7fdcc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bcf9a35e6091b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:52.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400a2f0 con 0x7fdcc4005200 2023-07-07T18:15:52.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd4012620 con 0x7fdcc4005200 2023-07-07T18:15:52.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.336+0000 7fdcd959a700 1 -- 172.21.15.12:0/3053844303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40129d0 con 0x7fdcc4005200 2023-07-07T18:15:52.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.337+0000 7fdce0a4c700 1 -- 172.21.15.12:0/3053844303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 msgr2=0x7fdcc400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.337+0000 7fdce0a4c700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcc400ba10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400a830 tx=0x7fdcc4005880 comp rx=0 tx=0).stop 2023-07-07T18:15:52.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.337+0000 7fdce0a4c700 1 -- 172.21.15.12:0/3053844303 shutdown_connections 2023-07-07T18:15:52.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.337+0000 7fdce0a4c700 1 --2- 172.21.15.12:0/3053844303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcc400ba10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.337+0000 7fdce0a4c700 1 -- 172.21.15.12:0/3053844303 >> 172.21.15.12:0/3053844303 conn(0x7fdcdc06b920 msgr2=0x7fdcdc0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:52.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.337+0000 7fdce0a4c700 1 -- 172.21.15.12:0/3053844303 shutdown_connections 2023-07-07T18:15:52.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.337+0000 7fdce0a4c700 1 -- 172.21.15.12:0/3053844303 wait complete. 2023-07-07T18:15:52.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.338+0000 7fdce0a4c700 1 Processor -- start 2023-07-07T18:15:52.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdce0a4c700 1 -- start start 2023-07-07T18:15:52.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdce0a4c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcdc152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdce0a4c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdcdc0c2e50 0x7fdcdc0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdce0a4c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcdc0c32c0 0x7fdcdc1e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdce0a4c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0ad360 con 0x7fdcc4005200 2023-07-07T18:15:52.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdce0a4c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0ac490 con 0x7fdcdc0c32c0 2023-07-07T18:15:52.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdce0a4c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0ac6e0 con 0x7fdcdc0c2e50 2023-07-07T18:15:52.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdcda59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcdc152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdcda59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcdc152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58848/0 (socket says 172.21.15.12:58848) 2023-07-07T18:15:52.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.339+0000 7fdcda59c700 1 -- 172.21.15.12:0/408286326 learned_addr learned my addr 172.21.15.12:0/408286326 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:52.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdcda59c700 1 -- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdcdc0c2e50 msgr2=0x7fdcdc0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdcd9d9b700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdcdc0c2e50 0x7fdcdc0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdcdad9d700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcdc0c32c0 0x7fdcdc1e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdcda59c700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdcdc0c2e50 0x7fdcdc0b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdcda59c700 1 -- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcdc0c32c0 msgr2=0x7fdcdc1e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdcda59c700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcdc0c32c0 0x7fdcdc1e6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdcda59c700 1 -- 172.21.15.12:0/408286326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0ac9c0 con 0x7fdcc4005200 2023-07-07T18:15:52.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdcda59c700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcdc152f00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0119a0 tx=0x7fdccc011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:52.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdccaffd700 1 -- 172.21.15.12:0/408286326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc00f940 con 0x7fdcc4005200 2023-07-07T18:15:52.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdccaffd700 1 -- 172.21.15.12:0/408286326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc00faa0 con 0x7fdcc4005200 2023-07-07T18:15:52.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc0acca0 con 0x7fdcc4005200 2023-07-07T18:15:52.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdccaffd700 1 -- 172.21.15.12:0/408286326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc00fe30 con 0x7fdcc4005200 2023-07-07T18:15:52.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.340+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc0afe10 con 0x7fdcc4005200 2023-07-07T18:15:52.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.341+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0ad5d0 con 0x7fdcc4005200 2023-07-07T18:15:52.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.341+0000 7fdccaffd700 1 -- 172.21.15.12:0/408286326 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdccc014440 con 0x7fdcc4005200 2023-07-07T18:15:52.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.342+0000 7fdccaffd700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcbc06ace0 0x7fdcbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.342+0000 7fdccaffd700 1 -- 172.21.15.12:0/408286326 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdccc089e60 con 0x7fdcc4005200 2023-07-07T18:15:52.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.342+0000 7fdcd9d9b700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcbc06ace0 0x7fdcbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.343+0000 7fdcd9d9b700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcbc06ace0 0x7fdcbc06d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0c9790 tx=0x7fdcd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:52.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.346+0000 7fdccaffd700 1 -- 172.21.15.12:0/408286326 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdccc058700 con 0x7fdcc4005200 2023-07-07T18:15:52.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.589+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcdc073910 con 0x7fdcc4005200 2023-07-07T18:15:52.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.590+0000 7fdccaffd700 1 -- 172.21.15.12:0/408286326 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fdccc058290 con 0x7fdcc4005200 2023-07-07T18:15:52.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:52.593 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:15:09.693432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-07T18:15:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcbc06ace0 msgr2=0x7fdcbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcbc06ace0 0x7fdcbc06d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0c9790 tx=0x7fdcd0009040 comp rx=0 tx=0).stop 2023-07-07T18:15:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 msgr2=0x7fdcdc152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcdc152f00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0119a0 tx=0x7fdccc011d60 comp rx=0 tx=0).stop 2023-07-07T18:15:52.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 shutdown_connections 2023-07-07T18:15:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdcbc06ace0 0x7fdcbc06d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdcdc0c32c0 0x7fdcdc1e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdcc4005200 0x7fdcdc152f00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 --2- 172.21.15.12:0/408286326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdcdc0c2e50 0x7fdcdc0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 >> 172.21.15.12:0/408286326 conn(0x7fdcdc06b920 msgr2=0x7fdcdc0b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 shutdown_connections 2023-07-07T18:15:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.592+0000 7fdce0a4c700 1 -- 172.21.15.12:0/408286326 wait complete. 2023-07-07T18:15:52.596 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2023-07-07T18:15:52.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.729+0000 7f6cad25b700 1 Processor -- start 2023-07-07T18:15:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.729+0000 7f6cad25b700 1 -- start start 2023-07-07T18:15:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6cad25b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ca815c420 0x7f6ca8069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6cad25b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6ca80cae00 0x7f6ca806a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6cad25b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80cf2a0 con 0x7f6ca80b08d0 2023-07-07T18:15:52.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6cad25b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca80ce690 con 0x7f6ca80cae00 2023-07-07T18:15:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6cad25b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80ce970 con 0x7f6ca815c420 2023-07-07T18:15:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6ca80b08d0 0x7f6ca80cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56054/0 (socket says 172.21.15.12:56054) 2023-07-07T18:15:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca659c700 1 -- 172.21.15.12:0/553539950 learned_addr learned my addr 172.21.15.12:0/553539950 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca759e700 1 --2- 172.21.15.12:0/553539950 >> v2:172.21.15.160:3300/0 conn(0x7f6ca80cae00 0x7f6ca806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca6d9d700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ca815c420 0x7f6ca8069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781437366 0 0) 0x7f6ca80cf2a0 con 0x7f6ca80b08d0 2023-07-07T18:15:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c900035b0 con 0x7f6ca80b08d0 2023-07-07T18:15:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1361906831 0 0) 0x7f6c900035b0 con 0x7f6ca80b08d0 2023-07-07T18:15:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ca815c420 msgr2=0x7f6ca8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca5d9b700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ca815c420 0x7f6ca8069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 >> v2:172.21.15.160:3300/0 conn(0x7f6ca80cae00 msgr2=0x7f6ca806a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca5d9b700 1 --2- 172.21.15.12:0/553539950 >> v2:172.21.15.160:3300/0 conn(0x7f6ca80cae00 0x7f6ca806a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.730+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80cec50 con 0x7f6ca80b08d0 2023-07-07T18:15:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f6c98001670 con 0x7f6ca80b08d0 2023-07-07T18:15:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 >> v1:172.21.15.12:6789/0 conn(0x7f6ca80b08d0 legacy=0x7f6ca80cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c90003a00 0x7f6c90003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c900043e0 0x7f6c900048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c90004fc0 0x7f6c9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80ce690 con 0x7f6c900043e0 2023-07-07T18:15:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca80ce970 con 0x7f6c90004fc0 2023-07-07T18:15:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9000bf50 con 0x7f6c90003a00 2023-07-07T18:15:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca6d9d700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ca815c420 0x7f6ca8069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca759e700 1 --2- 172.21.15.12:0/553539950 >> v2:172.21.15.160:3300/0 conn(0x7f6ca80cae00 0x7f6ca806a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:15:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca659c700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c900043e0 0x7f6c900048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca6d9d700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c90003a00 0x7f6c90003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca759e700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c90004fc0 0x7f6c9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca659c700 1 -- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c90003a00 msgr2=0x7f6c90003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca659c700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c90003a00 0x7f6c90003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca659c700 1 -- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c90004fc0 msgr2=0x7f6c9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca659c700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c90004fc0 0x7f6c9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca659c700 1 -- 172.21.15.12:0/553539950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c900035b0 con 0x7f6c900043e0 2023-07-07T18:15:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca759e700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c90004fc0 0x7f6c9000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca659c700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c900043e0 0x7f6c900048b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c350 tx=0x7f6c90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677b1f026a76f09d server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800ce50 con 0x7f6c900043e0 2023-07-07T18:15:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98005960 con 0x7f6c900043e0 2023-07-07T18:15:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.731+0000 7f6ca5d9b700 1 -- 172.21.15.12:0/553539950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98005d10 con 0x7f6c900043e0 2023-07-07T18:15:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.732+0000 7f6cad25b700 1 -- 172.21.15.12:0/553539950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c900043e0 msgr2=0x7f6c900048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.732+0000 7f6cad25b700 1 --2- 172.21.15.12:0/553539950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c900043e0 0x7f6c900048b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800c350 tx=0x7f6c90005880 comp rx=0 tx=0).stop 2023-07-07T18:15:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.732+0000 7f6ca759e700 1 -- 172.21.15.12:0/553539950 reap_dead start 2023-07-07T18:15:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.732+0000 7f6cad25b700 1 -- 172.21.15.12:0/553539950 shutdown_connections 2023-07-07T18:15:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.732+0000 7f6cad25b700 1 -- 172.21.15.12:0/553539950 >> 172.21.15.12:0/553539950 conn(0x7f6ca806b920 msgr2=0x7f6ca80cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.732+0000 7f6cad25b700 1 -- 172.21.15.12:0/553539950 shutdown_connections 2023-07-07T18:15:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.732+0000 7f6cad25b700 1 -- 172.21.15.12:0/553539950 wait complete. 2023-07-07T18:15:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6cad25b700 1 Processor -- start 2023-07-07T18:15:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6cad25b700 1 -- start start 2023-07-07T18:15:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6cad25b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c900043e0 0x7f6ca80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6cad25b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca80995a0 0x7f6ca80c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6cad25b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ca809adc0 0x7f6ca809b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6cad25b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca809b7a0 con 0x7f6ca80995a0 2023-07-07T18:15:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6cad25b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8150480 con 0x7f6ca809adc0 2023-07-07T18:15:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6cad25b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca809a640 con 0x7f6c900043e0 2023-07-07T18:15:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6ca659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca80995a0 0x7f6ca80c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.734+0000 7f6ca659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca80995a0 0x7f6ca80c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58870/0 (socket says 172.21.15.12:58870) 2023-07-07T18:15:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6ca659c700 1 -- 172.21.15.12:0/1624274909 learned_addr learned my addr 172.21.15.12:0/1624274909 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6ca759e700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ca809adc0 0x7f6ca809b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6ca6d9d700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c900043e0 0x7f6ca80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6ca659c700 1 -- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c900043e0 msgr2=0x7f6ca80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6ca659c700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c900043e0 0x7f6ca80aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6ca659c700 1 -- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ca809adc0 msgr2=0x7f6ca809b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6ca659c700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ca809adc0 0x7f6ca809b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6ca659c700 1 -- 172.21.15.12:0/1624274909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80af470 con 0x7f6ca80995a0 2023-07-07T18:15:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6ca659c700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca80995a0 0x7f6ca80c9d40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c98011000 tx=0x7f6c98001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6c8f7fe700 1 -- 172.21.15.12:0/1624274909 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98007c20 con 0x7f6ca80995a0 2023-07-07T18:15:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6c8f7fe700 1 -- 172.21.15.12:0/1624274909 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98004870 con 0x7f6ca80995a0 2023-07-07T18:15:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca809d1f0 con 0x7f6ca80995a0 2023-07-07T18:15:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6c8f7fe700 1 -- 172.21.15.12:0/1624274909 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98004c20 con 0x7f6ca80995a0 2023-07-07T18:15:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.735+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca8099a30 con 0x7f6ca80995a0 2023-07-07T18:15:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.736+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca8073910 con 0x7f6ca80995a0 2023-07-07T18:15:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.737+0000 7f6c8f7fe700 1 -- 172.21.15.12:0/1624274909 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c980070d0 con 0x7f6ca80995a0 2023-07-07T18:15:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.737+0000 7f6c8f7fe700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6c9406ace0 0x7f6c9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.737+0000 7f6c8f7fe700 1 -- 172.21.15.12:0/1624274909 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c9808a7e0 con 0x7f6ca80995a0 2023-07-07T18:15:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.737+0000 7f6ca6d9d700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6c9406ace0 0x7f6c9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:52.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.738+0000 7f6ca6d9d700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6c9406ace0 0x7f6c9406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ca806af50 tx=0x7f6c9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:52.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.741+0000 7f6c8f7fe700 1 -- 172.21.15.12:0/1624274909 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c980556b0 con 0x7f6ca80995a0 2023-07-07T18:15:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.943+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ca80af470 con 0x7f6ca80995a0 2023-07-07T18:15:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.944+0000 7f6c8f7fe700 1 -- 172.21.15.12:0/1624274909 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f6ca80af470 con 0x7f6ca80995a0 2023-07-07T18:15:52.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:52.947 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6c9406ace0 msgr2=0x7f6c9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6c9406ace0 0x7f6c9406d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6ca806af50 tx=0x7f6c9c008040 comp rx=0 tx=0).stop 2023-07-07T18:15:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca80995a0 msgr2=0x7f6ca80c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca80995a0 0x7f6ca80c9d40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c98011000 tx=0x7f6c98001a00 comp rx=0 tx=0).stop 2023-07-07T18:15:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 shutdown_connections 2023-07-07T18:15:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f6c9406ace0 0x7f6c9406d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ca809adc0 0x7f6ca809b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c900043e0 0x7f6ca80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 --2- 172.21.15.12:0/1624274909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ca80995a0 0x7f6ca80c9d40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 >> 172.21.15.12:0/1624274909 conn(0x7f6ca806b920 msgr2=0x7f6ca806eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 shutdown_connections 2023-07-07T18:15:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:52.946+0000 7f6cad25b700 1 -- 172.21.15.12:0/1624274909 wait complete. 2023-07-07T18:15:52.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:14:43.914969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:14:45.200432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-07T18:14:48.275636+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-07T18:15:52.962 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:15:53.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.088+0000 7fd086a0d700 1 Processor -- start 2023-07-07T18:15:53.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.088+0000 7fd086a0d700 1 -- start start 2023-07-07T18:15:53.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd086a0d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0800d0a60 0x7fd0800b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd086a0d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd0800cf910 0x7fd0800d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd086a0d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0800cd9d0 con 0x7fd0800b51d0 2023-07-07T18:15:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd086a0d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0800d0060 con 0x7fd0800d0a60 2023-07-07T18:15:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd086a0d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0800b5620 con 0x7fd0800cf910 2023-07-07T18:15:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0800d0a60 0x7fd0800b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd0800b51d0 0x7fd0800d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56076/0 (socket says 172.21.15.12:56076) 2023-07-07T18:15:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07f7fe700 1 -- 172.21.15.12:0/4136674353 learned_addr learned my addr 172.21.15.12:0/4136674353 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd084faa700 1 --2- 172.21.15.12:0/4136674353 >> v2:172.21.15.160:3300/0 conn(0x7fd0800cf910 0x7fd0800d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07ffff700 1 -- 172.21.15.12:0/4136674353 >> v2:172.21.15.160:3300/0 conn(0x7fd0800cf910 msgr2=0x7fd0800d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:53.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07ffff700 1 --2- 172.21.15.12:0/4136674353 >> v2:172.21.15.160:3300/0 conn(0x7fd0800cf910 0x7fd0800d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07ffff700 1 -- 172.21.15.12:0/4136674353 >> v1:172.21.15.12:6789/0 conn(0x7fd0800b51d0 legacy=0x7fd0800d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07ffff700 1 -- 172.21.15.12:0/4136674353 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800cd410 con 0x7fd0800d0a60 2023-07-07T18:15:53.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07effd700 1 -- 172.21.15.12:0/4136674353 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195652960 0 0) 0x7fd0800cd9d0 con 0x7fd0800b51d0 2023-07-07T18:15:53.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07ffff700 1 --2- 172.21.15.12:0/4136674353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800d0a60 0x7fd0800b5a70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd0800b2610 tx=0x7fd074009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5b986ba77b6c10 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:53.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.089+0000 7fd07effd700 1 -- 172.21.15.12:0/4136674353 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074011830 con 0x7fd0800d0a60 2023-07-07T18:15:53.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd07effd700 1 -- 172.21.15.12:0/4136674353 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd074011990 con 0x7fd0800d0a60 2023-07-07T18:15:53.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd07effd700 1 -- 172.21.15.12:0/4136674353 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074011d20 con 0x7fd0800d0a60 2023-07-07T18:15:53.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd086a0d700 1 -- 172.21.15.12:0/4136674353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800d0a60 msgr2=0x7fd0800b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd086a0d700 1 --2- 172.21.15.12:0/4136674353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800d0a60 0x7fd0800b5a70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd0800b2610 tx=0x7fd074009b20 comp rx=0 tx=0).stop 2023-07-07T18:15:53.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd086a0d700 1 -- 172.21.15.12:0/4136674353 shutdown_connections 2023-07-07T18:15:53.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd086a0d700 1 --2- 172.21.15.12:0/4136674353 >> v2:172.21.15.160:3300/0 conn(0x7fd0800cf910 0x7fd0800d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd086a0d700 1 --2- 172.21.15.12:0/4136674353 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800d0a60 0x7fd0800b5a70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd086a0d700 1 -- 172.21.15.12:0/4136674353 >> 172.21.15.12:0/4136674353 conn(0x7fd080071620 msgr2=0x7fd0800719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:53.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd086a0d700 1 -- 172.21.15.12:0/4136674353 shutdown_connections 2023-07-07T18:15:53.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.090+0000 7fd086a0d700 1 -- 172.21.15.12:0/4136674353 wait complete. 2023-07-07T18:15:53.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.091+0000 7fd086a0d700 1 Processor -- start 2023-07-07T18:15:53.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd086a0d700 1 -- start start 2023-07-07T18:15:53.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd086a0d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800b51d0 0x7fd080151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd086a0d700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0800cf910 0x7fd08015ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd086a0d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0800d0a60 0x7fd08015f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd086a0d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800c74a0 con 0x7fd0800b51d0 2023-07-07T18:15:53.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd086a0d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800c8020 con 0x7fd0800d0a60 2023-07-07T18:15:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd086a0d700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08015f680 con 0x7fd0800cf910 2023-07-07T18:15:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd07ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800b51d0 0x7fd080151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd07ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800b51d0 0x7fd080151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58882/0 (socket says 172.21.15.12:58882) 2023-07-07T18:15:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd07ffff700 1 -- 172.21.15.12:0/102391274 learned_addr learned my addr 172.21.15.12:0/102391274 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd084faa700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0800d0a60 0x7fd08015f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.092+0000 7fd07f7fe700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0800cf910 0x7fd08015ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd07ffff700 1 -- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0800cf910 msgr2=0x7fd08015ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd07ffff700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0800cf910 0x7fd08015ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd07ffff700 1 -- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0800d0a60 msgr2=0x7fd08015f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd07ffff700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0800d0a60 0x7fd08015f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd07ffff700 1 -- 172.21.15.12:0/102391274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0740094a0 con 0x7fd0800b51d0 2023-07-07T18:15:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd084faa700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0800d0a60 0x7fd08015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd07ffff700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800b51d0 0x7fd080151230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd0740090b0 tx=0x7fd074004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd07cff9700 1 -- 172.21.15.12:0/102391274 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740038a0 con 0x7fd0800b51d0 2023-07-07T18:15:53.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd07cff9700 1 -- 172.21.15.12:0/102391274 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07401e070 con 0x7fd0800b51d0 2023-07-07T18:15:53.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0800c76f0 con 0x7fd0800b51d0 2023-07-07T18:15:53.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd07cff9700 1 -- 172.21.15.12:0/102391274 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074003c20 con 0x7fd0800b51d0 2023-07-07T18:15:53.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.093+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0800c7cb0 con 0x7fd0800b51d0 2023-07-07T18:15:53.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.094+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08004ea20 con 0x7fd0800b51d0 2023-07-07T18:15:53.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.094+0000 7fd07cff9700 1 -- 172.21.15.12:0/102391274 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd07401a420 con 0x7fd0800b51d0 2023-07-07T18:15:53.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.095+0000 7fd07cff9700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd06c06ace0 0x7fd06c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.095+0000 7fd07cff9700 1 -- 172.21.15.12:0/102391274 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd07408a850 con 0x7fd0800b51d0 2023-07-07T18:15:53.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.095+0000 7fd07f7fe700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd06c06ace0 0x7fd06c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.096+0000 7fd07f7fe700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd06c06ace0 0x7fd06c06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd0801f5900 tx=0x7fd070007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:53.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.100+0000 7fd07cff9700 1 -- 172.21.15.12:0/102391274 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd074055660 con 0x7fd0800b51d0 2023-07-07T18:15:53.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.294+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0800ccb00 con 0x7fd0800b51d0 2023-07-07T18:15:53.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.294+0000 7fd07cff9700 1 -- 172.21.15.12:0/102391274 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd074058c80 con 0x7fd0800b51d0 2023-07-07T18:15:53.297 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:15:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd06c06ace0 msgr2=0x7fd06c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd06c06ace0 0x7fd06c06d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd0801f5900 tx=0x7fd070007be0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800b51d0 msgr2=0x7fd080151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800b51d0 0x7fd080151230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd0740090b0 tx=0x7fd074004750 comp rx=0 tx=0).stop 2023-07-07T18:15:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 shutdown_connections 2023-07-07T18:15:53.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd06c06ace0 0x7fd06c06d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0800d0a60 0x7fd08015f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0800b51d0 0x7fd080151230 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 --2- 172.21.15.12:0/102391274 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0800cf910 0x7fd08015ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 >> 172.21.15.12:0/102391274 conn(0x7fd080071620 msgr2=0x7fd0801e4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 shutdown_connections 2023-07-07T18:15:53.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.297+0000 7fd086a0d700 1 -- 172.21.15.12:0/102391274 wait complete. 2023-07-07T18:15:53.311 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:15:53.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.437+0000 7f9798eb7700 1 Processor -- start 2023-07-07T18:15:53.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.437+0000 7f9798eb7700 1 -- start start 2023-07-07T18:15:53.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f9798eb7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f97940b23a0 0x7f979406cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f9798eb7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979415c720 con 0x7f979415d2d0 2023-07-07T18:15:53.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f9798eb7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97940d03a0 con 0x7f979406b000 2023-07-07T18:15:53.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f9798eb7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979415d820 con 0x7f97940b23a0 2023-07-07T18:15:53.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f979259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f97940b23a0 0x7f979406cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f9791d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f979415d2d0 0x7f97940b2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56088/0 (socket says 172.21.15.12:56088) 2023-07-07T18:15:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f979259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f97940b23a0 0x7f979406cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58890/0 (socket says 172.21.15.12:58890) 2023-07-07T18:15:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f9791d9b700 1 -- 172.21.15.12:0/1516568803 learned_addr learned my addr 172.21.15.12:0/1516568803 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f979259c700 1 -- 172.21.15.12:0/1516568803 >> v1:172.21.15.160:6789/0 conn(0x7f979406b000 legacy=0x7f979406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f979259c700 1 -- 172.21.15.12:0/1516568803 >> v1:172.21.15.12:6789/0 conn(0x7f979415d2d0 legacy=0x7f97940b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f979259c700 1 -- 172.21.15.12:0/1516568803 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940ce690 con 0x7f97940b23a0 2023-07-07T18:15:53.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f979159a700 1 -- 172.21.15.12:0/1516568803 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375045834 0 0) 0x7f9788001110 con 0x7f979415d2d0 2023-07-07T18:15:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f979259c700 1 --2- 172.21.15.12:0/1516568803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97940b23a0 0x7f979406cc60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9784009840 tx=0x7f9784009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7b0bddfca46810 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f979159a700 1 -- 172.21.15.12:0/1516568803 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784004230 con 0x7f97940b23a0 2023-07-07T18:15:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.438+0000 7f979159a700 1 -- 172.21.15.12:0/1516568803 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9784004390 con 0x7f97940b23a0 2023-07-07T18:15:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.439+0000 7f979159a700 1 -- 172.21.15.12:0/1516568803 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840036a0 con 0x7f97940b23a0 2023-07-07T18:15:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.439+0000 7f9798eb7700 1 -- 172.21.15.12:0/1516568803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97940b23a0 msgr2=0x7f979406cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.439+0000 7f9798eb7700 1 --2- 172.21.15.12:0/1516568803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97940b23a0 0x7f979406cc60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9784009840 tx=0x7f9784009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:53.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.439+0000 7f9798eb7700 1 -- 172.21.15.12:0/1516568803 shutdown_connections 2023-07-07T18:15:53.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.439+0000 7f9798eb7700 1 --2- 172.21.15.12:0/1516568803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f97940b23a0 0x7f979406cc60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.439+0000 7f9798eb7700 1 -- 172.21.15.12:0/1516568803 >> 172.21.15.12:0/1516568803 conn(0x7f979406e5c0 msgr2=0x7f979406e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:53.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.439+0000 7f9798eb7700 1 -- 172.21.15.12:0/1516568803 shutdown_connections 2023-07-07T18:15:53.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.439+0000 7f9798eb7700 1 -- 172.21.15.12:0/1516568803 wait complete. 2023-07-07T18:15:53.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.440+0000 7f9798eb7700 1 Processor -- start 2023-07-07T18:15:53.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.440+0000 7f9798eb7700 1 -- start start 2023-07-07T18:15:53.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f9798eb7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f979406b000 0x7f97941591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f9798eb7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b23a0 0x7f97941597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f9798eb7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f979415d2d0 0x7f9794159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f9798eb7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97941f1e20 con 0x7f979406b000 2023-07-07T18:15:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f9798eb7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940aca00 con 0x7f97940b23a0 2023-07-07T18:15:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f9798eb7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97940ac480 con 0x7f979415d2d0 2023-07-07T18:15:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f979259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f979406b000 0x7f97941591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f979259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f979406b000 0x7f97941591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58896/0 (socket says 172.21.15.12:58896) 2023-07-07T18:15:53.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f979259c700 1 -- 172.21.15.12:0/951928742 learned_addr learned my addr 172.21.15.12:0/951928742 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:53.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.441+0000 7f9792d9d700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f979415d2d0 0x7f9794159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f9791d9b700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b23a0 0x7f97941597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f979259c700 1 -- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f979415d2d0 msgr2=0x7f9794159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f979259c700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f979415d2d0 0x7f9794159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f979259c700 1 -- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b23a0 msgr2=0x7f97941597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f979259c700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b23a0 0x7f97941597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f979259c700 1 -- 172.21.15.12:0/951928742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840094a0 con 0x7f979406b000 2023-07-07T18:15:53.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f9791d9b700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b23a0 0x7f97941597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:53.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f979259c700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f979406b000 0x7f97941591d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f97840090b0 tx=0x7f9784004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:53.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f9782ffd700 1 -- 172.21.15.12:0/951928742 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784011830 con 0x7f979406b000 2023-07-07T18:15:53.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f9782ffd700 1 -- 172.21.15.12:0/951928742 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978401e070 con 0x7f979406b000 2023-07-07T18:15:53.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97941f2060 con 0x7f979406b000 2023-07-07T18:15:53.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f9782ffd700 1 -- 172.21.15.12:0/951928742 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784011bf0 con 0x7f979406b000 2023-07-07T18:15:53.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.442+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97940ac720 con 0x7f979406b000 2023-07-07T18:15:53.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.443+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97940cdb10 con 0x7f979406b000 2023-07-07T18:15:53.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.444+0000 7f9782ffd700 1 -- 172.21.15.12:0/951928742 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9784011d50 con 0x7f979406b000 2023-07-07T18:15:53.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.444+0000 7f9782ffd700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f977406ace0 0x7f977406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.444+0000 7f9782ffd700 1 -- 172.21.15.12:0/951928742 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f978408ab40 con 0x7f979406b000 2023-07-07T18:15:53.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.444+0000 7f9791d9b700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f977406ace0 0x7f977406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.445+0000 7f9791d9b700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f977406ace0 0x7f977406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9788007fd0 tx=0x7f9788009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:53.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.448+0000 7f9782ffd700 1 -- 172.21.15.12:0/951928742 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9784055950 con 0x7f979406b000 2023-07-07T18:15:53.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.643+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97940ac1d0 con 0x7f979406b000 2023-07-07T18:15:53.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.644+0000 7f9782ffd700 1 -- 172.21.15.12:0/951928742 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9784058f70 con 0x7f979406b000 2023-07-07T18:15:53.646 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:15:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f977406ace0 msgr2=0x7f977406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f977406ace0 0x7f977406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9788007fd0 tx=0x7f9788009040 comp rx=0 tx=0).stop 2023-07-07T18:15:53.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f979406b000 msgr2=0x7f97941591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f979406b000 0x7f97941591d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f97840090b0 tx=0x7f9784004750 comp rx=0 tx=0).stop 2023-07-07T18:15:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 shutdown_connections 2023-07-07T18:15:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f977406ace0 0x7f977406d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f979415d2d0 0x7f9794159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f979406b000 0x7f97941591d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 --2- 172.21.15.12:0/951928742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b23a0 0x7f97941597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 >> 172.21.15.12:0/951928742 conn(0x7f979406e5c0 msgr2=0x7f979415ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:53.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 shutdown_connections 2023-07-07T18:15:53.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.646+0000 7f9798eb7700 1 -- 172.21.15.12:0/951928742 wait complete. 2023-07-07T18:15:53.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T18:15:53.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.785+0000 7fcc641f2700 1 Processor -- start 2023-07-07T18:15:53.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.786+0000 7fcc641f2700 1 -- start start 2023-07-07T18:15:53.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.786+0000 7fcc641f2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c15a330 0x7fcc5c070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.786+0000 7fcc641f2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc5c0afc40 0x7fcc5c15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.786+0000 7fcc641f2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0caf70 con 0x7fcc5c0cd330 2023-07-07T18:15:53.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.786+0000 7fcc641f2700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c0cb210 con 0x7fcc5c0afc40 2023-07-07T18:15:53.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.786+0000 7fcc641f2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c0ccc20 con 0x7fcc5c15a330 2023-07-07T18:15:53.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc6278f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc5c0afc40 0x7fcc5c15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc6278f700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc5c0afc40 0x7fcc5c15dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58908/0 (socket says 172.21.15.12:58908) 2023-07-07T18:15:53.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc61f8e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcc5c0cd330 0x7fcc5c0cd700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56102/0 (socket says 172.21.15.12:56102) 2023-07-07T18:15:53.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc6278f700 1 -- 172.21.15.12:0/1779209746 learned_addr learned my addr 172.21.15.12:0/1779209746 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:53.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc6178d700 1 --2- 172.21.15.12:0/1779209746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c15a330 0x7fcc5c070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc6278f700 1 -- 172.21.15.12:0/1779209746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c15a330 msgr2=0x7fcc5c070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:53.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc6278f700 1 --2- 172.21.15.12:0/1779209746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c15a330 0x7fcc5c070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc6278f700 1 -- 172.21.15.12:0/1779209746 >> v1:172.21.15.12:6789/0 conn(0x7fcc5c0cd330 legacy=0x7fcc5c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc60f8c700 1 -- 172.21.15.12:0/1779209746 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992458942 0 0) 0x7fcc5c0caf70 con 0x7fcc5c0cd330 2023-07-07T18:15:53.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc6278f700 1 -- 172.21.15.12:0/1779209746 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0ccf00 con 0x7fcc5c0afc40 2023-07-07T18:15:53.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc6278f700 1 --2- 172.21.15.12:0/1779209746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 0x7fcc5c15dc50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009e50 tx=0x7fcc5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea04833ff47b72ae server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:53.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc60f8c700 1 -- 172.21.15.12:0/1779209746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400e070 con 0x7fcc5c0afc40 2023-07-07T18:15:53.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc60f8c700 1 -- 172.21.15.12:0/1779209746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5400b910 con 0x7fcc5c0afc40 2023-07-07T18:15:53.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.787+0000 7fcc60f8c700 1 -- 172.21.15.12:0/1779209746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5400bcc0 con 0x7fcc5c0afc40 2023-07-07T18:15:53.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.788+0000 7fcc641f2700 1 -- 172.21.15.12:0/1779209746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 msgr2=0x7fcc5c15dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.788+0000 7fcc641f2700 1 --2- 172.21.15.12:0/1779209746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 0x7fcc5c15dc50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcc54009e50 tx=0x7fcc5400b330 comp rx=0 tx=0).stop 2023-07-07T18:15:53.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.788+0000 7fcc641f2700 1 -- 172.21.15.12:0/1779209746 shutdown_connections 2023-07-07T18:15:53.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.788+0000 7fcc641f2700 1 --2- 172.21.15.12:0/1779209746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 0x7fcc5c15dc50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.788+0000 7fcc641f2700 1 --2- 172.21.15.12:0/1779209746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c15a330 0x7fcc5c070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.788+0000 7fcc641f2700 1 -- 172.21.15.12:0/1779209746 >> 172.21.15.12:0/1779209746 conn(0x7fcc5c06e5c0 msgr2=0x7fcc5c06e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:53.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.788+0000 7fcc641f2700 1 -- 172.21.15.12:0/1779209746 shutdown_connections 2023-07-07T18:15:53.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.788+0000 7fcc641f2700 1 -- 172.21.15.12:0/1779209746 wait complete. 2023-07-07T18:15:53.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.789+0000 7fcc641f2700 1 Processor -- start 2023-07-07T18:15:53.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.789+0000 7fcc641f2700 1 -- start start 2023-07-07T18:15:53.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc641f2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 0x7fcc5c153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc641f2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c0cd330 0x7fcc5c0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc641f2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc5c15a330 0x7fcc5c0c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc641f2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c153f70 con 0x7fcc5c0afc40 2023-07-07T18:15:53.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc641f2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c15a7f0 con 0x7fcc5c15a330 2023-07-07T18:15:53.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc641f2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c15aad0 con 0x7fcc5c0cd330 2023-07-07T18:15:53.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc61f8e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 0x7fcc5c153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc61f8e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 0x7fcc5c153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58910/0 (socket says 172.21.15.12:58910) 2023-07-07T18:15:53.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc61f8e700 1 -- 172.21.15.12:0/3437791947 learned_addr learned my addr 172.21.15.12:0/3437791947 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:53.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc6178d700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c0cd330 0x7fcc5c0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc6278f700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc5c15a330 0x7fcc5c0c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc61f8e700 1 -- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c0cd330 msgr2=0x7fcc5c0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc61f8e700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c0cd330 0x7fcc5c0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc61f8e700 1 -- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc5c15a330 msgr2=0x7fcc5c0c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc61f8e700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc5c15a330 0x7fcc5c0c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc61f8e700 1 -- 172.21.15.12:0/3437791947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54009b30 con 0x7fcc5c0afc40 2023-07-07T18:15:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.790+0000 7fcc61f8e700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 0x7fcc5c153a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0011e0 tx=0x7fcc4c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.791+0000 7fcc527fc700 1 -- 172.21.15.12:0/3437791947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c004c80 con 0x7fcc5c0afc40 2023-07-07T18:15:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.791+0000 7fcc527fc700 1 -- 172.21.15.12:0/3437791947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c004e00 con 0x7fcc5c0afc40 2023-07-07T18:15:53.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.791+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c15adb0 con 0x7fcc5c0afc40 2023-07-07T18:15:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.791+0000 7fcc527fc700 1 -- 172.21.15.12:0/3437791947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c007310 con 0x7fcc5c0afc40 2023-07-07T18:15:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.791+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c15b370 con 0x7fcc5c0afc40 2023-07-07T18:15:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.792+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c15d660 con 0x7fcc5c0afc40 2023-07-07T18:15:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.792+0000 7fcc527fc700 1 -- 172.21.15.12:0/3437791947 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc4c007470 con 0x7fcc5c0afc40 2023-07-07T18:15:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.792+0000 7fcc527fc700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcc4006ace0 0x7fcc4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.792+0000 7fcc527fc700 1 -- 172.21.15.12:0/3437791947 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcc4c089550 con 0x7fcc5c0afc40 2023-07-07T18:15:53.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.793+0000 7fcc6178d700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcc4006ace0 0x7fcc4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.793+0000 7fcc6178d700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcc4006ace0 0x7fcc4006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0b3260 tx=0x7fcc58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:53.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.797+0000 7fcc527fc700 1 -- 172.21.15.12:0/3437791947 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc4c0542d0 con 0x7fcc5c0afc40 2023-07-07T18:15:53.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.996+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc5c04ea20 con 0x7fcc5c0afc40 2023-07-07T18:15:53.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.997+0000 7fcc527fc700 1 -- 172.21.15.12:0/3437791947 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc4c0578f0 con 0x7fcc5c0afc40 2023-07-07T18:15:53.999 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.998+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcc4006ace0 msgr2=0x7fcc4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.998+0000 7fcc641f2700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcc4006ace0 0x7fcc4006d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0b3260 tx=0x7fcc58008040 comp rx=0 tx=0).stop 2023-07-07T18:15:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 msgr2=0x7fcc5c153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 0x7fcc5c153a30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0011e0 tx=0x7fcc4c00cae0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 shutdown_connections 2023-07-07T18:15:54.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcc4006ace0 0x7fcc4006d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc5c15a330 0x7fcc5c0c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc5c0afc40 0x7fcc5c153a30 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 --2- 172.21.15.12:0/3437791947 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc5c0cd330 0x7fcc5c0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 >> 172.21.15.12:0/3437791947 conn(0x7fcc5c06e5c0 msgr2=0x7fcc5c0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 shutdown_connections 2023-07-07T18:15:54.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:53.999+0000 7fcc641f2700 1 -- 172.21.15.12:0/3437791947 wait complete. 2023-07-07T18:15:54.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T18:15:54.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.138+0000 7f0d25faf700 1 Processor -- start 2023-07-07T18:15:54.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.138+0000 7f0d25faf700 1 -- start start 2023-07-07T18:15:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.139+0000 7f0d25faf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d2006e7d0 0x7f0d20165370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.139+0000 7f0d25faf700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d200aee00 con 0x7f0d2015a430 2023-07-07T18:15:54.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.139+0000 7f0d25faf700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2006e340 con 0x7f0d200ae8b0 2023-07-07T18:15:54.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.139+0000 7f0d25faf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200af330 con 0x7f0d2006e7d0 2023-07-07T18:15:54.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.139+0000 7f0d1f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0d2015a430 0x7f0d200ac600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56116/0 (socket says 172.21.15.12:56116) 2023-07-07T18:15:54.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.139+0000 7f0d1f7fe700 1 -- 172.21.15.12:0/562075682 learned_addr learned my addr 172.21.15.12:0/562075682 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1ffff700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d2006e7d0 0x7f0d20165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614970247 0 0) 0x7f0d200aee00 con 0x7f0d2015a430 2023-07-07T18:15:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d0c0035b0 con 0x7f0d2015a430 2023-07-07T18:15:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2736553689 0 0) 0x7f0d0c0035b0 con 0x7f0d2015a430 2023-07-07T18:15:54.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d2006e7d0 msgr2=0x7f0d20165370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:54.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d2006e7d0 0x7f0d20165370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 >> v1:172.21.15.160:6789/0 conn(0x7f0d200ae8b0 legacy=0x7f0d200acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2006ec50 con 0x7f0d2015a430 2023-07-07T18:15:54.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f0d100017f0 con 0x7f0d2015a430 2023-07-07T18:15:54.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 >> v1:172.21.15.12:6789/0 conn(0x7f0d2015a430 legacy=0x7f0d200ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d2006e7d0 0x7f0d0c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c003fb0 0x7f0d0c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d0c004d90 0x7f0d0c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200af330 con 0x7f0d0c003fb0 2023-07-07T18:15:54.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c00baf0 con 0x7f0d0c004d90 2023-07-07T18:15:54.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c00bcb0 con 0x7f0d2006e7d0 2023-07-07T18:15:54.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1effd700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c003fb0 0x7f0d0c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1f7fe700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d2006e7d0 0x7f0d0c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1ffff700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d0c004d90 0x7f0d0c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1effd700 1 -- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d2006e7d0 msgr2=0x7f0d0c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:54.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1effd700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d2006e7d0 0x7f0d0c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1effd700 1 -- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d0c004d90 msgr2=0x7f0d0c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:54.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1effd700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d0c004d90 0x7f0d0c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.140+0000 7f0d1effd700 1 -- 172.21.15.12:0/562075682 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c0035b0 con 0x7f0d0c003fb0 2023-07-07T18:15:54.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d1effd700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c003fb0 0x7f0d0c004850 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0d08007fd0 tx=0x7f0d0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd20591cb90068e server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:54.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d080052d0 con 0x7f0d0c003fb0 2023-07-07T18:15:54.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d08005470 con 0x7f0d0c003fb0 2023-07-07T18:15:54.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d1e7fc700 1 -- 172.21.15.12:0/562075682 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d080038c0 con 0x7f0d0c003fb0 2023-07-07T18:15:54.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d25faf700 1 -- 172.21.15.12:0/562075682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c003fb0 msgr2=0x7f0d0c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d25faf700 1 --2- 172.21.15.12:0/562075682 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d0c003fb0 0x7f0d0c004850 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0d08007fd0 tx=0x7f0d0c005880 comp rx=0 tx=0).stop 2023-07-07T18:15:54.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d1ffff700 1 -- 172.21.15.12:0/562075682 reap_dead start 2023-07-07T18:15:54.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d25faf700 1 -- 172.21.15.12:0/562075682 shutdown_connections 2023-07-07T18:15:54.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d25faf700 1 -- 172.21.15.12:0/562075682 >> 172.21.15.12:0/562075682 conn(0x7f0d2006b920 msgr2=0x7f0d200cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:54.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d25faf700 1 -- 172.21.15.12:0/562075682 shutdown_connections 2023-07-07T18:15:54.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.141+0000 7f0d25faf700 1 -- 172.21.15.12:0/562075682 wait complete. 2023-07-07T18:15:54.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.143+0000 7f0d25faf700 1 Processor -- start 2023-07-07T18:15:54.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.143+0000 7f0d25faf700 1 -- start start 2023-07-07T18:15:54.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.143+0000 7f0d25faf700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d0c003fb0 0x7f0d200b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.143+0000 7f0d25faf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d20152f80 0x7f0d201efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.143+0000 7f0d25faf700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d200c6ae0 0x7f0d200c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.143+0000 7f0d25faf700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200c4240 con 0x7f0d200c6ae0 2023-07-07T18:15:54.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.143+0000 7f0d25faf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200c7490 con 0x7f0d20152f80 2023-07-07T18:15:54.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.143+0000 7f0d25faf700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200c44e0 con 0x7f0d0c003fb0 2023-07-07T18:15:54.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d200c6ae0 0x7f0d200c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d200c6ae0 0x7f0d200c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58934/0 (socket says 172.21.15.12:58934) 2023-07-07T18:15:54.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1f7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d0c003fb0 0x7f0d200b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1ffff700 1 -- 172.21.15.12:0/2121775173 learned_addr learned my addr 172.21.15.12:0/2121775173 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:54.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1effd700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d20152f80 0x7f0d201efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1ffff700 1 -- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d0c003fb0 msgr2=0x7f0d200b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1ffff700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d0c003fb0 0x7f0d200b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1ffff700 1 -- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d20152f80 msgr2=0x7f0d201efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1ffff700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d20152f80 0x7f0d201efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1ffff700 1 -- 172.21.15.12:0/2121775173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d200b47e0 con 0x7f0d200c6ae0 2023-07-07T18:15:54.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d1ffff700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d200c6ae0 0x7f0d200c6f50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0d18011bf0 tx=0x7f0d18011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:54.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d17fff700 1 -- 172.21.15.12:0/2121775173 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800e040 con 0x7f0d200c6ae0 2023-07-07T18:15:54.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d17fff700 1 -- 172.21.15.12:0/2121775173 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1800f040 con 0x7f0d200c6ae0 2023-07-07T18:15:54.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d200b4a60 con 0x7f0d200c6ae0 2023-07-07T18:15:54.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d17fff700 1 -- 172.21.15.12:0/2121775173 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800fd30 con 0x7f0d200c6ae0 2023-07-07T18:15:54.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.144+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d200b5020 con 0x7f0d200c6ae0 2023-07-07T18:15:54.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.145+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d200b5240 con 0x7f0d200c6ae0 2023-07-07T18:15:54.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.146+0000 7f0d17fff700 1 -- 172.21.15.12:0/2121775173 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d18022460 con 0x7f0d200c6ae0 2023-07-07T18:15:54.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.146+0000 7f0d17fff700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d0006ace0 0x7f0d0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.146+0000 7f0d17fff700 1 -- 172.21.15.12:0/2121775173 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d18089d00 con 0x7f0d200c6ae0 2023-07-07T18:15:54.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.147+0000 7f0d1f7fe700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d0006ace0 0x7f0d0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.147+0000 7f0d1f7fe700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d0006ace0 0x7f0d0006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d10000c00 tx=0x7f0d10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:54.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.151+0000 7f0d17fff700 1 -- 172.21.15.12:0/2121775173 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d180549f0 con 0x7f0d200c6ae0 2023-07-07T18:15:54.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.353+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d2004ea20 con 0x7f0d200c6ae0 2023-07-07T18:15:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.353+0000 7f0d17fff700 1 -- 172.21.15.12:0/2121775173 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d18058010 con 0x7f0d200c6ae0 2023-07-07T18:15:54.355 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T18:15:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d0006ace0 msgr2=0x7f0d0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d0006ace0 0x7f0d0006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d10000c00 tx=0x7f0d10009040 comp rx=0 tx=0).stop 2023-07-07T18:15:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d200c6ae0 msgr2=0x7f0d200c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d200c6ae0 0x7f0d200c6f50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0d18011bf0 tx=0x7f0d18011f00 comp rx=0 tx=0).stop 2023-07-07T18:15:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 shutdown_connections 2023-07-07T18:15:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0d0006ace0 0x7f0d0006d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d200c6ae0 0x7f0d200c6f50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d0c003fb0 0x7f0d200b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 --2- 172.21.15.12:0/2121775173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d20152f80 0x7f0d201efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 >> 172.21.15.12:0/2121775173 conn(0x7f0d2006b920 msgr2=0x7f0d200af510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 shutdown_connections 2023-07-07T18:15:54.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.355+0000 7f0d25faf700 1 -- 172.21.15.12:0/2121775173 wait complete. 2023-07-07T18:15:54.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-07T18:15:54.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.495+0000 7f035eb03700 1 Processor -- start 2023-07-07T18:15:54.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.495+0000 7f035eb03700 1 -- start start 2023-07-07T18:15:54.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.496+0000 7f035eb03700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f03580cfd80 0x7f035815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.496+0000 7f035eb03700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0358069ef0 0x7f035806a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.496+0000 7f035eb03700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03580cb380 con 0x7f035806ccd0 2023-07-07T18:15:54.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.496+0000 7f035eb03700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035815b7a0 con 0x7f0358069ef0 2023-07-07T18:15:54.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.496+0000 7f035eb03700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03580c97f0 con 0x7f03580cfd80 2023-07-07T18:15:54.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.496+0000 7f035d0a0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0358069ef0 0x7f035806a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.496+0000 7f035d0a0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0358069ef0 0x7f035806a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58942/0 (socket says 172.21.15.12:58942) 2023-07-07T18:15:54.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.496+0000 7f035d0a0700 1 -- 172.21.15.12:0/707564028 learned_addr learned my addr 172.21.15.12:0/707564028 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:54.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.496+0000 7f0357fff700 1 --2- 172.21.15.12:0/707564028 >> v2:172.21.15.160:3300/0 conn(0x7f03580cfd80 0x7f035815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f035d0a0700 1 -- 172.21.15.12:0/707564028 >> v2:172.21.15.160:3300/0 conn(0x7f03580cfd80 msgr2=0x7f035815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:54.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f035d0a0700 1 --2- 172.21.15.12:0/707564028 >> v2:172.21.15.160:3300/0 conn(0x7f03580cfd80 0x7f035815b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f035d0a0700 1 -- 172.21.15.12:0/707564028 >> v1:172.21.15.160:6789/0 conn(0x7f035806ccd0 legacy=0x7f035806d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:54.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f035d0a0700 1 -- 172.21.15.12:0/707564028 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03580cb620 con 0x7f0358069ef0 2023-07-07T18:15:54.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f035d0a0700 1 --2- 172.21.15.12:0/707564028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 0x7f035806a370 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f03580cf0d0 tx=0x7f035000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5198a8d03484966b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:54.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f03577fe700 1 -- 172.21.15.12:0/707564028 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035000e070 con 0x7f0358069ef0 2023-07-07T18:15:54.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f03577fe700 1 -- 172.21.15.12:0/707564028 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0350003a20 con 0x7f0358069ef0 2023-07-07T18:15:54.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f03577fe700 1 -- 172.21.15.12:0/707564028 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350003dd0 con 0x7f0358069ef0 2023-07-07T18:15:54.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f035eb03700 1 -- 172.21.15.12:0/707564028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 msgr2=0x7f035806a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f035eb03700 1 --2- 172.21.15.12:0/707564028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 0x7f035806a370 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f03580cf0d0 tx=0x7f035000b330 comp rx=0 tx=0).stop 2023-07-07T18:15:54.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.497+0000 7f035eb03700 1 -- 172.21.15.12:0/707564028 shutdown_connections 2023-07-07T18:15:54.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.498+0000 7f035eb03700 1 --2- 172.21.15.12:0/707564028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 0x7f035806a370 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.498+0000 7f035eb03700 1 --2- 172.21.15.12:0/707564028 >> v2:172.21.15.160:3300/0 conn(0x7f03580cfd80 0x7f035815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.498+0000 7f035eb03700 1 -- 172.21.15.12:0/707564028 >> 172.21.15.12:0/707564028 conn(0x7f03580b1990 msgr2=0x7f03580cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:54.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.498+0000 7f035eb03700 1 -- 172.21.15.12:0/707564028 shutdown_connections 2023-07-07T18:15:54.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.498+0000 7f035eb03700 1 -- 172.21.15.12:0/707564028 wait complete. 2023-07-07T18:15:54.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.499+0000 7f035eb03700 1 Processor -- start 2023-07-07T18:15:54.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.499+0000 7f035eb03700 1 -- start start 2023-07-07T18:15:54.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.500+0000 7f035eb03700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 0x7f035815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.500+0000 7f035eb03700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035806ccd0 0x7f03580c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.500+0000 7f035eb03700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03580cfd80 0x7f035814a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.500+0000 7f035eb03700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03580c5230 con 0x7f0358069ef0 2023-07-07T18:15:54.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.500+0000 7f035eb03700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035815c7a0 con 0x7f035806ccd0 2023-07-07T18:15:54.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.500+0000 7f035eb03700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03580c4c70 con 0x7f03580cfd80 2023-07-07T18:15:54.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.500+0000 7f035c89f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 0x7f035815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.500+0000 7f035c89f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 0x7f035815c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58944/0 (socket says 172.21.15.12:58944) 2023-07-07T18:15:54.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.500+0000 7f035c89f700 1 -- 172.21.15.12:0/3280681404 learned_addr learned my addr 172.21.15.12:0/3280681404 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:54.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035d0a0700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03580cfd80 0x7f035814a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f0357fff700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035806ccd0 0x7f03580c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035c89f700 1 -- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03580cfd80 msgr2=0x7f035814a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035c89f700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03580cfd80 0x7f035814a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035c89f700 1 -- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035806ccd0 msgr2=0x7f03580c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035c89f700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035806ccd0 0x7f03580c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035c89f700 1 -- 172.21.15.12:0/3280681404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0350009b30 con 0x7f0358069ef0 2023-07-07T18:15:54.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f0357fff700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035806ccd0 0x7f03580c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:54.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035d0a0700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03580cfd80 0x7f035814a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:54.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035c89f700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 0x7f035815c260 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f034c00b4a0 tx=0x7f034c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:54.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f03557fa700 1 -- 172.21.15.12:0/3280681404 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c011830 con 0x7f0358069ef0 2023-07-07T18:15:54.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f03557fa700 1 -- 172.21.15.12:0/3280681404 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c011990 con 0x7f0358069ef0 2023-07-07T18:15:54.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03580c4f50 con 0x7f0358069ef0 2023-07-07T18:15:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f03557fa700 1 -- 172.21.15.12:0/3280681404 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c011d40 con 0x7f0358069ef0 2023-07-07T18:15:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.501+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035815bd40 con 0x7f0358069ef0 2023-07-07T18:15:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.502+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035804ea20 con 0x7f0358069ef0 2023-07-07T18:15:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.502+0000 7f03557fa700 1 -- 172.21.15.12:0/3280681404 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f034c01a400 con 0x7f0358069ef0 2023-07-07T18:15:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.503+0000 7f03557fa700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f033c06ace0 0x7f033c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.503+0000 7f03557fa700 1 -- 172.21.15.12:0/3280681404 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f034c089550 con 0x7f0358069ef0 2023-07-07T18:15:54.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.503+0000 7f0357fff700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f033c06ace0 0x7f033c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.504+0000 7f0357fff700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f033c06ace0 0x7f033c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f035815d9c0 tx=0x7f0344008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:54.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.507+0000 7f03557fa700 1 -- 172.21.15.12:0/3280681404 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f034c0542d0 con 0x7f0358069ef0 2023-07-07T18:15:54.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.704+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0358067970 con 0x7f0358069ef0 2023-07-07T18:15:54.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.704+0000 7f03557fa700 1 -- 172.21.15.12:0/3280681404 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f034c0578f0 con 0x7f0358069ef0 2023-07-07T18:15:54.707 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T18:15:54.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f033c06ace0 msgr2=0x7f033c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f033c06ace0 0x7f033c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f035815d9c0 tx=0x7f0344008040 comp rx=0 tx=0).stop 2023-07-07T18:15:54.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 msgr2=0x7f035815c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 0x7f035815c260 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f034c00b4a0 tx=0x7f034c00b860 comp rx=0 tx=0).stop 2023-07-07T18:15:54.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 shutdown_connections 2023-07-07T18:15:54.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f033c06ace0 0x7f033c06d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03580cfd80 0x7f035814a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0358069ef0 0x7f035815c260 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 --2- 172.21.15.12:0/3280681404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f035806ccd0 0x7f03580c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 >> 172.21.15.12:0/3280681404 conn(0x7f03580b1990 msgr2=0x7f03580b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:54.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.706+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 shutdown_connections 2023-07-07T18:15:54.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.707+0000 7f035eb03700 1 -- 172.21.15.12:0/3280681404 wait complete. 2023-07-07T18:15:54.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:15:54.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.843+0000 7f67a99d7700 1 Processor -- start 2023-07-07T18:15:54.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.843+0000 7f67a99d7700 1 -- start start 2023-07-07T18:15:54.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a99d7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67a415c570 0x7f67a40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a99d7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a4160a50 0x7f67a40d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a99d7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a41610a0 con 0x7f67a40cd660 2023-07-07T18:15:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a99d7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a415d670 con 0x7f67a415c570 2023-07-07T18:15:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a99d7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4160eb0 con 0x7f67a4160a50 2023-07-07T18:15:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67a415c570 0x7f67a40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67a415c570 0x7f67a40cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58952/0 (socket says 172.21.15.12:58952) 2023-07-07T18:15:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a2ffd700 1 -- 172.21.15.12:0/2029212292 learned_addr learned my addr 172.21.15.12:0/2029212292 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:54.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a37fe700 1 --2- 172.21.15.12:0/2029212292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a4160a50 0x7f67a40d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a2ffd700 1 -- 172.21.15.12:0/2029212292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a4160a50 msgr2=0x7f67a40d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a2ffd700 1 --2- 172.21.15.12:0/2029212292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a4160a50 0x7f67a40d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a2ffd700 1 -- 172.21.15.12:0/2029212292 >> v1:172.21.15.160:6789/0 conn(0x7f67a40cd660 legacy=0x7f67a4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a2ffd700 1 -- 172.21.15.12:0/2029212292 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a415da90 con 0x7f67a415c570 2023-07-07T18:15:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a2ffd700 1 --2- 172.21.15.12:0/2029212292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 0x7f67a40cd120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6794009920 tx=0x7f6794009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca9f940c3b1c2a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:54.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.844+0000 7f67a1ffb700 1 -- 172.21.15.12:0/2029212292 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794004230 con 0x7f67a415c570 2023-07-07T18:15:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a1ffb700 1 -- 172.21.15.12:0/2029212292 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6794004390 con 0x7f67a415c570 2023-07-07T18:15:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a1ffb700 1 -- 172.21.15.12:0/2029212292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6794009e70 con 0x7f67a415c570 2023-07-07T18:15:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a99d7700 1 -- 172.21.15.12:0/2029212292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 msgr2=0x7f67a40cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a99d7700 1 --2- 172.21.15.12:0/2029212292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 0x7f67a40cd120 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6794009920 tx=0x7f6794009c30 comp rx=0 tx=0).stop 2023-07-07T18:15:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a99d7700 1 -- 172.21.15.12:0/2029212292 shutdown_connections 2023-07-07T18:15:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a99d7700 1 --2- 172.21.15.12:0/2029212292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a4160a50 0x7f67a40d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a99d7700 1 --2- 172.21.15.12:0/2029212292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 0x7f67a40cd120 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a99d7700 1 -- 172.21.15.12:0/2029212292 >> 172.21.15.12:0/2029212292 conn(0x7f67a4071620 msgr2=0x7f67a40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a99d7700 1 -- 172.21.15.12:0/2029212292 shutdown_connections 2023-07-07T18:15:54.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.845+0000 7f67a99d7700 1 -- 172.21.15.12:0/2029212292 wait complete. 2023-07-07T18:15:54.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.846+0000 7f67a99d7700 1 Processor -- start 2023-07-07T18:15:54.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a99d7700 1 -- start start 2023-07-07T18:15:54.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a99d7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a40cd660 0x7f67a4150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a99d7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 0x7f67a41588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a99d7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a4160a50 0x7f67a4158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a99d7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40c72b0 con 0x7f67a415c570 2023-07-07T18:15:54.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a99d7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4150b60 con 0x7f67a4160a50 2023-07-07T18:15:54.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a99d7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a40c66a0 con 0x7f67a40cd660 2023-07-07T18:15:54.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 0x7f67a41588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 0x7f67a41588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58960/0 (socket says 172.21.15.12:58960) 2023-07-07T18:15:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.847+0000 7f67a27fc700 1 -- 172.21.15.12:0/3026973969 learned_addr learned my addr 172.21.15.12:0/3026973969 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a2ffd700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a40cd660 0x7f67a4150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a37fe700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a4160a50 0x7f67a4158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a27fc700 1 -- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a40cd660 msgr2=0x7f67a4150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a27fc700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a40cd660 0x7f67a4150620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a27fc700 1 -- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a4160a50 msgr2=0x7f67a4158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:54.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a27fc700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a4160a50 0x7f67a4158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a27fc700 1 -- 172.21.15.12:0/3026973969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6794009550 con 0x7f67a415c570 2023-07-07T18:15:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a2ffd700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a40cd660 0x7f67a4150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a37fe700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a4160a50 0x7f67a4158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a27fc700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 0x7f67a41588c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f679800c4d0 tx=0x7f679800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f678bfff700 1 -- 172.21.15.12:0/3026973969 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798011790 con 0x7f67a415c570 2023-07-07T18:15:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f678bfff700 1 -- 172.21.15.12:0/3026973969 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67980118f0 con 0x7f67a415c570 2023-07-07T18:15:54.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f678bfff700 1 -- 172.21.15.12:0/3026973969 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798011ca0 con 0x7f67a415c570 2023-07-07T18:15:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a40c6980 con 0x7f67a415c570 2023-07-07T18:15:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.848+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a40c6f40 con 0x7f67a415c570 2023-07-07T18:15:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.849+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a4073910 con 0x7f67a415c570 2023-07-07T18:15:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.849+0000 7f678bfff700 1 -- 172.21.15.12:0/3026973969 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f679801c460 con 0x7f67a415c570 2023-07-07T18:15:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.850+0000 7f678bfff700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f679006ace0 0x7f679006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.850+0000 7f678bfff700 1 -- 172.21.15.12:0/3026973969 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6798089730 con 0x7f67a415c570 2023-07-07T18:15:54.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.850+0000 7f67a2ffd700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f679006ace0 0x7f679006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:54.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.851+0000 7f67a2ffd700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f679006ace0 0x7f679006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6794009870 tx=0x7f6794008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:54.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:54.854+0000 7f678bfff700 1 -- 172.21.15.12:0/3026973969 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6798054420 con 0x7f67a415c570 2023-07-07T18:15:55.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.098+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67a40b5360 con 0x7f67a415c570 2023-07-07T18:15:55.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.099+0000 7f678bfff700 1 -- 172.21.15.12:0/3026973969 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f6798057a40 con 0x7f67a415c570 2023-07-07T18:15:55.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:55.101 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:15:09.693432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-07T18:15:55.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f679006ace0 msgr2=0x7f679006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f679006ace0 0x7f679006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6794009870 tx=0x7f6794008030 comp rx=0 tx=0).stop 2023-07-07T18:15:55.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 msgr2=0x7f67a41588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 0x7f67a41588c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f679800c4d0 tx=0x7f679800c890 comp rx=0 tx=0).stop 2023-07-07T18:15:55.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 shutdown_connections 2023-07-07T18:15:55.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f679006ace0 0x7f679006d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a4160a50 0x7f67a4158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67a40cd660 0x7f67a4150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 --2- 172.21.15.12:0/3026973969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67a415c570 0x7f67a41588c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.101+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 >> 172.21.15.12:0/3026973969 conn(0x7f67a4071620 msgr2=0x7f67a40cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:55.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.102+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 shutdown_connections 2023-07-07T18:15:55.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.102+0000 7f67a99d7700 1 -- 172.21.15.12:0/3026973969 wait complete. 2023-07-07T18:15:55.106 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2023-07-07T18:15:55.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:55.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.238+0000 7f3c54b05700 1 Processor -- start 2023-07-07T18:15:55.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.238+0000 7f3c54b05700 1 -- start start 2023-07-07T18:15:55.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.239+0000 7f3c54b05700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3c5015a1e0 0x7f3c500aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.239+0000 7f3c54b05700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5015d6a0 con 0x7f3c500cddd0 2023-07-07T18:15:55.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.239+0000 7f3c54b05700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c50159700 con 0x7f3c500ae6c0 2023-07-07T18:15:55.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.239+0000 7f3c54b05700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c500cdc80 con 0x7f3c5015a1e0 2023-07-07T18:15:55.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.239+0000 7f3c4e59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3c500cddd0 0x7f3c500ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56164/0 (socket says 172.21.15.12:56164) 2023-07-07T18:15:55.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.239+0000 7f3c4e59c700 1 -- 172.21.15.12:0/3998994492 learned_addr learned my addr 172.21.15.12:0/3998994492 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:55.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4ed9d700 1 --2- 172.21.15.12:0/3998994492 >> v2:172.21.15.160:3300/0 conn(0x7f3c5015a1e0 0x7f3c500aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763464251 0 0) 0x7f3c5015d6a0 con 0x7f3c500cddd0 2023-07-07T18:15:55.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c3c0035b0 con 0x7f3c500cddd0 2023-07-07T18:15:55.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1504062817 0 0) 0x7f3c3c0035b0 con 0x7f3c500cddd0 2023-07-07T18:15:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 >> v2:172.21.15.160:3300/0 conn(0x7f3c5015a1e0 msgr2=0x7f3c500aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 --2- 172.21.15.12:0/3998994492 >> v2:172.21.15.160:3300/0 conn(0x7f3c5015a1e0 0x7f3c500aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 >> v1:172.21.15.160:6789/0 conn(0x7f3c500ae6c0 legacy=0x7f3c500714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c501599e0 con 0x7f3c500cddd0 2023-07-07T18:15:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f3c40001670 con 0x7f3c500cddd0 2023-07-07T18:15:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 >> v1:172.21.15.12:6789/0 conn(0x7f3c500cddd0 legacy=0x7f3c500ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c3c004850 0x7f3c3c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c3c005200 0x7f3c3c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c00c0e0 con 0x7f3c3c003a00 2023-07-07T18:15:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c00c250 con 0x7f3c3c004850 2023-07-07T18:15:55.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c00c410 con 0x7f3c3c005200 2023-07-07T18:15:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4e59c700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4dd9b700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c3c004850 0x7f3c3c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4ed9d700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c3c005200 0x7f3c3c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.240+0000 7f3c4e59c700 1 -- 172.21.15.12:0/3998994492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c3c005200 msgr2=0x7f3c3c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4e59c700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c3c005200 0x7f3c3c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4e59c700 1 -- 172.21.15.12:0/3998994492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c3c004850 msgr2=0x7f3c3c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4e59c700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c3c004850 0x7f3c3c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4e59c700 1 -- 172.21.15.12:0/3998994492 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c0035b0 con 0x7f3c3c003a00 2023-07-07T18:15:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4ed9d700 1 -- 172.21.15.12:0/3998994492 reap_dead start 2023-07-07T18:15:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4dd9b700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c3c004850 0x7f3c3c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4e59c700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c3c003e10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c240 tx=0x7f3c3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ec28954509475d server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40007c10 con 0x7f3c3c003a00 2023-07-07T18:15:55.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4000ce00 con 0x7f3c3c003a00 2023-07-07T18:15:55.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c4d59a700 1 -- 172.21.15.12:0/3998994492 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40005ba0 con 0x7f3c3c003a00 2023-07-07T18:15:55.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c54b05700 1 -- 172.21.15.12:0/3998994492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 msgr2=0x7f3c3c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c54b05700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c3c003e10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c240 tx=0x7f3c3c005880 comp rx=0 tx=0).stop 2023-07-07T18:15:55.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c54b05700 1 -- 172.21.15.12:0/3998994492 shutdown_connections 2023-07-07T18:15:55.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c54b05700 1 --2- 172.21.15.12:0/3998994492 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c3c003e10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.241+0000 7f3c54b05700 1 -- 172.21.15.12:0/3998994492 >> 172.21.15.12:0/3998994492 conn(0x7f3c5006d4a0 msgr2=0x7f3c5006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:55.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.242+0000 7f3c54b05700 1 -- 172.21.15.12:0/3998994492 shutdown_connections 2023-07-07T18:15:55.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.242+0000 7f3c54b05700 1 -- 172.21.15.12:0/3998994492 wait complete. 2023-07-07T18:15:55.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.243+0000 7f3c54b05700 1 Processor -- start 2023-07-07T18:15:55.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.243+0000 7f3c54b05700 1 -- start start 2023-07-07T18:15:55.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c54b05700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c500b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c54b05700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c501540c0 0x7f3c500c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c54b05700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c500c5eb0 0x7f3c500c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c54b05700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c50155100 con 0x7f3c3c003a00 2023-07-07T18:15:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c54b05700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500cae40 con 0x7f3c501540c0 2023-07-07T18:15:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c54b05700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500cb120 con 0x7f3c500c5eb0 2023-07-07T18:15:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c500b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c500b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58976/0 (socket says 172.21.15.12:58976) 2023-07-07T18:15:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4e59c700 1 -- 172.21.15.12:0/3304935777 learned_addr learned my addr 172.21.15.12:0/3304935777 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:55.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4ed9d700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c500c5eb0 0x7f3c500c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4dd9b700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c501540c0 0x7f3c500c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4e59c700 1 -- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c500c5eb0 msgr2=0x7f3c500c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4e59c700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c500c5eb0 0x7f3c500c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4e59c700 1 -- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c501540c0 msgr2=0x7f3c500c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4e59c700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c501540c0 0x7f3c500c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4e59c700 1 -- 172.21.15.12:0/3304935777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c500cb400 con 0x7f3c3c003a00 2023-07-07T18:15:55.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4ed9d700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c500c5eb0 0x7f3c500c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4dd9b700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c501540c0 0x7f3c500c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c4e59c700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c500b2610 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c220 tx=0x7f3c40001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c46ffd700 1 -- 172.21.15.12:0/3304935777 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40001630 con 0x7f3c3c003a00 2023-07-07T18:15:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.244+0000 7f3c46ffd700 1 -- 172.21.15.12:0/3304935777 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400070d0 con 0x7f3c3c003a00 2023-07-07T18:15:55.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.245+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c500cb6e0 con 0x7f3c3c003a00 2023-07-07T18:15:55.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.245+0000 7f3c46ffd700 1 -- 172.21.15.12:0/3304935777 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40007460 con 0x7f3c3c003a00 2023-07-07T18:15:55.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.245+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c500cab10 con 0x7f3c3c003a00 2023-07-07T18:15:55.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.245+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c500cbd30 con 0x7f3c3c003a00 2023-07-07T18:15:55.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.246+0000 7f3c46ffd700 1 -- 172.21.15.12:0/3304935777 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c400075c0 con 0x7f3c3c003a00 2023-07-07T18:15:55.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.246+0000 7f3c46ffd700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3c3006ace0 0x7f3c3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.246+0000 7f3c46ffd700 1 -- 172.21.15.12:0/3304935777 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3c4008aa80 con 0x7f3c3c003a00 2023-07-07T18:15:55.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.247+0000 7f3c4dd9b700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3c3006ace0 0x7f3c3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.247+0000 7f3c4dd9b700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3c3006ace0 0x7f3c3006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3c38000c00 tx=0x7f3c38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:55.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.251+0000 7f3c46ffd700 1 -- 172.21.15.12:0/3304935777 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c40055810 con 0x7f3c3c003a00 2023-07-07T18:15:55.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.448+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c50155100 con 0x7f3c3c003a00 2023-07-07T18:15:55.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.450+0000 7f3c46ffd700 1 -- 172.21.15.12:0/3304935777 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7f3c40058e30 con 0x7f3c3c003a00 2023-07-07T18:15:55.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:55.452 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3c3006ace0 msgr2=0x7f3c3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3c3006ace0 0x7f3c3006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3c38000c00 tx=0x7f3c38009040 comp rx=0 tx=0).stop 2023-07-07T18:15:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 msgr2=0x7f3c500b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c500b2610 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c220 tx=0x7f3c40001a00 comp rx=0 tx=0).stop 2023-07-07T18:15:55.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 shutdown_connections 2023-07-07T18:15:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f3c3006ace0 0x7f3c3006d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c500c5eb0 0x7f3c500c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3c3c003a00 0x7f3c500b2610 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 --2- 172.21.15.12:0/3304935777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c501540c0 0x7f3c500c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 >> 172.21.15.12:0/3304935777 conn(0x7f3c5006d4a0 msgr2=0x7f3c501570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 shutdown_connections 2023-07-07T18:15:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.452+0000 7f3c54b05700 1 -- 172.21.15.12:0/3304935777 wait complete. 2023-07-07T18:15:55.466 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-07T18:15:55.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:15:55.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.589+0000 7f2cf1bb5700 1 Processor -- start 2023-07-07T18:15:55.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.589+0000 7f2cf1bb5700 1 -- start start 2023-07-07T18:15:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.590+0000 7f2cf1bb5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec156880 0x7f2cec069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.590+0000 7f2cf1bb5700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec0cee80 con 0x7f2cec0cc1d0 2023-07-07T18:15:55.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.590+0000 7f2cf1bb5700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec0cf100 con 0x7f2cec0aed30 2023-07-07T18:15:55.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.590+0000 7f2cf1bb5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0cf3e0 con 0x7f2cec156880 2023-07-07T18:15:55.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.590+0000 7f2cebfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2cec0cc1d0 0x7f2cec15cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56186/0 (socket says 172.21.15.12:56186) 2023-07-07T18:15:55.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.590+0000 7f2cebfff700 1 -- 172.21.15.12:0/2492469911 learned_addr learned my addr 172.21.15.12:0/2492469911 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:55.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.590+0000 7f2ceb7fe700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec156880 0x7f2cec069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.590+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649392732 0 0) 0x7f2cec0cee80 con 0x7f2cec0cc1d0 2023-07-07T18:15:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.590+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd40035b0 con 0x7f2cec0cc1d0 2023-07-07T18:15:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509245124 0 0) 0x7f2cec0cf100 con 0x7f2cec0aed30 2023-07-07T18:15:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cec0cee80 con 0x7f2cec0aed30 2023-07-07T18:15:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2661925895 0 0) 0x7f2cd40035b0 con 0x7f2cec0cc1d0 2023-07-07T18:15:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec156880 msgr2=0x7f2cec069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec156880 0x7f2cec069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 >> v1:172.21.15.160:6789/0 conn(0x7f2cec0aed30 legacy=0x7f2cec160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec0cd390 con 0x7f2cec0cc1d0 2023-07-07T18:15:55.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f2ce40019f0 con 0x7f2cec0cc1d0 2023-07-07T18:15:55.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 >> v1:172.21.15.12:6789/0 conn(0x7f2cec0cc1d0 legacy=0x7f2cec15cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cd4003bc0 0x7f2cd4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec156880 0x7f2cd4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cd4004d90 0x7f2cd4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec0cf3e0 con 0x7f2cd4003bc0 2023-07-07T18:15:55.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd400bac0 con 0x7f2cd4004d90 2023-07-07T18:15:55.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd400bc30 con 0x7f2cec156880 2023-07-07T18:15:55.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2ceb7fe700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cd4003bc0 0x7f2cd4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2ceaffd700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec156880 0x7f2cd4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cebfff700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cd4004d90 0x7f2cd4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2ceb7fe700 1 -- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec156880 msgr2=0x7f2cd4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:55.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2ceb7fe700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec156880 0x7f2cd4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2ceb7fe700 1 -- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cd4004d90 msgr2=0x7f2cd4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2ceb7fe700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cd4004d90 0x7f2cd4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2ceb7fe700 1 -- 172.21.15.12:0/2492469911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40035b0 con 0x7f2cd4003bc0 2023-07-07T18:15:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2cebfff700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cd4004d90 0x7f2cd4005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.591+0000 7f2ceb7fe700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cd4003bc0 0x7f2cd4003fb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009b60 tx=0x7f2cd4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b62cf6d5ab758ac server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc00e660 con 0x7f2cd4003bc0 2023-07-07T18:15:55.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc00e7c0 con 0x7f2cd4003bc0 2023-07-07T18:15:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cea7fc700 1 -- 172.21.15.12:0/2492469911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc00eb30 con 0x7f2cd4003bc0 2023-07-07T18:15:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/2492469911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cd4003bc0 msgr2=0x7f2cd4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cf1bb5700 1 --2- 172.21.15.12:0/2492469911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cd4003bc0 0x7f2cd4003fb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009b60 tx=0x7f2cd4005880 comp rx=0 tx=0).stop 2023-07-07T18:15:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cebfff700 1 -- 172.21.15.12:0/2492469911 reap_dead start 2023-07-07T18:15:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/2492469911 shutdown_connections 2023-07-07T18:15:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/2492469911 >> 172.21.15.12:0/2492469911 conn(0x7f2cec06d4a0 msgr2=0x7f2cec06d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:55.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/2492469911 shutdown_connections 2023-07-07T18:15:55.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.592+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/2492469911 wait complete. 2023-07-07T18:15:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.593+0000 7f2cf1bb5700 1 Processor -- start 2023-07-07T18:15:55.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.594+0000 7f2cf1bb5700 1 -- start start 2023-07-07T18:15:55.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.594+0000 7f2cf1bb5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec14eb20 0x7f2cec153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.594+0000 7f2cf1bb5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec14eef0 0x7f2cec0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.594+0000 7f2cf1bb5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cec154910 0x7f2cec06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.594+0000 7f2cf1bb5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec153960 con 0x7f2cec154910 2023-07-07T18:15:55.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.594+0000 7f2cf1bb5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec153b50 con 0x7f2cec14eb20 2023-07-07T18:15:55.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.594+0000 7f2cf1bb5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec153e30 con 0x7f2cec14eef0 2023-07-07T18:15:55.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.594+0000 7f2cebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cec154910 0x7f2cec06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cec154910 0x7f2cec06a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59000/0 (socket says 172.21.15.12:59000) 2023-07-07T18:15:55.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cebfff700 1 -- 172.21.15.12:0/3401842350 learned_addr learned my addr 172.21.15.12:0/3401842350 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:55.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2ceaffd700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec14eef0 0x7f2cec0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2ceb7fe700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec14eb20 0x7f2cec153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cebfff700 1 -- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec14eef0 msgr2=0x7f2cec0b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cebfff700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec14eef0 0x7f2cec0b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cebfff700 1 -- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec14eb20 msgr2=0x7f2cec153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cebfff700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec14eb20 0x7f2cec153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cebfff700 1 -- 172.21.15.12:0/3401842350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec154110 con 0x7f2cec154910 2023-07-07T18:15:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cebfff700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cec154910 0x7f2cec06a890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4000f80 tx=0x7f2ce4007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:55.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cd3fff700 1 -- 172.21.15.12:0/3401842350 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400ebc0 con 0x7f2cec154910 2023-07-07T18:15:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cd3fff700 1 -- 172.21.15.12:0/3401842350 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce400ed20 con 0x7f2cec154910 2023-07-07T18:15:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec1543f0 con 0x7f2cec154910 2023-07-07T18:15:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cd3fff700 1 -- 172.21.15.12:0/3401842350 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4013660 con 0x7f2cec154910 2023-07-07T18:15:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.595+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec154d80 con 0x7f2cec154910 2023-07-07T18:15:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.596+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec1545e0 con 0x7f2cec154910 2023-07-07T18:15:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.597+0000 7f2cd3fff700 1 -- 172.21.15.12:0/3401842350 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2ce40137c0 con 0x7f2cec154910 2023-07-07T18:15:55.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.597+0000 7f2cd3fff700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2cd806ace0 0x7f2cd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.597+0000 7f2cd3fff700 1 -- 172.21.15.12:0/3401842350 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2ce4089bc0 con 0x7f2cec154910 2023-07-07T18:15:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.597+0000 7f2ceb7fe700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2cd806ace0 0x7f2cd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.598+0000 7f2ceb7fe700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2cd806ace0 0x7f2cd806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2cec04fa50 tx=0x7f2cdc01f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:55.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.601+0000 7f2cd3fff700 1 -- 172.21.15.12:0/3401842350 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2ce40549d0 con 0x7f2cec154910 2023-07-07T18:15:55.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.844+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cec073910 con 0x7f2cec154910 2023-07-07T18:15:55.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.844+0000 7f2cd3fff700 1 -- 172.21.15.12:0/3401842350 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7f2ce4057ff0 con 0x7f2cec154910 2023-07-07T18:15:55.846 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:55.847 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:15:09.693432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-07T18:15:55.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2cd806ace0 msgr2=0x7f2cd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2cd806ace0 0x7f2cd806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2cec04fa50 tx=0x7f2cdc01f040 comp rx=0 tx=0).stop 2023-07-07T18:15:55.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cec154910 msgr2=0x7f2cec06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cec154910 0x7f2cec06a890 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4000f80 tx=0x7f2ce4007c90 comp rx=0 tx=0).stop 2023-07-07T18:15:55.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 shutdown_connections 2023-07-07T18:15:55.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f2cd806ace0 0x7f2cd806d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2cec154910 0x7f2cec06a890 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cec14eb20 0x7f2cec153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 --2- 172.21.15.12:0/3401842350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cec14eef0 0x7f2cec0b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.846+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 >> 172.21.15.12:0/3401842350 conn(0x7f2cec06d4a0 msgr2=0x7f2cec15ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:55.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.847+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 shutdown_connections 2023-07-07T18:15:55.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.847+0000 7f2cf1bb5700 1 -- 172.21.15.12:0/3401842350 wait complete. 2023-07-07T18:15:55.850 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2023-07-07T18:15:55.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:15:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.983+0000 7fa2a99d5700 1 Processor -- start 2023-07-07T18:15:55.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.983+0000 7fa2a99d5700 1 -- start start 2023-07-07T18:15:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a99d5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2a415c570 0x7fa2a40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a99d5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa2a40cd660 0x7fa2a4160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a99d5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 0x7fa2a406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a99d5700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a415d670 con 0x7fa2a415c570 2023-07-07T18:15:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a99d5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a40cdae0 con 0x7fa2a40cd660 2023-07-07T18:15:55.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a99d5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a41610a0 con 0x7fa2a4160880 2023-07-07T18:15:55.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2a415c570 0x7fa2a40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2a415c570 0x7fa2a40cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59004/0 (socket says 172.21.15.12:59004) 2023-07-07T18:15:55.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a2ffd700 1 -- 172.21.15.12:0/3292279657 learned_addr learned my addr 172.21.15.12:0/3292279657 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:55.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a27fc700 1 --2- 172.21.15.12:0/3292279657 >> v2:172.21.15.160:3300/0 conn(0x7fa2a40cd660 0x7fa2a4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a2ffd700 1 -- 172.21.15.12:0/3292279657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 msgr2=0x7fa2a406b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:55.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a37fe700 1 --2- 172.21.15.12:0/3292279657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 0x7fa2a406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a2ffd700 1 --2- 172.21.15.12:0/3292279657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 0x7fa2a406b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a2ffd700 1 -- 172.21.15.12:0/3292279657 >> v2:172.21.15.160:3300/0 conn(0x7fa2a40cd660 msgr2=0x7fa2a4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:55.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a2ffd700 1 --2- 172.21.15.12:0/3292279657 >> v2:172.21.15.160:3300/0 conn(0x7fa2a40cd660 0x7fa2a4160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.984+0000 7fa2a2ffd700 1 -- 172.21.15.12:0/3292279657 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a415da90 con 0x7fa2a415c570 2023-07-07T18:15:55.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a2ffd700 1 --2- 172.21.15.12:0/3292279657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a415c570 0x7fa2a40cd120 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa2a408bc50 tx=0x7fa298009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9ed7842c35eb8c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:55.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a1ffb700 1 -- 172.21.15.12:0/3292279657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800b870 con 0x7fa2a415c570 2023-07-07T18:15:55.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a1ffb700 1 -- 172.21.15.12:0/3292279657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29800b9d0 con 0x7fa2a415c570 2023-07-07T18:15:55.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a1ffb700 1 -- 172.21.15.12:0/3292279657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800bd60 con 0x7fa2a415c570 2023-07-07T18:15:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a99d5700 1 -- 172.21.15.12:0/3292279657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a415c570 msgr2=0x7fa2a40cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/3292279657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a415c570 0x7fa2a40cd120 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa2a408bc50 tx=0x7fa298009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a99d5700 1 -- 172.21.15.12:0/3292279657 shutdown_connections 2023-07-07T18:15:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/3292279657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 0x7fa2a406b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/3292279657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a415c570 0x7fa2a40cd120 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/3292279657 >> v2:172.21.15.160:3300/0 conn(0x7fa2a40cd660 0x7fa2a4160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a99d5700 1 -- 172.21.15.12:0/3292279657 >> 172.21.15.12:0/3292279657 conn(0x7fa2a4071620 msgr2=0x7fa2a40719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:55.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.985+0000 7fa2a99d5700 1 -- 172.21.15.12:0/3292279657 shutdown_connections 2023-07-07T18:15:55.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.986+0000 7fa2a99d5700 1 -- 172.21.15.12:0/3292279657 wait complete. 2023-07-07T18:15:55.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.987+0000 7fa2a99d5700 1 Processor -- start 2023-07-07T18:15:55.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.987+0000 7fa2a99d5700 1 -- start start 2023-07-07T18:15:55.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a99d5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a40cd660 0x7fa2a40c9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a99d5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a415c570 0x7fa2a40cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a99d5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 0x7fa2a414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a99d5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a4150a70 con 0x7fa2a40cd660 2023-07-07T18:15:55.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a99d5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40c6730 con 0x7fa2a415c570 2023-07-07T18:15:55.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a99d5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a40caab0 con 0x7fa2a4160880 2023-07-07T18:15:55.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a40cd660 0x7fa2a40c9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a40cd660 0x7fa2a40c9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59008/0 (socket says 172.21.15.12:59008) 2023-07-07T18:15:55.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a2ffd700 1 -- 172.21.15.12:0/1967899501 learned_addr learned my addr 172.21.15.12:0/1967899501 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:55.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a37fe700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 0x7fa2a414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a27fc700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a415c570 0x7fa2a40cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a2ffd700 1 -- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 msgr2=0x7fa2a414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a2ffd700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 0x7fa2a414fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a2ffd700 1 -- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a415c570 msgr2=0x7fa2a40cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:55.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a2ffd700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a415c570 0x7fa2a40cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:55.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a2ffd700 1 -- 172.21.15.12:0/1967899501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298009550 con 0x7fa2a40cd660 2023-07-07T18:15:55.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a37fe700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 0x7fa2a414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:55.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a2ffd700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a40cd660 0x7fa2a40c9ba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40d0170 tx=0x7fa298004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:55.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa28bfff700 1 -- 172.21.15.12:0/1967899501 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980128c0 con 0x7fa2a40cd660 2023-07-07T18:15:55.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa28bfff700 1 -- 172.21.15.12:0/1967899501 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29801e070 con 0x7fa2a40cd660 2023-07-07T18:15:55.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a40ca210 con 0x7fa2a40cd660 2023-07-07T18:15:55.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.988+0000 7fa28bfff700 1 -- 172.21.15.12:0/1967899501 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298012c40 con 0x7fa2a40cd660 2023-07-07T18:15:55.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.989+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a40ca7d0 con 0x7fa2a40cd660 2023-07-07T18:15:55.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.989+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a4073910 con 0x7fa2a40cd660 2023-07-07T18:15:55.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.990+0000 7fa28bfff700 1 -- 172.21.15.12:0/1967899501 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa29801a420 con 0x7fa2a40cd660 2023-07-07T18:15:55.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.990+0000 7fa28bfff700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa29006ace0 0x7fa29006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:55.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.990+0000 7fa28bfff700 1 -- 172.21.15.12:0/1967899501 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa29808aad0 con 0x7fa2a40cd660 2023-07-07T18:15:55.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.990+0000 7fa2a27fc700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa29006ace0 0x7fa29006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:55.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.991+0000 7fa2a27fc700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa29006ace0 0x7fa29006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40cb360 tx=0x7fa294008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:55.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:55.995+0000 7fa28bfff700 1 -- 172.21.15.12:0/1967899501 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa2980557c0 con 0x7fa2a40cd660 2023-07-07T18:15:56.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.236+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2a40c5fe0 con 0x7fa2a40cd660 2023-07-07T18:15:56.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.236+0000 7fa28bfff700 1 -- 172.21.15.12:0/1967899501 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4673 (secure 0 0 0) 0x7fa298058de0 con 0x7fa2a40cd660 2023-07-07T18:15:56.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:56.239 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1661556264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1661556264},{"type":"v1","addr":"172.21.15.12:6835","nonce":1661556264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1120202126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1120202126},{"type":"v1","addr":"172.21.15.12:6834","nonce":1120202126}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/2220071848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2220071848},{"type":"v1","addr":"172.21.15.160:6836","nonce":2220071848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:14:46.226517+0000","modified":"2023-07-07T18:15:09.693432+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/3361031905","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3361031905},{"type":"v1","addr":"172.21.15.160:6837","nonce":3361031905}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-07T18:15:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa29006ace0 msgr2=0x7fa29006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa29006ace0 0x7fa29006d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40cb360 tx=0x7fa294008040 comp rx=0 tx=0).stop 2023-07-07T18:15:56.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a40cd660 msgr2=0x7fa2a40c9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a40cd660 0x7fa2a40c9ba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40d0170 tx=0x7fa298004750 comp rx=0 tx=0).stop 2023-07-07T18:15:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 shutdown_connections 2023-07-07T18:15:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa29006ace0 0x7fa29006d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a4160880 0x7fa2a414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2a40cd660 0x7fa2a40c9ba0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 --2- 172.21.15.12:0/1967899501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a415c570 0x7fa2a40cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 >> 172.21.15.12:0/1967899501 conn(0x7fa2a4071620 msgr2=0x7fa2a40d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:56.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 shutdown_connections 2023-07-07T18:15:56.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.239+0000 7fa2a99d5700 1 -- 172.21.15.12:0/1967899501 wait complete. 2023-07-07T18:15:56.243 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2023-07-07T18:15:56.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:15:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.375+0000 7fa84dc6a700 1 Processor -- start 2023-07-07T18:15:56.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.376+0000 7fa84dc6a700 1 -- start start 2023-07-07T18:15:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.376+0000 7fa84dc6a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa84806bab0 0x7fa8480b2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.376+0000 7fa84dc6a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa84806a9d0 0x7fa8480b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.376+0000 7fa84dc6a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8480cc9e0 con 0x7fa848069ef0 2023-07-07T18:15:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.376+0000 7fa84dc6a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480b5780 con 0x7fa84806bab0 2023-07-07T18:15:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.376+0000 7fa84dc6a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8480c9f40 con 0x7fa84806a9d0 2023-07-07T18:15:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.376+0000 7fa846ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa84806bab0 0x7fa8480b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.376+0000 7fa846ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa84806bab0 0x7fa8480b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59018/0 (socket says 172.21.15.12:59018) 2023-07-07T18:15:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa846ffd700 1 -- 172.21.15.12:0/214841677 learned_addr learned my addr 172.21.15.12:0/214841677 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa847fff700 1 --2- 172.21.15.12:0/214841677 >> v2:172.21.15.160:3300/0 conn(0x7fa84806a9d0 0x7fa8480b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa846ffd700 1 -- 172.21.15.12:0/214841677 >> v2:172.21.15.160:3300/0 conn(0x7fa84806a9d0 msgr2=0x7fa8480b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa846ffd700 1 --2- 172.21.15.12:0/214841677 >> v2:172.21.15.160:3300/0 conn(0x7fa84806a9d0 0x7fa8480b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa846ffd700 1 -- 172.21.15.12:0/214841677 >> v1:172.21.15.160:6789/0 conn(0x7fa848069ef0 legacy=0x7fa84806a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa846ffd700 1 -- 172.21.15.12:0/214841677 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480cc390 con 0x7fa84806bab0 2023-07-07T18:15:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa847fff700 1 --2- 172.21.15.12:0/214841677 >> v2:172.21.15.160:3300/0 conn(0x7fa84806a9d0 0x7fa8480b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa846ffd700 1 --2- 172.21.15.12:0/214841677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa84806bab0 0x7fa8480b2710 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa8480af1f0 tx=0x7fa83c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a00cb37ac442be server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa8467fc700 1 -- 172.21.15.12:0/214841677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c004230 con 0x7fa84806bab0 2023-07-07T18:15:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa8467fc700 1 -- 172.21.15.12:0/214841677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c004390 con 0x7fa84806bab0 2023-07-07T18:15:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.377+0000 7fa8467fc700 1 -- 172.21.15.12:0/214841677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0036a0 con 0x7fa84806bab0 2023-07-07T18:15:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.378+0000 7fa84dc6a700 1 -- 172.21.15.12:0/214841677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa84806bab0 msgr2=0x7fa8480b2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.378+0000 7fa84dc6a700 1 --2- 172.21.15.12:0/214841677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa84806bab0 0x7fa8480b2710 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa8480af1f0 tx=0x7fa83c009bd0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.378+0000 7fa84dc6a700 1 -- 172.21.15.12:0/214841677 shutdown_connections 2023-07-07T18:15:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.378+0000 7fa84dc6a700 1 --2- 172.21.15.12:0/214841677 >> v2:172.21.15.160:3300/0 conn(0x7fa84806a9d0 0x7fa8480b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.378+0000 7fa84dc6a700 1 --2- 172.21.15.12:0/214841677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa84806bab0 0x7fa8480b2710 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.378+0000 7fa84dc6a700 1 -- 172.21.15.12:0/214841677 >> 172.21.15.12:0/214841677 conn(0x7fa84806d4a0 msgr2=0x7fa84806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.378+0000 7fa84dc6a700 1 -- 172.21.15.12:0/214841677 shutdown_connections 2023-07-07T18:15:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.378+0000 7fa84dc6a700 1 -- 172.21.15.12:0/214841677 wait complete. 2023-07-07T18:15:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.379+0000 7fa84dc6a700 1 Processor -- start 2023-07-07T18:15:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.379+0000 7fa84dc6a700 1 -- start start 2023-07-07T18:15:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa84dc6a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa848069ef0 0x7fa84815cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa84dc6a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa84806a9d0 0x7fa8480c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa84dc6a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa84806bab0 0x7fa848156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa84dc6a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c56f0 con 0x7fa848069ef0 2023-07-07T18:15:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa84dc6a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c60c0 con 0x7fa84806a9d0 2023-07-07T18:15:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa84dc6a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8480c4ae0 con 0x7fa84806bab0 2023-07-07T18:15:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa8477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa848069ef0 0x7fa84815cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa8477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa848069ef0 0x7fa84815cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59022/0 (socket says 172.21.15.12:59022) 2023-07-07T18:15:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa8477fe700 1 -- 172.21.15.12:0/79187014 learned_addr learned my addr 172.21.15.12:0/79187014 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa847fff700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa84806bab0 0x7fa848156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa846ffd700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa84806a9d0 0x7fa8480c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa8477fe700 1 -- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa84806bab0 msgr2=0x7fa848156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa8477fe700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa84806bab0 0x7fa848156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa8477fe700 1 -- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa84806a9d0 msgr2=0x7fa8480c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa8477fe700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa84806a9d0 0x7fa8480c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa8477fe700 1 -- 172.21.15.12:0/79187014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c009550 con 0x7fa848069ef0 2023-07-07T18:15:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa847fff700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa84806bab0 0x7fa848156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.380+0000 7fa8477fe700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa848069ef0 0x7fa84815cd50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa83800b470 tx=0x7fa83800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.381+0000 7fa82ffff700 1 -- 172.21.15.12:0/79187014 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838011830 con 0x7fa848069ef0 2023-07-07T18:15:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.381+0000 7fa82ffff700 1 -- 172.21.15.12:0/79187014 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8380119b0 con 0x7fa848069ef0 2023-07-07T18:15:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.381+0000 7fa82ffff700 1 -- 172.21.15.12:0/79187014 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838011d60 con 0x7fa848069ef0 2023-07-07T18:15:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.381+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8480c4dc0 con 0x7fa848069ef0 2023-07-07T18:15:56.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.381+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8480c5380 con 0x7fa848069ef0 2023-07-07T18:15:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.382+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa848073910 con 0x7fa848069ef0 2023-07-07T18:15:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.382+0000 7fa82ffff700 1 -- 172.21.15.12:0/79187014 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa83801a400 con 0x7fa848069ef0 2023-07-07T18:15:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.382+0000 7fa82ffff700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa83406ace0 0x7fa83406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.383+0000 7fa82ffff700 1 -- 172.21.15.12:0/79187014 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa8380897a0 con 0x7fa848069ef0 2023-07-07T18:15:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.383+0000 7fa846ffd700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa83406ace0 0x7fa83406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.383+0000 7fa846ffd700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa83406ace0 0x7fa83406d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009130 tx=0x7fa83c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:56.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.387+0000 7fa82ffff700 1 -- 172.21.15.12:0/79187014 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa838054520 con 0x7fa848069ef0 2023-07-07T18:15:56.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.584+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8480b4df0 con 0x7fa848069ef0 2023-07-07T18:15:56.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.585+0000 7fa82ffff700 1 -- 172.21.15.12:0/79187014 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+20215 (secure 0 0 0) 0x7fa838057b40 con 0x7fa848069ef0 2023-07-07T18:15:56.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:15:56.588 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:15:27.761270+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:14:43.914969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-07T18:14:45.200432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-07T18:14:48.275636+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:15:56.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa83406ace0 msgr2=0x7fa83406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa83406ace0 0x7fa83406d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009130 tx=0x7fa83c008030 comp rx=0 tx=0).stop 2023-07-07T18:15:56.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa848069ef0 msgr2=0x7fa84815cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa848069ef0 0x7fa84815cd50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa83800b470 tx=0x7fa83800b780 comp rx=0 tx=0).stop 2023-07-07T18:15:56.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 shutdown_connections 2023-07-07T18:15:56.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa83406ace0 0x7fa83406d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa84806bab0 0x7fa848156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa848069ef0 0x7fa84815cd50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 --2- 172.21.15.12:0/79187014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa84806a9d0 0x7fa8480c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 >> 172.21.15.12:0/79187014 conn(0x7fa84806d4a0 msgr2=0x7fa8480b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:56.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 shutdown_connections 2023-07-07T18:15:56.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.587+0000 7fa84dc6a700 1 -- 172.21.15.12:0/79187014 wait complete. 2023-07-07T18:15:56.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-07T18:15:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.725+0000 7f38bc513700 1 Processor -- start 2023-07-07T18:15:56.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.725+0000 7f38bc513700 1 -- start start 2023-07-07T18:15:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.726+0000 7f38bc513700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38b4069ef0 0x7f38b406a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.726+0000 7f38bc513700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b40cc9e0 con 0x7f38b406bab0 2023-07-07T18:15:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.726+0000 7f38bc513700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b40b5780 con 0x7f38b40b3720 2023-07-07T18:15:56.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.726+0000 7f38bc513700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b406fd10 con 0x7f38b4069ef0 2023-07-07T18:15:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.726+0000 7f38b9aae700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f38b406bab0 0x7f38b406eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56228/0 (socket says 172.21.15.12:56228) 2023-07-07T18:15:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.726+0000 7f38b9aae700 1 -- 172.21.15.12:0/2001380406 learned_addr learned my addr 172.21.15.12:0/2001380406 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.726+0000 7f38ba2af700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38b4069ef0 0x7f38b406a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980718207 0 0) 0x7f38b40cc9e0 con 0x7f38b406bab0 2023-07-07T18:15:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38a00035b0 con 0x7f38b406bab0 2023-07-07T18:15:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032021734 0 0) 0x7f38b40b5780 con 0x7f38b40b3720 2023-07-07T18:15:56.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b40cc9e0 con 0x7f38b40b3720 2023-07-07T18:15:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 963691205 0 0) 0x7f38a00035b0 con 0x7f38b406bab0 2023-07-07T18:15:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38b4069ef0 msgr2=0x7f38b406a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38b4069ef0 0x7f38b406a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 >> v1:172.21.15.160:6789/0 conn(0x7f38b40b3720 legacy=0x7f38b406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b40c9f40 con 0x7f38b406bab0 2023-07-07T18:15:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f38b0001670 con 0x7f38b406bab0 2023-07-07T18:15:56.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 >> v1:172.21.15.12:6789/0 conn(0x7f38b406bab0 legacy=0x7f38b406eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a0003bc0 0x7f38a0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38b4069ef0 0x7f38a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38a0004d90 0x7f38a0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b406fd10 con 0x7f38a0003bc0 2023-07-07T18:15:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a000bba0 con 0x7f38a0004d90 2023-07-07T18:15:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a000bd10 con 0x7f38b4069ef0 2023-07-07T18:15:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38ba2af700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a0003bc0 0x7f38a0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38b9aae700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38b4069ef0 0x7f38a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38baab0700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38a0004d90 0x7f38a0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38ba2af700 1 -- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38b4069ef0 msgr2=0x7f38a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38ba2af700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38b4069ef0 0x7f38a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38ba2af700 1 -- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38a0004d90 msgr2=0x7f38a0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:56.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38ba2af700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38a0004d90 0x7f38a0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.727+0000 7f38ba2af700 1 -- 172.21.15.12:0/2001380406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00035b0 con 0x7f38a0003bc0 2023-07-07T18:15:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38ba2af700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a0003bc0 0x7f38a0003fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009b30 tx=0x7f38a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a98ee6af25ecf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a400e6c0 con 0x7f38a0003bc0 2023-07-07T18:15:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a400e820 con 0x7f38a0003bc0 2023-07-07T18:15:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38b92ad700 1 -- 172.21.15.12:0/2001380406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a400eb90 con 0x7f38a0003bc0 2023-07-07T18:15:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38bc513700 1 -- 172.21.15.12:0/2001380406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a0003bc0 msgr2=0x7f38a0003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38bc513700 1 --2- 172.21.15.12:0/2001380406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a0003bc0 0x7f38a0003fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009b30 tx=0x7f38a0005880 comp rx=0 tx=0).stop 2023-07-07T18:15:56.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38baab0700 1 -- 172.21.15.12:0/2001380406 reap_dead start 2023-07-07T18:15:56.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38bc513700 1 -- 172.21.15.12:0/2001380406 shutdown_connections 2023-07-07T18:15:56.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38bc513700 1 -- 172.21.15.12:0/2001380406 >> 172.21.15.12:0/2001380406 conn(0x7f38b406d4a0 msgr2=0x7f38b406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:56.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38bc513700 1 -- 172.21.15.12:0/2001380406 shutdown_connections 2023-07-07T18:15:56.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.728+0000 7f38bc513700 1 -- 172.21.15.12:0/2001380406 wait complete. 2023-07-07T18:15:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.730+0000 7f38bc513700 1 Processor -- start 2023-07-07T18:15:56.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.730+0000 7f38bc513700 1 -- start start 2023-07-07T18:15:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.730+0000 7f38bc513700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a0003bc0 0x7f38b4153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.730+0000 7f38bc513700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38b40cefd0 0x7f38b415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.730+0000 7f38bc513700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38b415b360 0x7f38b415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.730+0000 7f38bc513700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b415d4e0 con 0x7f38b415b360 2023-07-07T18:15:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.730+0000 7f38bc513700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b415d200 con 0x7f38b40cefd0 2023-07-07T18:15:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.730+0000 7f38bc513700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b415a880 con 0x7f38a0003bc0 2023-07-07T18:15:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38baab0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38b415b360 0x7f38b415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38baab0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38b415b360 0x7f38b415b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59046/0 (socket says 172.21.15.12:59046) 2023-07-07T18:15:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38baab0700 1 -- 172.21.15.12:0/2049565257 learned_addr learned my addr 172.21.15.12:0/2049565257 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38b9aae700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38b40cefd0 0x7f38b415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38ba2af700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a0003bc0 0x7f38b4153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38baab0700 1 -- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a0003bc0 msgr2=0x7f38b4153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38baab0700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a0003bc0 0x7f38b4153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38baab0700 1 -- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38b40cefd0 msgr2=0x7f38b415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:56.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38baab0700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38b40cefd0 0x7f38b415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38baab0700 1 -- 172.21.15.12:0/2049565257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b415ab60 con 0x7f38b415b360 2023-07-07T18:15:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38b9aae700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38b40cefd0 0x7f38b415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38ba2af700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a0003bc0 0x7f38b4153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38baab0700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38b415b360 0x7f38b415b7d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f38b40b3af0 tx=0x7f38ac00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38aaffd700 1 -- 172.21.15.12:0/2049565257 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac003cd0 con 0x7f38b415b360 2023-07-07T18:15:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38aaffd700 1 -- 172.21.15.12:0/2049565257 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ac003e50 con 0x7f38b415b360 2023-07-07T18:15:56.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b415ae40 con 0x7f38b415b360 2023-07-07T18:15:56.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38aaffd700 1 -- 172.21.15.12:0/2049565257 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ac00dbd0 con 0x7f38b415b360 2023-07-07T18:15:56.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.731+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b40af480 con 0x7f38b415b360 2023-07-07T18:15:56.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.732+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b415a6e0 con 0x7f38b415b360 2023-07-07T18:15:56.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.733+0000 7f38aaffd700 1 -- 172.21.15.12:0/2049565257 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38ac00dd30 con 0x7f38b415b360 2023-07-07T18:15:56.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.733+0000 7f38aaffd700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f389806ace0 0x7f389806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:56.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.733+0000 7f38aaffd700 1 -- 172.21.15.12:0/2049565257 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f38ac089ba0 con 0x7f38b415b360 2023-07-07T18:15:56.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.733+0000 7f38ba2af700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f389806ace0 0x7f389806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:56.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.734+0000 7f38ba2af700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f389806ace0 0x7f389806d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f38a40090b0 tx=0x7f38a4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:56.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.737+0000 7f38aaffd700 1 -- 172.21.15.12:0/2049565257 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f38b415a6e0 con 0x7f38b415b360 2023-07-07T18:15:56.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:56.986+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f38b415a6e0 con 0x7f38b415b360 2023-07-07T18:15:57.868 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-07-07T18:15:57.866+0000 7f9d67cbb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-07T18:15:57.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.873+0000 7f38aaffd700 1 -- 172.21.15.12:0/2049565257 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f38b415a6e0 con 0x7f38b415b360 2023-07-07T18:15:57.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f389806ace0 msgr2=0x7f389806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:57.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f389806ace0 0x7f389806d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f38a40090b0 tx=0x7f38a4008030 comp rx=0 tx=0).stop 2023-07-07T18:15:57.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38b415b360 msgr2=0x7f38b415b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:57.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38b415b360 0x7f38b415b7d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f38b40b3af0 tx=0x7f38ac00d430 comp rx=0 tx=0).stop 2023-07-07T18:15:57.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 shutdown_connections 2023-07-07T18:15:57.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f389806ace0 0x7f389806d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:57.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38b415b360 0x7f38b415b7d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:57.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a0003bc0 0x7f38b4153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:57.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 --2- 172.21.15.12:0/2049565257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38b40cefd0 0x7f38b415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:57.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 >> 172.21.15.12:0/2049565257 conn(0x7f38b406d4a0 msgr2=0x7f38b406d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:57.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 shutdown_connections 2023-07-07T18:15:57.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:57.876+0000 7f38bc513700 1 -- 172.21.15.12:0/2049565257 wait complete. 2023-07-07T18:15:57.880 INFO:tasks.ceph.mds.b.smithi160.stderr: -6008> 2023-07-07T18:14:50.771+0000 7fbc50459700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-07T18:15:57.880 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-07T18:15:57.893 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-07T18:15:57.912 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-07-07T18:15:58.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.025+0000 7ff7483c4700 1 Processor -- start 2023-07-07T18:15:58.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.025+0000 7ff7483c4700 1 -- start start 2023-07-07T18:15:58.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff7483c4700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff74015c430 0x7ff7400ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:58.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff7483c4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff74006d3e0 0x7ff74015ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:58.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff7483c4700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff74015c800 con 0x7ff74006b410 2023-07-07T18:15:58.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff7483c4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7400660e0 con 0x7ff74006d3e0 2023-07-07T18:15:58.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff7483c4700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff740070f60 con 0x7ff74015c430 2023-07-07T18:15:58.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff746961700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff74006d3e0 0x7ff74015ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:58.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff74595f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff74006b410 0x7ff74006ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56248/0 (socket says 172.21.15.12:56248) 2023-07-07T18:15:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff74595f700 1 -- 172.21.15.12:0/603607983 learned_addr learned my addr 172.21.15.12:0/603607983 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff746961700 1 -- 172.21.15.12:0/603607983 >> v2:172.21.15.160:3300/0 conn(0x7ff74015c430 msgr2=0x7ff7400ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff746160700 1 --2- 172.21.15.12:0/603607983 >> v2:172.21.15.160:3300/0 conn(0x7ff74015c430 0x7ff7400ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff746961700 1 --2- 172.21.15.12:0/603607983 >> v2:172.21.15.160:3300/0 conn(0x7ff74015c430 0x7ff7400ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff74515e700 1 -- 172.21.15.12:0/603607983 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226386378 0 0) 0x7ff74015c800 con 0x7ff74006b410 2023-07-07T18:15:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff746961700 1 -- 172.21.15.12:0/603607983 >> v1:172.21.15.12:6789/0 conn(0x7ff74006b410 legacy=0x7ff74006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:58.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.026+0000 7ff746961700 1 -- 172.21.15.12:0/603607983 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740071240 con 0x7ff74006d3e0 2023-07-07T18:15:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff746961700 1 --2- 172.21.15.12:0/603607983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 0x7ff74015ffb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff7400cf100 tx=0x7ff73800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2865d67cca326239 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff74515e700 1 -- 172.21.15.12:0/603607983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73800e070 con 0x7ff74006d3e0 2023-07-07T18:15:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff74515e700 1 -- 172.21.15.12:0/603607983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73800bbd0 con 0x7ff74006d3e0 2023-07-07T18:15:58.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff74515e700 1 -- 172.21.15.12:0/603607983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738012430 con 0x7ff74006d3e0 2023-07-07T18:15:58.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff7483c4700 1 -- 172.21.15.12:0/603607983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 msgr2=0x7ff74015ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:58.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff7483c4700 1 --2- 172.21.15.12:0/603607983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 0x7ff74015ffb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff7400cf100 tx=0x7ff73800b330 comp rx=0 tx=0).stop 2023-07-07T18:15:58.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff7483c4700 1 -- 172.21.15.12:0/603607983 shutdown_connections 2023-07-07T18:15:58.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff7483c4700 1 --2- 172.21.15.12:0/603607983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 0x7ff74015ffb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:58.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff7483c4700 1 --2- 172.21.15.12:0/603607983 >> v2:172.21.15.160:3300/0 conn(0x7ff74015c430 0x7ff7400ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:58.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff7483c4700 1 -- 172.21.15.12:0/603607983 >> 172.21.15.12:0/603607983 conn(0x7ff7400b1990 msgr2=0x7ff7400cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:58.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff7483c4700 1 -- 172.21.15.12:0/603607983 shutdown_connections 2023-07-07T18:15:58.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.027+0000 7ff7483c4700 1 -- 172.21.15.12:0/603607983 wait complete. 2023-07-07T18:15:58.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.029+0000 7ff7483c4700 1 Processor -- start 2023-07-07T18:15:58.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.029+0000 7ff7483c4700 1 -- start start 2023-07-07T18:15:58.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.029+0000 7ff7483c4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff74006b410 0x7ff7400cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:58.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.029+0000 7ff7483c4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 0x7ff7400c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.029+0000 7ff7483c4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff74015c430 0x7ff7400c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.029+0000 7ff7483c4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74015b770 con 0x7ff74006d3e0 2023-07-07T18:15:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.029+0000 7ff7483c4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74015ba50 con 0x7ff74015c430 2023-07-07T18:15:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.029+0000 7ff7483c4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400c33f0 con 0x7ff74006b410 2023-07-07T18:15:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.029+0000 7ff74595f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 0x7ff7400c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:58.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff74595f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 0x7ff7400c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59058/0 (socket says 172.21.15.12:59058) 2023-07-07T18:15:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff74595f700 1 -- 172.21.15.12:0/2255017543 learned_addr learned my addr 172.21.15.12:0/2255017543 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff746160700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff74006b410 0x7ff7400cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff746961700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff74015c430 0x7ff7400c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff74595f700 1 -- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff74006b410 msgr2=0x7ff7400cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff74595f700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff74006b410 0x7ff7400cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff74595f700 1 -- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff74015c430 msgr2=0x7ff7400c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:58.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff74595f700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff74015c430 0x7ff7400c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff74595f700 1 -- 172.21.15.12:0/2255017543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff738009a70 con 0x7ff74006d3e0 2023-07-07T18:15:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff746160700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff74006b410 0x7ff7400cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff746961700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff74015c430 0x7ff7400c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:15:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff74595f700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 0x7ff7400c3ed0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c550 tx=0x7ff73c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff736ffd700 1 -- 172.21.15.12:0/2255017543 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c004c80 con 0x7ff74006d3e0 2023-07-07T18:15:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff736ffd700 1 -- 172.21.15.12:0/2255017543 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c004e00 con 0x7ff74006d3e0 2023-07-07T18:15:58.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7400c36d0 con 0x7ff74006d3e0 2023-07-07T18:15:58.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff736ffd700 1 -- 172.21.15.12:0/2255017543 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c007310 con 0x7ff74006d3e0 2023-07-07T18:15:58.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.030+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74015b3b0 con 0x7ff74006d3e0 2023-07-07T18:15:58.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.031+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7400c3bf0 con 0x7ff74006d3e0 2023-07-07T18:15:58.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.032+0000 7ff736ffd700 1 -- 172.21.15.12:0/2255017543 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff73c007470 con 0x7ff74006d3e0 2023-07-07T18:15:58.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.032+0000 7ff736ffd700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff72406ace0 0x7ff72406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:58.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.032+0000 7ff736ffd700 1 -- 172.21.15.12:0/2255017543 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7ff73c089540 con 0x7ff74006d3e0 2023-07-07T18:15:58.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.033+0000 7ff746160700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff72406ace0 0x7ff72406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:58.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.033+0000 7ff746160700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff72406ace0 0x7ff72406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff73000aa50 tx=0x7ff730008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:58.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.036+0000 7ff736ffd700 1 -- 172.21.15.12:0/2255017543 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff7400c3bf0 con 0x7ff74006d3e0 2023-07-07T18:15:58.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.281+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff7400c3bf0 con 0x7ff74006d3e0 2023-07-07T18:15:58.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.881+0000 7ff736ffd700 1 -- 172.21.15.12:0/2255017543 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff7400c3bf0 con 0x7ff74006d3e0 2023-07-07T18:15:58.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.883+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff72406ace0 msgr2=0x7ff72406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.883+0000 7ff7483c4700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff72406ace0 0x7ff72406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff73000aa50 tx=0x7ff730008040 comp rx=0 tx=0).stop 2023-07-07T18:15:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.883+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 msgr2=0x7ff7400c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.883+0000 7ff7483c4700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 0x7ff7400c3ed0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c550 tx=0x7ff73c00c910 comp rx=0 tx=0).stop 2023-07-07T18:15:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.884+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 shutdown_connections 2023-07-07T18:15:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.884+0000 7ff7483c4700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff72406ace0 0x7ff72406d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:58.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.884+0000 7ff7483c4700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff74015c430 0x7ff7400c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:58.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.884+0000 7ff7483c4700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff74006b410 0x7ff7400cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:58.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.884+0000 7ff7483c4700 1 --2- 172.21.15.12:0/2255017543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff74006d3e0 0x7ff7400c3ed0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:58.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.884+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 >> 172.21.15.12:0/2255017543 conn(0x7ff7400b1990 msgr2=0x7ff7400ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:58.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.884+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 shutdown_connections 2023-07-07T18:15:58.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:58.884+0000 7ff7483c4700 1 -- 172.21.15.12:0/2255017543 wait complete. 2023-07-07T18:15:58.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-07T18:15:59.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.034+0000 7f4a5cf6c700 1 Processor -- start 2023-07-07T18:15:59.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.034+0000 7f4a5cf6c700 1 -- start start 2023-07-07T18:15:59.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.035+0000 7f4a5cf6c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a580aecc0 0x7f4a5806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.035+0000 7f4a5cf6c700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a580ce620 con 0x7f4a5806e970 2023-07-07T18:15:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.035+0000 7f4a5cf6c700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a58160580 con 0x7f4a5815fc60 2023-07-07T18:15:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.035+0000 7f4a5cf6c700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a58160860 con 0x7f4a580aecc0 2023-07-07T18:15:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.035+0000 7f4a55d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a580aecc0 0x7f4a5806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.035+0000 7f4a56d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a5806e970 0x7f4a580cea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56266/0 (socket says 172.21.15.12:56266) 2023-07-07T18:15:59.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.035+0000 7f4a56d9d700 1 -- 172.21.15.12:0/499041783 learned_addr learned my addr 172.21.15.12:0/499041783 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:15:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.035+0000 7f4a55d9b700 1 -- 172.21.15.12:0/499041783 >> v1:172.21.15.160:6789/0 conn(0x7f4a5815fc60 legacy=0x7f4a5806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:15:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a55d9b700 1 -- 172.21.15.12:0/499041783 >> v1:172.21.15.12:6789/0 conn(0x7f4a5806e970 legacy=0x7f4a580cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a55d9b700 1 -- 172.21.15.12:0/499041783 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a58160b40 con 0x7f4a580aecc0 2023-07-07T18:15:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a5559a700 1 -- 172.21.15.12:0/499041783 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373158997 0 0) 0x7f4a580ce620 con 0x7f4a5806e970 2023-07-07T18:15:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a55d9b700 1 --2- 172.21.15.12:0/499041783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a580aecc0 0x7f4a5806a900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009840 tx=0x7f4a48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e3a4f8ef3adf39 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a5559a700 1 -- 172.21.15.12:0/499041783 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48004230 con 0x7f4a580aecc0 2023-07-07T18:15:59.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a5559a700 1 -- 172.21.15.12:0/499041783 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48004390 con 0x7f4a580aecc0 2023-07-07T18:15:59.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a5559a700 1 -- 172.21.15.12:0/499041783 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480036a0 con 0x7f4a580aecc0 2023-07-07T18:15:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/499041783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a580aecc0 msgr2=0x7f4a5806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a5cf6c700 1 --2- 172.21.15.12:0/499041783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a580aecc0 0x7f4a5806a900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4a48009840 tx=0x7f4a48009b50 comp rx=0 tx=0).stop 2023-07-07T18:15:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/499041783 shutdown_connections 2023-07-07T18:15:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a5cf6c700 1 --2- 172.21.15.12:0/499041783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a580aecc0 0x7f4a5806a900 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.036+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/499041783 >> 172.21.15.12:0/499041783 conn(0x7f4a5806b920 msgr2=0x7f4a580cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:59.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.037+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/499041783 shutdown_connections 2023-07-07T18:15:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.037+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/499041783 wait complete. 2023-07-07T18:15:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.038+0000 7f4a5cf6c700 1 Processor -- start 2023-07-07T18:15:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.038+0000 7f4a5cf6c700 1 -- start start 2023-07-07T18:15:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5cf6c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5806e970 0x7f4a5815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5cf6c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a580aecc0 0x7f4a580c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5cf6c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a5815fc60 0x7f4a580cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:59.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5cf6c700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c3f80 con 0x7f4a5806e970 2023-07-07T18:15:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5cf6c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c48e0 con 0x7f4a580aecc0 2023-07-07T18:15:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5cf6c700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c35e0 con 0x7f4a5815fc60 2023-07-07T18:15:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5806e970 0x7f4a5815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5806e970 0x7f4a5815d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59070/0 (socket says 172.21.15.12:59070) 2023-07-07T18:15:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5659c700 1 -- 172.21.15.12:0/4124973160 learned_addr learned my addr 172.21.15.12:0/4124973160 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:15:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a55d9b700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a580aecc0 0x7f4a580c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:59.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a56d9d700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a5815fc60 0x7f4a580cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5659c700 1 -- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a5815fc60 msgr2=0x7f4a580cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5659c700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a5815fc60 0x7f4a580cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5659c700 1 -- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a580aecc0 msgr2=0x7f4a580c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5659c700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a580aecc0 0x7f4a580c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5659c700 1 -- 172.21.15.12:0/4124973160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a480094a0 con 0x7f4a5806e970 2023-07-07T18:15:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a56d9d700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a5815fc60 0x7f4a580cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:15:59.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5659c700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5806e970 0x7f4a5815d500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000b450 tx=0x7f4a4000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a4effd700 1 -- 172.21.15.12:0/4124973160 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40004020 con 0x7f4a5806e970 2023-07-07T18:15:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a4effd700 1 -- 172.21.15.12:0/4124973160 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40004180 con 0x7f4a5806e970 2023-07-07T18:15:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580c38c0 con 0x7f4a5806e970 2023-07-07T18:15:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a4effd700 1 -- 172.21.15.12:0/4124973160 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40004530 con 0x7f4a5806e970 2023-07-07T18:15:59.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.039+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a580cc380 con 0x7f4a5806e970 2023-07-07T18:15:59.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.040+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a580c40c0 con 0x7f4a5806e970 2023-07-07T18:15:59.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.041+0000 7f4a4effd700 1 -- 172.21.15.12:0/4124973160 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a400036d0 con 0x7f4a5806e970 2023-07-07T18:15:59.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.041+0000 7f4a4effd700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4a3806ace0 0x7f4a3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:15:59.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.041+0000 7f4a4effd700 1 -- 172.21.15.12:0/4124973160 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f4a400890e0 con 0x7f4a5806e970 2023-07-07T18:15:59.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.041+0000 7f4a55d9b700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4a3806ace0 0x7f4a3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:15:59.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.042+0000 7f4a55d9b700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4a3806ace0 0x7f4a3806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4a48000c00 tx=0x7f4a4801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:15:59.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.046+0000 7f4a4effd700 1 -- 172.21.15.12:0/4124973160 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4a580c40c0 con 0x7f4a5806e970 2023-07-07T18:15:59.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.244+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4a580c40c0 con 0x7f4a5806e970 2023-07-07T18:15:59.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.884+0000 7f4a4effd700 1 -- 172.21.15.12:0/4124973160 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v33) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4a580c40c0 con 0x7f4a5806e970 2023-07-07T18:15:59.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4a3806ace0 msgr2=0x7f4a3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:59.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4a3806ace0 0x7f4a3806d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4a48000c00 tx=0x7f4a4801c040 comp rx=0 tx=0).stop 2023-07-07T18:15:59.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5806e970 msgr2=0x7f4a5815d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:15:59.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5806e970 0x7f4a5815d500 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000b450 tx=0x7f4a4000b810 comp rx=0 tx=0).stop 2023-07-07T18:15:59.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 shutdown_connections 2023-07-07T18:15:59.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4a3806ace0 0x7f4a3806d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:59.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a5815fc60 0x7f4a580cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:59.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a5806e970 0x7f4a5815d500 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:59.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 --2- 172.21.15.12:0/4124973160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a580aecc0 0x7f4a580c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:15:59.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.889+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 >> 172.21.15.12:0/4124973160 conn(0x7f4a5806b920 msgr2=0x7f4a5815dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:15:59.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.890+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 shutdown_connections 2023-07-07T18:15:59.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:15:59.890+0000 7f4a5cf6c700 1 -- 172.21.15.12:0/4124973160 wait complete. 2023-07-07T18:15:59.894 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-07-07T18:15:59.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-07T18:16:00.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.045+0000 7f4d372a9700 1 Processor -- start 2023-07-07T18:16:00.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.045+0000 7f4d372a9700 1 -- start start 2023-07-07T18:16:00.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.045+0000 7f4d372a9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f4d300cd330 0x7f4d30070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:00.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.045+0000 7f4d372a9700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d3015a330 0x7f4d300cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:00.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.045+0000 7f4d372a9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d300afc40 0x7f4d3015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:00.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.045+0000 7f4d372a9700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d300caf70 con 0x7f4d3015a330 2023-07-07T18:16:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.045+0000 7f4d372a9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d300cdc40 con 0x7f4d300cd330 2023-07-07T18:16:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.045+0000 7f4d372a9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300cb210 con 0x7f4d300afc40 2023-07-07T18:16:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.045+0000 7f4d34844700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d3015a330 0x7f4d300cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d34844700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d3015a330 0x7f4d300cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59078/0 (socket says 172.21.15.12:59078) 2023-07-07T18:16:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d34844700 1 -- 172.21.15.12:0/1839913545 learned_addr learned my addr 172.21.15.12:0/1839913545 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d35045700 1 --2- 172.21.15.12:0/1839913545 >> v2:172.21.15.160:3300/0 conn(0x7f4d300cd330 0x7f4d30070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:00.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d35846700 1 --2- 172.21.15.12:0/1839913545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d300afc40 0x7f4d3015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:00.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d34844700 1 -- 172.21.15.12:0/1839913545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d300afc40 msgr2=0x7f4d3015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:00.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d34844700 1 --2- 172.21.15.12:0/1839913545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d300afc40 0x7f4d3015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d34844700 1 -- 172.21.15.12:0/1839913545 >> v2:172.21.15.160:3300/0 conn(0x7f4d300cd330 msgr2=0x7f4d30070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:00.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d34844700 1 --2- 172.21.15.12:0/1839913545 >> v2:172.21.15.160:3300/0 conn(0x7f4d300cd330 0x7f4d30070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d34844700 1 -- 172.21.15.12:0/1839913545 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300ccc20 con 0x7f4d3015a330 2023-07-07T18:16:00.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d34844700 1 --2- 172.21.15.12:0/1839913545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3015a330 0x7f4d300cd700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4d300d0880 tx=0x7f4d24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69642ba039493099 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:00.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d23fff700 1 -- 172.21.15.12:0/1839913545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400b870 con 0x7f4d3015a330 2023-07-07T18:16:00.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d23fff700 1 -- 172.21.15.12:0/1839913545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400b9d0 con 0x7f4d3015a330 2023-07-07T18:16:00.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.046+0000 7f4d23fff700 1 -- 172.21.15.12:0/1839913545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400bd60 con 0x7f4d3015a330 2023-07-07T18:16:00.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.047+0000 7f4d372a9700 1 -- 172.21.15.12:0/1839913545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3015a330 msgr2=0x7f4d300cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:00.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.047+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1839913545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3015a330 0x7f4d300cd700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4d300d0880 tx=0x7f4d24009bd0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.047+0000 7f4d372a9700 1 -- 172.21.15.12:0/1839913545 shutdown_connections 2023-07-07T18:16:00.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.047+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1839913545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d300afc40 0x7f4d3015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.047+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1839913545 >> v2:172.21.15.160:3300/0 conn(0x7f4d300cd330 0x7f4d30070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.047+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1839913545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3015a330 0x7f4d300cd700 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.047+0000 7f4d372a9700 1 -- 172.21.15.12:0/1839913545 >> 172.21.15.12:0/1839913545 conn(0x7f4d3006e5c0 msgr2=0x7f4d3006e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:00.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.047+0000 7f4d372a9700 1 -- 172.21.15.12:0/1839913545 shutdown_connections 2023-07-07T18:16:00.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.047+0000 7f4d372a9700 1 -- 172.21.15.12:0/1839913545 wait complete. 2023-07-07T18:16:00.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.048+0000 7f4d372a9700 1 Processor -- start 2023-07-07T18:16:00.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.048+0000 7f4d372a9700 1 -- start start 2023-07-07T18:16:00.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d372a9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d300afc40 0x7f4d300b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:00.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d372a9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300cd330 0x7f4d30158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:00.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d372a9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d3015a330 0x7f4d300b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:00.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d372a9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30155e30 con 0x7f4d300cd330 2023-07-07T18:16:00.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d372a9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300b4f40 con 0x7f4d300afc40 2023-07-07T18:16:00.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d372a9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300b4330 con 0x7f4d3015a330 2023-07-07T18:16:00.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d34844700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300cd330 0x7f4d30158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:00.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d34844700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300cd330 0x7f4d30158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59086/0 (socket says 172.21.15.12:59086) 2023-07-07T18:16:00.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d34844700 1 -- 172.21.15.12:0/1484971017 learned_addr learned my addr 172.21.15.12:0/1484971017 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:00.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d35045700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d300afc40 0x7f4d300b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:00.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d35846700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d3015a330 0x7f4d300b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:00.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d34844700 1 -- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d3015a330 msgr2=0x7f4d300b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:00.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d34844700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d3015a330 0x7f4d300b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d34844700 1 -- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d300afc40 msgr2=0x7f4d300b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:00.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d34844700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d300afc40 0x7f4d300b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d34844700 1 -- 172.21.15.12:0/1484971017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d24009550 con 0x7f4d300cd330 2023-07-07T18:16:00.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d35045700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d300afc40 0x7f4d300b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:00.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.049+0000 7f4d34844700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300cd330 0x7f4d30158a00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4d24000c00 tx=0x7f4d24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:00.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.050+0000 7f4d21ffb700 1 -- 172.21.15.12:0/1484971017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d24004520 con 0x7f4d300cd330 2023-07-07T18:16:00.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.050+0000 7f4d21ffb700 1 -- 172.21.15.12:0/1484971017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2401e070 con 0x7f4d300cd330 2023-07-07T18:16:00.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.050+0000 7f4d21ffb700 1 -- 172.21.15.12:0/1484971017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240038c0 con 0x7f4d300cd330 2023-07-07T18:16:00.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.050+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d300b4610 con 0x7f4d300cd330 2023-07-07T18:16:00.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.050+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d300b4bd0 con 0x7f4d300cd330 2023-07-07T18:16:00.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.051+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3004ea20 con 0x7f4d300cd330 2023-07-07T18:16:00.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.051+0000 7f4d21ffb700 1 -- 172.21.15.12:0/1484971017 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d24003a20 con 0x7f4d300cd330 2023-07-07T18:16:00.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.052+0000 7f4d21ffb700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4d1406ace0 0x7f4d1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:00.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.052+0000 7f4d21ffb700 1 -- 172.21.15.12:0/1484971017 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f4d24020070 con 0x7f4d300cd330 2023-07-07T18:16:00.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.052+0000 7f4d35045700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4d1406ace0 0x7f4d1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:00.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.053+0000 7f4d35045700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4d1406ace0 0x7f4d1406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009970 tx=0x7f4d2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:00.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.056+0000 7f4d21ffb700 1 -- 172.21.15.12:0/1484971017 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4d240559f0 con 0x7f4d300cd330 2023-07-07T18:16:00.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.255+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d300b5080 con 0x7f4d300cd330 2023-07-07T18:16:00.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.892+0000 7f4d21ffb700 1 -- 172.21.15.12:0/1484971017 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v34) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4d24059010 con 0x7f4d300cd330 2023-07-07T18:16:00.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.898+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4d1406ace0 msgr2=0x7f4d1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:00.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.898+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4d1406ace0 0x7f4d1406d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009970 tx=0x7f4d2c008040 comp rx=0 tx=0).stop 2023-07-07T18:16:00.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.898+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300cd330 msgr2=0x7f4d30158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:00.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.898+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300cd330 0x7f4d30158a00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4d24000c00 tx=0x7f4d24004750 comp rx=0 tx=0).stop 2023-07-07T18:16:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.899+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 shutdown_connections 2023-07-07T18:16:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.899+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4d1406ace0 0x7f4d1406d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.899+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d3015a330 0x7f4d300b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.899+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d300afc40 0x7f4d300b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.899+0000 7f4d372a9700 1 --2- 172.21.15.12:0/1484971017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d300cd330 0x7f4d30158a00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:00.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.899+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 >> 172.21.15.12:0/1484971017 conn(0x7f4d3006e5c0 msgr2=0x7f4d300cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:00.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.899+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 shutdown_connections 2023-07-07T18:16:00.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:00.899+0000 7f4d372a9700 1 -- 172.21.15.12:0/1484971017 wait complete. 2023-07-07T18:16:00.906 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-07-07T18:16:00.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-07T18:16:01.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.050+0000 7f62700f7700 1 Processor -- start 2023-07-07T18:16:01.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.050+0000 7f62700f7700 1 -- start start 2023-07-07T18:16:01.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f62700f7700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f62680cd330 0x7f6268070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:01.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f62700f7700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f626815a330 0x7f62680cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:01.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f62700f7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62680afc40 0x7f626815dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:01.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f62700f7700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680caf70 con 0x7f62680cd330 2023-07-07T18:16:01.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f62700f7700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62680cdc40 con 0x7f626815a330 2023-07-07T18:16:01.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f62700f7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680cb210 con 0x7f62680afc40 2023-07-07T18:16:01.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626de93700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f62680cd330 0x7f6268070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:01.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626de93700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f62680cd330 0x7f6268070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59092/0 (socket says 172.21.15.12:59092) 2023-07-07T18:16:01.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626de93700 1 -- 172.21.15.12:0/2739136207 learned_addr learned my addr 172.21.15.12:0/2739136207 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:01.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626d692700 1 --2- 172.21.15.12:0/2739136207 >> v2:172.21.15.160:3300/0 conn(0x7f626815a330 0x7f62680cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:01.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626e694700 1 --2- 172.21.15.12:0/2739136207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62680afc40 0x7f626815dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:01.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626de93700 1 -- 172.21.15.12:0/2739136207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62680afc40 msgr2=0x7f626815dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:01.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626de93700 1 --2- 172.21.15.12:0/2739136207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62680afc40 0x7f626815dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626de93700 1 -- 172.21.15.12:0/2739136207 >> v2:172.21.15.160:3300/0 conn(0x7f626815a330 msgr2=0x7f62680cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:01.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626de93700 1 --2- 172.21.15.12:0/2739136207 >> v2:172.21.15.160:3300/0 conn(0x7f626815a330 0x7f62680cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626de93700 1 -- 172.21.15.12:0/2739136207 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680ccc20 con 0x7f62680cd330 2023-07-07T18:16:01.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.051+0000 7f626d692700 1 --2- 172.21.15.12:0/2739136207 >> v2:172.21.15.160:3300/0 conn(0x7f626815a330 0x7f62680cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:01.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f626de93700 1 --2- 172.21.15.12:0/2739136207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680cd330 0x7f6268070980 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62680cc360 tx=0x7f6264009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=200d32bf04c90c63 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:01.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f626ce91700 1 -- 172.21.15.12:0/2739136207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400b870 con 0x7f62680cd330 2023-07-07T18:16:01.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f626ce91700 1 -- 172.21.15.12:0/2739136207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626400b9d0 con 0x7f62680cd330 2023-07-07T18:16:01.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f626ce91700 1 -- 172.21.15.12:0/2739136207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400bd60 con 0x7f62680cd330 2023-07-07T18:16:01.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f62700f7700 1 -- 172.21.15.12:0/2739136207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680cd330 msgr2=0x7f6268070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:01.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f62700f7700 1 --2- 172.21.15.12:0/2739136207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680cd330 0x7f6268070980 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62680cc360 tx=0x7f6264009bd0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f62700f7700 1 -- 172.21.15.12:0/2739136207 shutdown_connections 2023-07-07T18:16:01.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f62700f7700 1 --2- 172.21.15.12:0/2739136207 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62680afc40 0x7f626815dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f62700f7700 1 --2- 172.21.15.12:0/2739136207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680cd330 0x7f6268070980 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f62700f7700 1 --2- 172.21.15.12:0/2739136207 >> v2:172.21.15.160:3300/0 conn(0x7f626815a330 0x7f62680cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f62700f7700 1 -- 172.21.15.12:0/2739136207 >> 172.21.15.12:0/2739136207 conn(0x7f626806e5c0 msgr2=0x7f626806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:01.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f62700f7700 1 -- 172.21.15.12:0/2739136207 shutdown_connections 2023-07-07T18:16:01.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.052+0000 7f62700f7700 1 -- 172.21.15.12:0/2739136207 wait complete. 2023-07-07T18:16:01.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.054+0000 7f62700f7700 1 Processor -- start 2023-07-07T18:16:01.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.054+0000 7f62700f7700 1 -- start start 2023-07-07T18:16:01.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.054+0000 7f62700f7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680afc40 0x7f62681f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:01.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.054+0000 7f62700f7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62680cd330 0x7f626815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:01.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.054+0000 7f62700f7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f626815a330 0x7f62680b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:01.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.054+0000 7f62700f7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626815b8b0 con 0x7f62680afc40 2023-07-07T18:16:01.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.054+0000 7f62700f7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62681f4f20 con 0x7f62680cd330 2023-07-07T18:16:01.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.054+0000 7f62700f7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62680b4010 con 0x7f626815a330 2023-07-07T18:16:01.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.054+0000 7f626de93700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680afc40 0x7f62681f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:01.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626de93700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680afc40 0x7f62681f5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59098/0 (socket says 172.21.15.12:59098) 2023-07-07T18:16:01.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626de93700 1 -- 172.21.15.12:0/2952278693 learned_addr learned my addr 172.21.15.12:0/2952278693 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:01.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626e694700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f626815a330 0x7f62680b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:01.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626d692700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62680cd330 0x7f626815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:01.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626de93700 1 -- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f626815a330 msgr2=0x7f62680b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:01.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626de93700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f626815a330 0x7f62680b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626de93700 1 -- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62680cd330 msgr2=0x7f626815d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:01.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626de93700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62680cd330 0x7f626815d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626de93700 1 -- 172.21.15.12:0/2952278693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264009550 con 0x7f62680afc40 2023-07-07T18:16:01.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f626de93700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680afc40 0x7f62681f5150 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6264000c00 tx=0x7f6264004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:01.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f625a7fc700 1 -- 172.21.15.12:0/2952278693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6264004480 con 0x7f62680afc40 2023-07-07T18:16:01.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f625a7fc700 1 -- 172.21.15.12:0/2952278693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62640045e0 con 0x7f62680afc40 2023-07-07T18:16:01.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f625a7fc700 1 -- 172.21.15.12:0/2952278693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62640038e0 con 0x7f62680afc40 2023-07-07T18:16:01.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62681f5730 con 0x7f62680afc40 2023-07-07T18:16:01.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.055+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62681f5cf0 con 0x7f62680afc40 2023-07-07T18:16:01.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.056+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626804ea20 con 0x7f62680afc40 2023-07-07T18:16:01.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.057+0000 7f625a7fc700 1 -- 172.21.15.12:0/2952278693 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6264021070 con 0x7f62680afc40 2023-07-07T18:16:01.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.057+0000 7f625a7fc700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f624c06ace0 0x7f624c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:01.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.057+0000 7f625a7fc700 1 -- 172.21.15.12:0/2952278693 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f626408a950 con 0x7f62680afc40 2023-07-07T18:16:01.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.057+0000 7f626d692700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f624c06ace0 0x7f624c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:01.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.058+0000 7f626d692700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f624c06ace0 0x7f624c06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62681598d0 tx=0x7f625c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:01.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.062+0000 7f625a7fc700 1 -- 172.21.15.12:0/2952278693 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6264055bc0 con 0x7f62680afc40 2023-07-07T18:16:01.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.263+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62680b68a0 con 0x7f62680afc40 2023-07-07T18:16:01.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.896+0000 7f625a7fc700 1 -- 172.21.15.12:0/2952278693 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v35) v1 ==== 178+0+0 (secure 0 0 0) 0x7f62640150d0 con 0x7f62680afc40 2023-07-07T18:16:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f624c06ace0 msgr2=0x7f624c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f624c06ace0 0x7f624c06d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f62681598d0 tx=0x7f625c008040 comp rx=0 tx=0).stop 2023-07-07T18:16:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680afc40 msgr2=0x7f62681f5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680afc40 0x7f62681f5150 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6264000c00 tx=0x7f6264004750 comp rx=0 tx=0).stop 2023-07-07T18:16:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 shutdown_connections 2023-07-07T18:16:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f624c06ace0 0x7f624c06d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f626815a330 0x7f62680b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62680afc40 0x7f62681f5150 secure :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6264000c00 tx=0x7f6264004750 comp rx=0 tx=0).stop 2023-07-07T18:16:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 --2- 172.21.15.12:0/2952278693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62680cd330 0x7f626815d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 >> 172.21.15.12:0/2952278693 conn(0x7f626806e5c0 msgr2=0x7f62680b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 shutdown_connections 2023-07-07T18:16:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:01.901+0000 7f62700f7700 1 -- 172.21.15.12:0/2952278693 wait complete. 2023-07-07T18:16:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data_ec' removed 2023-07-07T18:16:01.918 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-07T18:16:01.918 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-07T18:16:01.919 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-07T18:16:01.919 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T18:16:01.919 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-07T18:16:01.919 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-07T18:16:01.920 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-07T18:16:01.920 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T18:16:01.920 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-07T18:16:01.920 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-07T18:16:01.921 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-07T18:16:01.921 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T18:16:01.921 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-07T18:16:01.921 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-07T18:16:01.922 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-07T18:16:01.922 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T18:16:01.930 INFO:tasks.ceph.mds.a:Stopped 2023-07-07T18:16:01.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-07T18:16:01.931 INFO:tasks.ceph.mds.c:Stopped 2023-07-07T18:16:01.931 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-07T18:16:01.933 INFO:tasks.ceph.mds.b:Stopped 2023-07-07T18:16:01.933 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-07T18:16:01.934 INFO:tasks.ceph.mds.d:Stopped 2023-07-07T18:16:01.934 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-07T18:16:01.973 INFO:tasks.ceph.mds.a:Started 2023-07-07T18:16:01.973 DEBUG:teuthology.parallel:result is None 2023-07-07T18:16:01.974 INFO:tasks.ceph.mds.c:Started 2023-07-07T18:16:01.974 DEBUG:teuthology.parallel:result is None 2023-07-07T18:16:01.976 INFO:tasks.ceph.mds.b:Started 2023-07-07T18:16:01.976 DEBUG:teuthology.parallel:result is None 2023-07-07T18:16:01.977 INFO:tasks.ceph.mds.d:Started 2023-07-07T18:16:01.977 DEBUG:teuthology.parallel:result is None 2023-07-07T18:16:01.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-07T18:16:02.061 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2023-07-07T18:16:02.061 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2023-07-07T18:16:02.062 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-07-07T18:16:02.062 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-07-07T18:16:02.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.118+0000 7fd1a3f93700 1 Processor -- start 2023-07-07T18:16:02.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.118+0000 7fd1a3f93700 1 -- start start 2023-07-07T18:16:02.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.119+0000 7fd1a3f93700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd19c15c420 0x7fd19c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:02.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.119+0000 7fd1a3f93700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd19c0b08d0 0x7fd19c06a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:02.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.119+0000 7fd1a3f93700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c0cf2a0 con 0x7fd19c15c7f0 2023-07-07T18:16:02.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.119+0000 7fd1a3f93700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0ce690 con 0x7fd19c0b08d0 2023-07-07T18:16:02.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.119+0000 7fd1a3f93700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19c0ce970 con 0x7fd19c15c420 2023-07-07T18:16:02.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.119+0000 7fd1a152e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd19c0b08d0 0x7fd19c06a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:02.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.119+0000 7fd1a152e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd19c0b08d0 0x7fd19c06a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59144/0 (socket says 172.21.15.12:59144) 2023-07-07T18:16:02.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.119+0000 7fd1a152e700 1 -- 172.21.15.12:0/2427449734 learned_addr learned my addr 172.21.15.12:0/2427449734 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:02.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.119+0000 7fd1a1d2f700 1 --2- 172.21.15.12:0/2427449734 >> v2:172.21.15.160:3300/0 conn(0x7fd19c15c420 0x7fd19c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:02.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a152e700 1 -- 172.21.15.12:0/2427449734 >> v2:172.21.15.160:3300/0 conn(0x7fd19c15c420 msgr2=0x7fd19c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:02.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a152e700 1 --2- 172.21.15.12:0/2427449734 >> v2:172.21.15.160:3300/0 conn(0x7fd19c15c420 0x7fd19c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:02.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a152e700 1 -- 172.21.15.12:0/2427449734 >> v1:172.21.15.12:6789/0 conn(0x7fd19c15c7f0 legacy=0x7fd19c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:02.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a152e700 1 -- 172.21.15.12:0/2427449734 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0cec50 con 0x7fd19c0b08d0 2023-07-07T18:16:02.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a0d2d700 1 -- 172.21.15.12:0/2427449734 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434232014 0 0) 0x7fd19c0cf2a0 con 0x7fd19c15c7f0 2023-07-07T18:16:02.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a152e700 1 --2- 172.21.15.12:0/2427449734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c0b08d0 0x7fd19c06a430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd19c06af50 tx=0x7fd198009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c2620daa604dc8 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:02.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a0d2d700 1 -- 172.21.15.12:0/2427449734 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198011830 con 0x7fd19c0b08d0 2023-07-07T18:16:02.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a0d2d700 1 -- 172.21.15.12:0/2427449734 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198011990 con 0x7fd19c0b08d0 2023-07-07T18:16:02.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a0d2d700 1 -- 172.21.15.12:0/2427449734 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198011d20 con 0x7fd19c0b08d0 2023-07-07T18:16:02.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a3f93700 1 -- 172.21.15.12:0/2427449734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c0b08d0 msgr2=0x7fd19c06a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:02.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a3f93700 1 --2- 172.21.15.12:0/2427449734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c0b08d0 0x7fd19c06a430 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd19c06af50 tx=0x7fd198009bd0 comp rx=0 tx=0).stop 2023-07-07T18:16:02.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.120+0000 7fd1a3f93700 1 -- 172.21.15.12:0/2427449734 shutdown_connections 2023-07-07T18:16:02.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.121+0000 7fd1a3f93700 1 --2- 172.21.15.12:0/2427449734 >> v2:172.21.15.160:3300/0 conn(0x7fd19c15c420 0x7fd19c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:02.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.121+0000 7fd1a3f93700 1 --2- 172.21.15.12:0/2427449734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c0b08d0 0x7fd19c06a430 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:02.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.121+0000 7fd1a3f93700 1 -- 172.21.15.12:0/2427449734 >> 172.21.15.12:0/2427449734 conn(0x7fd19c06b920 msgr2=0x7fd19c0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:02.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.121+0000 7fd1a3f93700 1 -- 172.21.15.12:0/2427449734 shutdown_connections 2023-07-07T18:16:02.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.121+0000 7fd1a3f93700 1 -- 172.21.15.12:0/2427449734 wait complete. 2023-07-07T18:16:02.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.122+0000 7fd1a3f93700 1 Processor -- start 2023-07-07T18:16:02.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.122+0000 7fd1a3f93700 1 -- start start 2023-07-07T18:16:02.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a3f93700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c0b08d0 0x7fd19c0adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:02.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a3f93700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19c15c420 0x7fd19c15e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:02.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a3f93700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c15c7f0 0x7fd19c159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:02.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a3f93700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0adfe0 con 0x7fd19c15c7f0 2023-07-07T18:16:02.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a3f93700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c15e850 con 0x7fd19c0b08d0 2023-07-07T18:16:02.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a3f93700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c15ea60 con 0x7fd19c15c420 2023-07-07T18:16:02.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a2530700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c15c7f0 0x7fd19c159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:02.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a2530700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c15c7f0 0x7fd19c159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59152/0 (socket says 172.21.15.12:59152) 2023-07-07T18:16:02.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a2530700 1 -- 172.21.15.12:0/3946400155 learned_addr learned my addr 172.21.15.12:0/3946400155 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:02.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a1d2f700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c0b08d0 0x7fd19c0adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:02.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.123+0000 7fd1a152e700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19c15c420 0x7fd19c15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:02.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1a2530700 1 -- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19c15c420 msgr2=0x7fd19c15e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:02.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1a2530700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19c15c420 0x7fd19c15e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:02.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1a2530700 1 -- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c0b08d0 msgr2=0x7fd19c0adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:02.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1a2530700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c0b08d0 0x7fd19c0adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:02.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1a2530700 1 -- 172.21.15.12:0/3946400155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd198009550 con 0x7fd19c15c7f0 2023-07-07T18:16:02.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1a2530700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c15c7f0 0x7fd19c159f90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd194001560 tx=0x7fd19400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:02.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1927fc700 1 -- 172.21.15.12:0/3946400155 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194003e30 con 0x7fd19c15c7f0 2023-07-07T18:16:02.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1927fc700 1 -- 172.21.15.12:0/3946400155 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd194005070 con 0x7fd19c15c7f0 2023-07-07T18:16:02.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1927fc700 1 -- 172.21.15.12:0/3946400155 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194005420 con 0x7fd19c15c7f0 2023-07-07T18:16:02.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c15ed40 con 0x7fd19c15c7f0 2023-07-07T18:16:02.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.124+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c15f5e0 con 0x7fd19c15c7f0 2023-07-07T18:16:02.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.125+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c15ef30 con 0x7fd19c15c7f0 2023-07-07T18:16:02.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.125+0000 7fd1927fc700 1 -- 172.21.15.12:0/3946400155 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd194005580 con 0x7fd19c15c7f0 2023-07-07T18:16:02.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.126+0000 7fd1927fc700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd18006ace0 0x7fd18006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:02.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.126+0000 7fd1927fc700 1 -- 172.21.15.12:0/3946400155 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd194088890 con 0x7fd19c15c7f0 2023-07-07T18:16:02.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.126+0000 7fd1a1d2f700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd18006ace0 0x7fd18006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:02.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.127+0000 7fd1a1d2f700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd18006ace0 0x7fd18006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009be0 tx=0x7fd18c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:02.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.130+0000 7fd1927fc700 1 -- 172.21.15.12:0/3946400155 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd194053b90 con 0x7fd19c15c7f0 2023-07-07T18:16:02.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:02.348+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd19c15f800 con 0x7fd19c15c7f0 2023-07-07T18:16:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.111+0000 7fd1927fc700 1 -- 172.21.15.12:0/3946400155 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd194017020 con 0x7fd19c15c7f0 2023-07-07T18:16:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd18006ace0 msgr2=0x7fd18006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd18006ace0 0x7fd18006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009be0 tx=0x7fd18c009210 comp rx=0 tx=0).stop 2023-07-07T18:16:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c15c7f0 msgr2=0x7fd19c159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c15c7f0 0x7fd19c159f90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd194001560 tx=0x7fd19400cb50 comp rx=0 tx=0).stop 2023-07-07T18:16:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 shutdown_connections 2023-07-07T18:16:03.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd18006ace0 0x7fd18006d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd19c15c7f0 0x7fd19c159f90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c0b08d0 0x7fd19c0adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 --2- 172.21.15.12:0/3946400155 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19c15c420 0x7fd19c15e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 >> 172.21.15.12:0/3946400155 conn(0x7fd19c06b920 msgr2=0x7fd19c0cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:03.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 shutdown_connections 2023-07-07T18:16:03.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.114+0000 7fd1a3f93700 1 -- 172.21.15.12:0/3946400155 wait complete. 2023-07-07T18:16:03.117 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-07-07T18:16:03.130 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-07T18:16:03.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.264+0000 7f636c97a700 1 Processor -- start 2023-07-07T18:16:03.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.264+0000 7f636c97a700 1 -- start start 2023-07-07T18:16:03.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f636c97a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f636815a0c0 0x7f63680cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f636c97a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63680c8ce0 0x7f63680ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f636c97a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6368069ef0 0x7f636806a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f636c97a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636806a870 con 0x7f6368069ef0 2023-07-07T18:16:03.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f636c97a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63680caea0 con 0x7f636815a0c0 2023-07-07T18:16:03.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f636c97a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636815a490 con 0x7f63680c8ce0 2023-07-07T18:16:03.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f6366d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6368069ef0 0x7f636806a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f6366d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6368069ef0 0x7f636806a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59164/0 (socket says 172.21.15.12:59164) 2023-07-07T18:16:03.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f6366d9d700 1 -- 172.21.15.12:0/3547554883 learned_addr learned my addr 172.21.15.12:0/3547554883 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:03.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.265+0000 7f6365d9b700 1 --2- 172.21.15.12:0/3547554883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63680c8ce0 0x7f63680ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f636659c700 1 --2- 172.21.15.12:0/3547554883 >> v2:172.21.15.160:3300/0 conn(0x7f636815a0c0 0x7f63680cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f6366d9d700 1 -- 172.21.15.12:0/3547554883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63680c8ce0 msgr2=0x7f63680ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:03.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f6366d9d700 1 --2- 172.21.15.12:0/3547554883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63680c8ce0 0x7f63680ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f6366d9d700 1 -- 172.21.15.12:0/3547554883 >> v2:172.21.15.160:3300/0 conn(0x7f636815a0c0 msgr2=0x7f63680cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:03.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f6366d9d700 1 --2- 172.21.15.12:0/3547554883 >> v2:172.21.15.160:3300/0 conn(0x7f636815a0c0 0x7f63680cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f6366d9d700 1 -- 172.21.15.12:0/3547554883 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63680ca620 con 0x7f6368069ef0 2023-07-07T18:16:03.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f6365d9b700 1 --2- 172.21.15.12:0/3547554883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63680c8ce0 0x7f63680ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:03.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f636659c700 1 --2- 172.21.15.12:0/3547554883 >> v2:172.21.15.160:3300/0 conn(0x7f636815a0c0 0x7f63680cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:03.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f6366d9d700 1 --2- 172.21.15.12:0/3547554883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 0x7f636806a330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f63680671b0 tx=0x7f636000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fa635c533a68ed server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:03.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f636559a700 1 -- 172.21.15.12:0/3547554883 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000e070 con 0x7f6368069ef0 2023-07-07T18:16:03.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f636559a700 1 -- 172.21.15.12:0/3547554883 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636000b9c0 con 0x7f6368069ef0 2023-07-07T18:16:03.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.266+0000 7f636559a700 1 -- 172.21.15.12:0/3547554883 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000bd70 con 0x7f6368069ef0 2023-07-07T18:16:03.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.267+0000 7f636c97a700 1 -- 172.21.15.12:0/3547554883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 msgr2=0x7f636806a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.267+0000 7f636c97a700 1 --2- 172.21.15.12:0/3547554883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 0x7f636806a330 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f63680671b0 tx=0x7f636000b330 comp rx=0 tx=0).stop 2023-07-07T18:16:03.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.267+0000 7f636c97a700 1 -- 172.21.15.12:0/3547554883 shutdown_connections 2023-07-07T18:16:03.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.267+0000 7f636c97a700 1 --2- 172.21.15.12:0/3547554883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 0x7f636806a330 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.267+0000 7f636c97a700 1 --2- 172.21.15.12:0/3547554883 >> v2:172.21.15.160:3300/0 conn(0x7f636815a0c0 0x7f63680cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.267+0000 7f636c97a700 1 --2- 172.21.15.12:0/3547554883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63680c8ce0 0x7f63680ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.267+0000 7f636c97a700 1 -- 172.21.15.12:0/3547554883 >> 172.21.15.12:0/3547554883 conn(0x7f63680b0ef0 msgr2=0x7f63680ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.267+0000 7f636c97a700 1 -- 172.21.15.12:0/3547554883 shutdown_connections 2023-07-07T18:16:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.267+0000 7f636c97a700 1 -- 172.21.15.12:0/3547554883 wait complete. 2023-07-07T18:16:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.268+0000 7f636c97a700 1 Processor -- start 2023-07-07T18:16:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.268+0000 7f636c97a700 1 -- start start 2023-07-07T18:16:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636c97a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 0x7f63680c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636c97a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63680c8ce0 0x7f636815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636c97a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636815a0c0 0x7f6368154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636c97a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680b1970 con 0x7f6368069ef0 2023-07-07T18:16:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636c97a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680c8640 con 0x7f63680c8ce0 2023-07-07T18:16:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636c97a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63680c8080 con 0x7f636815a0c0 2023-07-07T18:16:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 0x7f63680c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 0x7f63680c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59166/0 (socket says 172.21.15.12:59166) 2023-07-07T18:16:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636659c700 1 -- 172.21.15.12:0/2377183746 learned_addr learned my addr 172.21.15.12:0/2377183746 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:03.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f6366d9d700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636815a0c0 0x7f6368154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636659c700 1 -- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636815a0c0 msgr2=0x7f6368154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f6365d9b700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63680c8ce0 0x7f636815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636659c700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636815a0c0 0x7f6368154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636659c700 1 -- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63680c8ce0 msgr2=0x7f636815b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636659c700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63680c8ce0 0x7f636815b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.269+0000 7f636659c700 1 -- 172.21.15.12:0/2377183746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360009b30 con 0x7f6368069ef0 2023-07-07T18:16:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.270+0000 7f636659c700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 0x7f63680c7850 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f635800e760 tx=0x7f635800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.270+0000 7f6356ffd700 1 -- 172.21.15.12:0/2377183746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358013610 con 0x7f6368069ef0 2023-07-07T18:16:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.270+0000 7f6356ffd700 1 -- 172.21.15.12:0/2377183746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6358013770 con 0x7f6368069ef0 2023-07-07T18:16:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.270+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63680c8360 con 0x7f6368069ef0 2023-07-07T18:16:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.270+0000 7f6356ffd700 1 -- 172.21.15.12:0/2377183746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358013b20 con 0x7f6368069ef0 2023-07-07T18:16:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.270+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63680c7d90 con 0x7f6368069ef0 2023-07-07T18:16:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.271+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6368073910 con 0x7f6368069ef0 2023-07-07T18:16:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.271+0000 7f6356ffd700 1 -- 172.21.15.12:0/2377183746 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6358013c80 con 0x7f6368069ef0 2023-07-07T18:16:03.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.272+0000 7f6356ffd700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f634806ace0 0x7f634806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.272+0000 7f6356ffd700 1 -- 172.21.15.12:0/2377183746 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6358088e10 con 0x7f6368069ef0 2023-07-07T18:16:03.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.272+0000 7f6365d9b700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f634806ace0 0x7f634806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.272+0000 7f6365d9b700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f634806ace0 0x7f634806d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f63681e6420 tx=0x7f635c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:03.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.276+0000 7f6356ffd700 1 -- 172.21.15.12:0/2377183746 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6358057b60 con 0x7f6368069ef0 2023-07-07T18:16:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.551+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f63681593a0 con 0x7f6368069ef0 2023-07-07T18:16:03.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.552+0000 7f6356ffd700 1 -- 172.21.15.12:0/2377183746 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f63580576f0 con 0x7f6368069ef0 2023-07-07T18:16:03.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:03.554 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-07-07T18:16:03.554 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-07-07T18:16:03.554 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.554 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-07-07T18:16:03.554 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDaVahkEwmXMxAA0N67oUjM+lo9lCbJy2LOhQ==", 2023-07-07T18:16:03.554 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.554 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-07-07T18:16:03.555 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-07-07T18:16:03.555 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-07-07T18:16:03.555 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.555 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.555 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.555 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.555 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-07-07T18:16:03.555 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDbVahkUgCdBBAAsYJlTiGSOT1EFE8yyQ9NHw==", 2023-07-07T18:16:03.556 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.556 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-07-07T18:16:03.556 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-07-07T18:16:03.556 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-07-07T18:16:03.556 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.556 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.556 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.557 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.557 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-07-07T18:16:03.557 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDaVahkQX84OxAArGJ7gx3jDV4oMj7EqAE3YQ==", 2023-07-07T18:16:03.557 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.557 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-07-07T18:16:03.557 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-07-07T18:16:03.557 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-07-07T18:16:03.557 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.558 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.558 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.558 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.558 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-07-07T18:16:03.558 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDbVahkz+rmCxAAMUjWCjf38RicKatpjIKVjg==", 2023-07-07T18:16:03.558 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.558 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-07-07T18:16:03.558 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-07-07T18:16:03.559 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-07-07T18:16:03.559 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.559 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.559 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.559 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.559 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-07-07T18:16:03.559 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDeVahkDD0+KhAAWgslZQ2Y3JWKvAYpk+PSwQ==", 2023-07-07T18:16:03.560 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.560 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-07-07T18:16:03.560 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-07-07T18:16:03.560 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.560 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.560 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.560 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.560 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-07-07T18:16:03.561 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDhVahkmj8xKxAAwogMNCf5P5YhfAypyUSV8w==", 2023-07-07T18:16:03.561 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.561 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-07-07T18:16:03.561 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-07-07T18:16:03.561 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.561 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.561 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.561 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.562 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-07-07T18:16:03.562 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDkVahkQEd6LRAA5M6fmo+oZkj3ht26aZtYlg==", 2023-07-07T18:16:03.562 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.562 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-07-07T18:16:03.562 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-07-07T18:16:03.562 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.562 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.562 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.563 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.563 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-07-07T18:16:03.563 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDnVahk7gWDLxAAV5tSWaQSP+ZaqeI4eIzmZg==", 2023-07-07T18:16:03.563 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.563 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-07-07T18:16:03.563 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-07-07T18:16:03.563 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.564 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.564 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.564 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.564 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-07-07T18:16:03.564 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDtVahk+D2wNhAAKj7cFwIijeo7aRzeKXk4vg==", 2023-07-07T18:16:03.564 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.564 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-07-07T18:16:03.564 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-07-07T18:16:03.565 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.565 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.565 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.565 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.565 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-07-07T18:16:03.565 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDwVahkPEJHNhAAEoZWvD9ezs05l0y4WdbYRg==", 2023-07-07T18:16:03.565 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.565 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-07-07T18:16:03.566 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-07-07T18:16:03.566 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.566 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.566 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.566 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.566 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-07-07T18:16:03.566 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDzVahk4jJKNRAAWAUNxQVvVYrX9nWtEFZL9A==", 2023-07-07T18:16:03.566 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.567 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-07-07T18:16:03.567 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-07-07T18:16:03.567 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.567 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.567 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.567 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.567 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-07-07T18:16:03.568 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD2Vahk/X0bNRAAfBRtuV7Ib2Vj+0oXVjOhSg==", 2023-07-07T18:16:03.568 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.568 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-07-07T18:16:03.568 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-07-07T18:16:03.568 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.568 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.569 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-07-07T18:16:03.569 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDbVahk/qJ+EBAAyWYDEbqpYZz+0Etm6L8jmQ==", 2023-07-07T18:16:03.569 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.569 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-07-07T18:16:03.569 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-07-07T18:16:03.569 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-07-07T18:16:03.569 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-07-07T18:16:03.569 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.570 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.570 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.570 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-07-07T18:16:03.570 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDbVahkhLSTFxAAoynbRXnwI3XHNW+VbjxZTg==", 2023-07-07T18:16:03.570 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.570 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-07-07T18:16:03.570 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-07-07T18:16:03.570 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-07-07T18:16:03.571 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-07-07T18:16:03.571 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.571 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.571 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.571 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-07-07T18:16:03.571 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDbVahkjrUmFBAANC465Dp1j+deGsLyjOPZog==", 2023-07-07T18:16:03.571 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.571 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-07-07T18:16:03.572 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-07-07T18:16:03.572 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-07-07T18:16:03.572 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-07-07T18:16:03.572 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.572 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.572 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.572 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-07-07T18:16:03.573 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDbVahkKNBSHRAA3Fuays/RfZh9749Nvumb2w==", 2023-07-07T18:16:03.573 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.573 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-07-07T18:16:03.573 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-07-07T18:16:03.573 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-07-07T18:16:03.573 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-07-07T18:16:03.573 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.573 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.574 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.574 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-07-07T18:16:03.574 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg==", 2023-07-07T18:16:03.574 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.574 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-07-07T18:16:03.574 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-07-07T18:16:03.574 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-07-07T18:16:03.574 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.575 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.575 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.575 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mds", 2023-07-07T18:16:03.575 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD8VahkuHYTNhAA61mKZO8/YQfX4gVkJHUE3w==", 2023-07-07T18:16:03.575 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.575 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mds" 2023-07-07T18:16:03.575 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.576 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.576 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.576 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mgr", 2023-07-07T18:16:03.576 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD8VahkuH8TNhAAKCeKbuVmdrUq8uSvdpUsgg==", 2023-07-07T18:16:03.576 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.576 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-07T18:16:03.576 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.577 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.577 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-osd", 2023-07-07T18:16:03.577 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD8VahkfYcTNhAA33NFc8U2X4L06TLTnIPMXA==", 2023-07-07T18:16:03.577 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.577 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-osd" 2023-07-07T18:16:03.577 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.577 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.578 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd", 2023-07-07T18:16:03.578 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD8VahkHY8TNhAAVg+kcii4g1BtSgYgrahTnw==", 2023-07-07T18:16:03.578 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.578 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-07T18:16:03.578 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.578 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.578 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.579 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-07T18:16:03.579 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD8VahkFJcTNhAA+xsZprgFCAZGrnkmDYrKnw==", 2023-07-07T18:16:03.579 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.579 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-07T18:16:03.579 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.579 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.579 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.579 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rgw", 2023-07-07T18:16:03.580 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD8VahkhZ8TNhAA0Kxy2SloRL/4H6Fu/Mt2PQ==", 2023-07-07T18:16:03.580 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.580 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-07T18:16:03.580 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.580 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.580 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.580 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-07-07T18:16:03.581 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDaVahkat8CMBAAaic8I//8rMHdbP11gJ/AAg==", 2023-07-07T18:16:03.581 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.581 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-07-07T18:16:03.581 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-07-07T18:16:03.581 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.581 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.581 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:03.581 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:03.582 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-07-07T18:16:03.582 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDaVahkQgg0LBAA4sTfWRn0DxADMGvqxTcWVQ==", 2023-07-07T18:16:03.582 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-07-07T18:16:03.582 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-07-07T18:16:03.582 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-07-07T18:16:03.582 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-07-07T18:16:03.582 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.582 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:03.583 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-07-07T18:16:03.583 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-07-07T18:16:03.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f634806ace0 msgr2=0x7f634806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f634806ace0 0x7f634806d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f63681e6420 tx=0x7f635c008040 comp rx=0 tx=0).stop 2023-07-07T18:16:03.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 msgr2=0x7f63680c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 0x7f63680c7850 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f635800e760 tx=0x7f635800eb20 comp rx=0 tx=0).stop 2023-07-07T18:16:03.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 shutdown_connections 2023-07-07T18:16:03.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f634806ace0 0x7f634806d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636815a0c0 0x7f6368154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6368069ef0 0x7f63680c7850 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 --2- 172.21.15.12:0/2377183746 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63680c8ce0 0x7f636815b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 >> 172.21.15.12:0/2377183746 conn(0x7f63680b0ef0 msgr2=0x7f6368157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:03.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 shutdown_connections 2023-07-07T18:16:03.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.555+0000 7f636c97a700 1 -- 172.21.15.12:0/2377183746 wait complete. 2023-07-07T18:16:03.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-07T18:16:03.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.714+0000 7ff473e65700 1 Processor -- start 2023-07-07T18:16:03.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.715+0000 7ff473e65700 1 -- start start 2023-07-07T18:16:03.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff473e65700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff46c0b06d0 0x7ff46c0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff473e65700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff46c15a440 0x7ff46c0af260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff473e65700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c06aca0 con 0x7ff46c15a070 2023-07-07T18:16:03.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff473e65700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c06a090 con 0x7ff46c15a440 2023-07-07T18:16:03.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff473e65700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c06a370 con 0x7ff46c0b06d0 2023-07-07T18:16:03.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff471c01700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff46c15a070 0x7ff46c0d00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56372/0 (socket says 172.21.15.12:56372) 2023-07-07T18:16:03.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff471c01700 1 -- 172.21.15.12:0/940387147 learned_addr learned my addr 172.21.15.12:0/940387147 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff472402700 1 --2- 172.21.15.12:0/940387147 >> v2:172.21.15.12:3300/0 conn(0x7ff46c15a440 0x7ff46c0af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff471400700 1 --2- 172.21.15.12:0/940387147 >> v2:172.21.15.160:3300/0 conn(0x7ff46c0b06d0 0x7ff46c0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff470bff700 1 -- 172.21.15.12:0/940387147 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791396762 0 0) 0x7ff46c06aca0 con 0x7ff46c15a070 2023-07-07T18:16:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff470bff700 1 -- 172.21.15.12:0/940387147 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4580035b0 con 0x7ff46c15a070 2023-07-07T18:16:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff472402700 1 -- 172.21.15.12:0/940387147 >> v2:172.21.15.160:3300/0 conn(0x7ff46c0b06d0 msgr2=0x7ff46c0aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff472402700 1 --2- 172.21.15.12:0/940387147 >> v2:172.21.15.160:3300/0 conn(0x7ff46c0b06d0 0x7ff46c0aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff472402700 1 -- 172.21.15.12:0/940387147 >> v1:172.21.15.12:6789/0 conn(0x7ff46c15a070 legacy=0x7ff46c0d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.716+0000 7ff472402700 1 -- 172.21.15.12:0/940387147 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c06a650 con 0x7ff46c15a440 2023-07-07T18:16:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.717+0000 7ff472402700 1 --2- 172.21.15.12:0/940387147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c15a440 0x7ff46c0af260 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0721f0 tx=0x7ff46400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a771be999b72c71 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.717+0000 7ff470bff700 1 -- 172.21.15.12:0/940387147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400e070 con 0x7ff46c15a440 2023-07-07T18:16:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.717+0000 7ff470bff700 1 -- 172.21.15.12:0/940387147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400bb20 con 0x7ff46c15a440 2023-07-07T18:16:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.717+0000 7ff470bff700 1 -- 172.21.15.12:0/940387147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464012430 con 0x7ff46c15a440 2023-07-07T18:16:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.717+0000 7ff473e65700 1 -- 172.21.15.12:0/940387147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c15a440 msgr2=0x7ff46c0af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.717+0000 7ff473e65700 1 --2- 172.21.15.12:0/940387147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c15a440 0x7ff46c0af260 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0721f0 tx=0x7ff46400b330 comp rx=0 tx=0).stop 2023-07-07T18:16:03.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.718+0000 7ff473e65700 1 -- 172.21.15.12:0/940387147 shutdown_connections 2023-07-07T18:16:03.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.718+0000 7ff473e65700 1 --2- 172.21.15.12:0/940387147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c15a440 0x7ff46c0af260 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.718+0000 7ff473e65700 1 --2- 172.21.15.12:0/940387147 >> v2:172.21.15.160:3300/0 conn(0x7ff46c0b06d0 0x7ff46c0aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.718+0000 7ff473e65700 1 -- 172.21.15.12:0/940387147 >> 172.21.15.12:0/940387147 conn(0x7ff46c06b920 msgr2=0x7ff46c0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:03.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.718+0000 7ff473e65700 1 -- 172.21.15.12:0/940387147 shutdown_connections 2023-07-07T18:16:03.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.718+0000 7ff473e65700 1 -- 172.21.15.12:0/940387147 wait complete. 2023-07-07T18:16:03.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.719+0000 7ff473e65700 1 Processor -- start 2023-07-07T18:16:03.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.719+0000 7ff473e65700 1 -- start start 2023-07-07T18:16:03.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff473e65700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c0b06d0 0x7ff46c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff473e65700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff46c15a070 0x7ff46c0c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff473e65700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff46c15a440 0x7ff46c15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff473e65700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c159320 con 0x7ff46c0b06d0 2023-07-07T18:16:03.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff473e65700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c15b5a0 con 0x7ff46c15a440 2023-07-07T18:16:03.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff473e65700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c158710 con 0x7ff46c15a070 2023-07-07T18:16:03.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471c01700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c0b06d0 0x7ff46c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471c01700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c0b06d0 0x7ff46c157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59180/0 (socket says 172.21.15.12:59180) 2023-07-07T18:16:03.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471c01700 1 -- 172.21.15.12:0/4179776606 learned_addr learned my addr 172.21.15.12:0/4179776606 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:03.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471400700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff46c15a070 0x7ff46c0c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff472402700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff46c15a440 0x7ff46c15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471c01700 1 -- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff46c15a070 msgr2=0x7ff46c0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471c01700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff46c15a070 0x7ff46c0c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471c01700 1 -- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff46c15a440 msgr2=0x7ff46c15ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:03.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471c01700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff46c15a440 0x7ff46c15ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:03.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471c01700 1 -- 172.21.15.12:0/4179776606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff464009a70 con 0x7ff46c0b06d0 2023-07-07T18:16:03.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff471c01700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c0b06d0 0x7ff46c157ee0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff46800c700 tx=0x7ff46800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:03.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.720+0000 7ff4627fc700 1 -- 172.21.15.12:0/4179776606 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468005d70 con 0x7ff46c0b06d0 2023-07-07T18:16:03.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.721+0000 7ff4627fc700 1 -- 172.21.15.12:0/4179776606 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4680070d0 con 0x7ff46c0b06d0 2023-07-07T18:16:03.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.721+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c1589f0 con 0x7ff46c0b06d0 2023-07-07T18:16:03.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.721+0000 7ff4627fc700 1 -- 172.21.15.12:0/4179776606 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468007460 con 0x7ff46c0b06d0 2023-07-07T18:16:03.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.721+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c158fb0 con 0x7ff46c0b06d0 2023-07-07T18:16:03.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.722+0000 7ff4627fc700 1 -- 172.21.15.12:0/4179776606 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4680075c0 con 0x7ff46c0b06d0 2023-07-07T18:16:03.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.722+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c073910 con 0x7ff46c0b06d0 2023-07-07T18:16:03.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.722+0000 7ff4627fc700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff45006ace0 0x7ff45006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:03.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.722+0000 7ff4627fc700 1 -- 172.21.15.12:0/4179776606 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff4680888e0 con 0x7ff46c0b06d0 2023-07-07T18:16:03.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.723+0000 7ff471400700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff45006ace0 0x7ff45006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:03.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.723+0000 7ff471400700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff45006ace0 0x7ff45006d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0d03a0 tx=0x7ff45c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:03.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:03.727+0000 7ff4627fc700 1 -- 172.21.15.12:0/4179776606 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff468053bb0 con 0x7ff46c0b06d0 2023-07-07T18:16:04.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.009+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff46c1e3c30 con 0x7ff46c0b06d0 2023-07-07T18:16:04.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.012+0000 7ff4627fc700 1 -- 172.21.15.12:0/4179776606 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff4680571d0 con 0x7ff46c0b06d0 2023-07-07T18:16:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff45006ace0 msgr2=0x7ff45006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff45006ace0 0x7ff45006d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff46c0d03a0 tx=0x7ff45c008040 comp rx=0 tx=0).stop 2023-07-07T18:16:04.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c0b06d0 msgr2=0x7ff46c157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c0b06d0 0x7ff46c157ee0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff46800c700 tx=0x7ff46800cac0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 shutdown_connections 2023-07-07T18:16:04.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff45006ace0 0x7ff45006d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff46c15a440 0x7ff46c15ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff46c0b06d0 0x7ff46c157ee0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 --2- 172.21.15.12:0/4179776606 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff46c15a070 0x7ff46c0c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 >> 172.21.15.12:0/4179776606 conn(0x7ff46c06b920 msgr2=0x7ff46c06db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:04.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.014+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 shutdown_connections 2023-07-07T18:16:04.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.015+0000 7ff473e65700 1 -- 172.21.15.12:0/4179776606 wait complete. 2023-07-07T18:16:04.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-07T18:16:04.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.156+0000 7f1450147700 1 Processor -- start 2023-07-07T18:16:04.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.156+0000 7f1450147700 1 -- start start 2023-07-07T18:16:04.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.157+0000 7f1450147700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f144806c2c0 0x7f14480d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.157+0000 7f1450147700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14480afdb0 con 0x7f144815c2e0 2023-07-07T18:16:04.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.157+0000 7f1450147700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144815c6b0 con 0x7f144806ccc0 2023-07-07T18:16:04.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.157+0000 7f1450147700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14480ceb90 con 0x7f144806c2c0 2023-07-07T18:16:04.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.157+0000 7f144dee3700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f144815c2e0 0x7f14480ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56386/0 (socket says 172.21.15.12:56386) 2023-07-07T18:16:04.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.157+0000 7f144dee3700 1 -- 172.21.15.12:0/3529978953 learned_addr learned my addr 172.21.15.12:0/3529978953 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:04.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.157+0000 7f144e6e4700 1 --2- 172.21.15.12:0/3529978953 >> v2:172.21.15.160:3300/0 conn(0x7f144806c2c0 0x7f14480d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.157+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929990987 0 0) 0x7f14480afdb0 con 0x7f144815c2e0 2023-07-07T18:16:04.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.157+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14340035b0 con 0x7f144815c2e0 2023-07-07T18:16:04.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 560132183 0 0) 0x7f14340035b0 con 0x7f144815c2e0 2023-07-07T18:16:04.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 >> v2:172.21.15.160:3300/0 conn(0x7f144806c2c0 msgr2=0x7f14480d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:04.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 --2- 172.21.15.12:0/3529978953 >> v2:172.21.15.160:3300/0 conn(0x7f144806c2c0 0x7f14480d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 >> v1:172.21.15.160:6789/0 conn(0x7f144806ccc0 legacy=0x7f144815fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480b0000 con 0x7f144815c2e0 2023-07-07T18:16:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f1438001670 con 0x7f144815c2e0 2023-07-07T18:16:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 >> v1:172.21.15.12:6789/0 conn(0x7f144815c2e0 legacy=0x7f14480ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1434003a00 0x7f1434003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1434004850 0x7f1434004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1434005200 0x7f143400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14480ceb90 con 0x7f1434005200 2023-07-07T18:16:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143400c190 con 0x7f1434003a00 2023-07-07T18:16:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143400c350 con 0x7f1434004850 2023-07-07T18:16:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144e6e4700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1434005200 0x7f143400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144dee3700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1434003a00 0x7f1434003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144d6e2700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1434004850 0x7f1434004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144e6e4700 1 -- 172.21.15.12:0/3529978953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1434004850 msgr2=0x7f1434004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144e6e4700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1434004850 0x7f1434004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144e6e4700 1 -- 172.21.15.12:0/3529978953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1434003a00 msgr2=0x7f1434003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144e6e4700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1434003a00 0x7f1434003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144e6e4700 1 -- 172.21.15.12:0/3529978953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340035b0 con 0x7f1434005200 2023-07-07T18:16:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144d6e2700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1434004850 0x7f1434004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144e6e4700 1 -- 172.21.15.12:0/3529978953 reap_dead start 2023-07-07T18:16:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.158+0000 7f144e6e4700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1434005200 0x7f143400ba10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1440009f90 tx=0x7f1434005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be97218e6e02149 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440003a20 con 0x7f1434005200 2023-07-07T18:16:04.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144000f040 con 0x7f1434005200 2023-07-07T18:16:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f144cee1700 1 -- 172.21.15.12:0/3529978953 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440003dc0 con 0x7f1434005200 2023-07-07T18:16:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f1450147700 1 -- 172.21.15.12:0/3529978953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1434005200 msgr2=0x7f143400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f1450147700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1434005200 0x7f143400ba10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1440009f90 tx=0x7f1434005880 comp rx=0 tx=0).stop 2023-07-07T18:16:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f1450147700 1 -- 172.21.15.12:0/3529978953 shutdown_connections 2023-07-07T18:16:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f1450147700 1 --2- 172.21.15.12:0/3529978953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1434005200 0x7f143400ba10 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f1450147700 1 -- 172.21.15.12:0/3529978953 >> 172.21.15.12:0/3529978953 conn(0x7f144806e530 msgr2=0x7f144806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f1450147700 1 -- 172.21.15.12:0/3529978953 shutdown_connections 2023-07-07T18:16:04.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.159+0000 7f1450147700 1 -- 172.21.15.12:0/3529978953 wait complete. 2023-07-07T18:16:04.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.161+0000 7f1450147700 1 Processor -- start 2023-07-07T18:16:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.161+0000 7f1450147700 1 -- start start 2023-07-07T18:16:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.161+0000 7f1450147700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1434005200 0x7f144814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.161+0000 7f1450147700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14481f13d0 0x7f14481f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.161+0000 7f1450147700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14481f2200 0x7f14481f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f1450147700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144814b810 con 0x7f14481f2200 2023-07-07T18:16:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f1450147700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14481e52c0 con 0x7f1434005200 2023-07-07T18:16:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f1450147700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14481f1d80 con 0x7f14481f13d0 2023-07-07T18:16:04.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144e6e4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14481f2200 0x7f14481f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144e6e4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14481f2200 0x7f14481f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59204/0 (socket says 172.21.15.12:59204) 2023-07-07T18:16:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144e6e4700 1 -- 172.21.15.12:0/3461830427 learned_addr learned my addr 172.21.15.12:0/3461830427 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144dee3700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1434005200 0x7f144814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144d6e2700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14481f13d0 0x7f14481f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144e6e4700 1 -- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14481f13d0 msgr2=0x7f14481f1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144e6e4700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14481f13d0 0x7f14481f1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144e6e4700 1 -- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1434005200 msgr2=0x7f144814ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144e6e4700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1434005200 0x7f144814ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144e6e4700 1 -- 172.21.15.12:0/3461830427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14481e46b0 con 0x7f14481f2200 2023-07-07T18:16:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f144e6e4700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14481f2200 0x7f14481f26a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f144000e700 tx=0x7f1440004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f143e7fc700 1 -- 172.21.15.12:0/3461830427 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440003e10 con 0x7f14481f2200 2023-07-07T18:16:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f143e7fc700 1 -- 172.21.15.12:0/3461830427 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1440004230 con 0x7f14481f2200 2023-07-07T18:16:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14481e4990 con 0x7f14481f2200 2023-07-07T18:16:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f143e7fc700 1 -- 172.21.15.12:0/3461830427 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400045e0 con 0x7f14481f2200 2023-07-07T18:16:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.162+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14481e4f50 con 0x7f14481f2200 2023-07-07T18:16:04.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.163+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14481e5450 con 0x7f14481f2200 2023-07-07T18:16:04.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.164+0000 7f143e7fc700 1 -- 172.21.15.12:0/3461830427 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1440004740 con 0x7f14481f2200 2023-07-07T18:16:04.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.164+0000 7f143e7fc700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f142c06ace0 0x7f142c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.165+0000 7f143e7fc700 1 -- 172.21.15.12:0/3461830427 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f144008a440 con 0x7f14481f2200 2023-07-07T18:16:04.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.165+0000 7f144dee3700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f142c06ace0 0x7f142c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.165+0000 7f144dee3700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f142c06ace0 0x7f142c06d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f144806f3e0 tx=0x7f1438001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:04.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.169+0000 7f143e7fc700 1 -- 172.21.15.12:0/3461830427 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f14400558b0 con 0x7f14481f2200 2023-07-07T18:16:04.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.448+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f14480ccfa0 con 0x7f14481f2200 2023-07-07T18:16:04.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.452+0000 7f143e7fc700 1 -- 172.21.15.12:0/3461830427 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1440058ed0 con 0x7f14481f2200 2023-07-07T18:16:04.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f142c06ace0 msgr2=0x7f142c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f142c06ace0 0x7f142c06d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f144806f3e0 tx=0x7f1438001430 comp rx=0 tx=0).stop 2023-07-07T18:16:04.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14481f2200 msgr2=0x7f14481f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14481f2200 0x7f14481f26a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f144000e700 tx=0x7f1440004b40 comp rx=0 tx=0).stop 2023-07-07T18:16:04.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 shutdown_connections 2023-07-07T18:16:04.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f142c06ace0 0x7f142c06d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14481f2200 0x7f14481f26a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1434005200 0x7f144814ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 --2- 172.21.15.12:0/3461830427 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14481f13d0 0x7f14481f1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 >> 172.21.15.12:0/3461830427 conn(0x7f144806e530 msgr2=0x7f144806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:04.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 shutdown_connections 2023-07-07T18:16:04.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.456+0000 7f1450147700 1 -- 172.21.15.12:0/3461830427 wait complete. 2023-07-07T18:16:04.469 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-07T18:16:04.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.595+0000 7f5e7ae42700 1 Processor -- start 2023-07-07T18:16:04.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.595+0000 7f5e7ae42700 1 -- start start 2023-07-07T18:16:04.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.596+0000 7f5e7ae42700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e7415a820 0x7f5e740caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.596+0000 7f5e7ae42700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5e740d0f80 0x7f5e740ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.596+0000 7f5e7ae42700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e740cfa60 con 0x7f5e740d0b00 2023-07-07T18:16:04.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.596+0000 7f5e7ae42700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e74154a80 con 0x7f5e7415a820 2023-07-07T18:16:04.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.596+0000 7f5e7ae42700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740cfd40 con 0x7f5e740d0f80 2023-07-07T18:16:04.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e78bde700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e7415a820 0x7f5e740caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e73fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5e740d0b00 0x7f5e7415abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56406/0 (socket says 172.21.15.12:56406) 2023-07-07T18:16:04.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e73fff700 1 -- 172.21.15.12:0/66132420 learned_addr learned my addr 172.21.15.12:0/66132420 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:04.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e78bde700 1 -- 172.21.15.12:0/66132420 >> v2:172.21.15.160:3300/0 conn(0x7f5e740d0f80 msgr2=0x7f5e740ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:04.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e793df700 1 --2- 172.21.15.12:0/66132420 >> v2:172.21.15.160:3300/0 conn(0x7f5e740d0f80 0x7f5e740ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e78bde700 1 --2- 172.21.15.12:0/66132420 >> v2:172.21.15.160:3300/0 conn(0x7f5e740d0f80 0x7f5e740ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e78bde700 1 -- 172.21.15.12:0/66132420 >> v1:172.21.15.12:6789/0 conn(0x7f5e740d0b00 legacy=0x7f5e7415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e737fe700 1 -- 172.21.15.12:0/66132420 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104662936 0 0) 0x7f5e740cfa60 con 0x7f5e740d0b00 2023-07-07T18:16:04.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e78bde700 1 -- 172.21.15.12:0/66132420 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e740d0020 con 0x7f5e7415a820 2023-07-07T18:16:04.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e793df700 1 --2- 172.21.15.12:0/66132420 >> v2:172.21.15.160:3300/0 conn(0x7f5e740d0f80 0x7f5e740ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:16:04.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.597+0000 7f5e78bde700 1 --2- 172.21.15.12:0/66132420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415a820 0x7f5e740caf00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5e7406f5d0 tx=0x7f5e68009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c8252522de083b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:04.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e737fe700 1 -- 172.21.15.12:0/66132420 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68011830 con 0x7f5e7415a820 2023-07-07T18:16:04.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e737fe700 1 -- 172.21.15.12:0/66132420 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68011990 con 0x7f5e7415a820 2023-07-07T18:16:04.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e737fe700 1 -- 172.21.15.12:0/66132420 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68011d20 con 0x7f5e7415a820 2023-07-07T18:16:04.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e7ae42700 1 -- 172.21.15.12:0/66132420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415a820 msgr2=0x7f5e740caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e7ae42700 1 --2- 172.21.15.12:0/66132420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415a820 0x7f5e740caf00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5e7406f5d0 tx=0x7f5e68009b20 comp rx=0 tx=0).stop 2023-07-07T18:16:04.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e7ae42700 1 -- 172.21.15.12:0/66132420 shutdown_connections 2023-07-07T18:16:04.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e7ae42700 1 --2- 172.21.15.12:0/66132420 >> v2:172.21.15.160:3300/0 conn(0x7f5e740d0f80 0x7f5e740ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e7ae42700 1 --2- 172.21.15.12:0/66132420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415a820 0x7f5e740caf00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e7ae42700 1 -- 172.21.15.12:0/66132420 >> 172.21.15.12:0/66132420 conn(0x7f5e7406e530 msgr2=0x7f5e7406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:04.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e7ae42700 1 -- 172.21.15.12:0/66132420 shutdown_connections 2023-07-07T18:16:04.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.598+0000 7f5e7ae42700 1 -- 172.21.15.12:0/66132420 wait complete. 2023-07-07T18:16:04.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.600+0000 7f5e7ae42700 1 Processor -- start 2023-07-07T18:16:04.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.600+0000 7f5e7ae42700 1 -- start start 2023-07-07T18:16:04.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.600+0000 7f5e7ae42700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e740d0b00 0x7f5e74159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.600+0000 7f5e7ae42700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e740d0f80 0x7f5e74153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.600+0000 7f5e7ae42700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e7415a820 0x7f5e741539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e7ae42700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7406bde0 con 0x7f5e740d0f80 2023-07-07T18:16:04.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e7ae42700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74153ef0 con 0x7f5e740d0b00 2023-07-07T18:16:04.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e7ae42700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7406b1a0 con 0x7f5e7415a820 2023-07-07T18:16:04.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e73fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e740d0f80 0x7f5e74153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e73fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e740d0f80 0x7f5e74153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59216/0 (socket says 172.21.15.12:59216) 2023-07-07T18:16:04.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e73fff700 1 -- 172.21.15.12:0/3648076664 learned_addr learned my addr 172.21.15.12:0/3648076664 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:04.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e78bde700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e740d0b00 0x7f5e74159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e793df700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e7415a820 0x7f5e741539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e73fff700 1 -- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e7415a820 msgr2=0x7f5e741539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e73fff700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e7415a820 0x7f5e741539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e73fff700 1 -- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e740d0b00 msgr2=0x7f5e74159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e73fff700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e740d0b00 0x7f5e74159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e73fff700 1 -- 172.21.15.12:0/3648076664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680094a0 con 0x7f5e740d0f80 2023-07-07T18:16:04.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e73fff700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e740d0f80 0x7f5e74153470 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5e600011e0 tx=0x7f5e6000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:04.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e717fa700 1 -- 172.21.15.12:0/3648076664 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60004c80 con 0x7f5e740d0f80 2023-07-07T18:16:04.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e717fa700 1 -- 172.21.15.12:0/3648076664 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e60004e00 con 0x7f5e740d0f80 2023-07-07T18:16:04.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7406b440 con 0x7f5e740d0f80 2023-07-07T18:16:04.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e717fa700 1 -- 172.21.15.12:0/3648076664 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60007310 con 0x7f5e740d0f80 2023-07-07T18:16:04.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.601+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7406ba00 con 0x7f5e740d0f80 2023-07-07T18:16:04.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.602+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7406bf20 con 0x7f5e740d0f80 2023-07-07T18:16:04.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.603+0000 7f5e717fa700 1 -- 172.21.15.12:0/3648076664 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e60007470 con 0x7f5e740d0f80 2023-07-07T18:16:04.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.603+0000 7f5e717fa700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5e5806ace0 0x7f5e5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.603+0000 7f5e717fa700 1 -- 172.21.15.12:0/3648076664 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5e60088f20 con 0x7f5e740d0f80 2023-07-07T18:16:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.603+0000 7f5e78bde700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5e5806ace0 0x7f5e5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:04.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.604+0000 7f5e78bde700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5e5806ace0 0x7f5e5806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5e680090b0 tx=0x7f5e6801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:04.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.608+0000 7f5e717fa700 1 -- 172.21.15.12:0/3648076664 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e7406bf20 con 0x7f5e740d0f80 2023-07-07T18:16:04.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.885+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5e7406bf20 con 0x7f5e740d0f80 2023-07-07T18:16:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.889+0000 7f5e717fa700 1 -- 172.21.15.12:0/3648076664 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5e7406bf20 con 0x7f5e740d0f80 2023-07-07T18:16:04.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5e5806ace0 msgr2=0x7f5e5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5e5806ace0 0x7f5e5806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5e680090b0 tx=0x7f5e6801c040 comp rx=0 tx=0).stop 2023-07-07T18:16:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e740d0f80 msgr2=0x7f5e74153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e740d0f80 0x7f5e74153470 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5e600011e0 tx=0x7f5e6000ca30 comp rx=0 tx=0).stop 2023-07-07T18:16:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 shutdown_connections 2023-07-07T18:16:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5e5806ace0 0x7f5e5806d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e7415a820 0x7f5e741539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e740d0b00 0x7f5e74159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 --2- 172.21.15.12:0/3648076664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e740d0f80 0x7f5e74153470 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:04.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.891+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 >> 172.21.15.12:0/3648076664 conn(0x7f5e7406e530 msgr2=0x7f5e7415abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:04.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.892+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 shutdown_connections 2023-07-07T18:16:04.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:04.892+0000 7f5e7ae42700 1 -- 172.21.15.12:0/3648076664 wait complete. 2023-07-07T18:16:04.904 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-07T18:16:05.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.031+0000 7ff5ac1e7700 1 Processor -- start 2023-07-07T18:16:05.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.031+0000 7ff5ac1e7700 1 -- start start 2023-07-07T18:16:05.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.032+0000 7ff5ac1e7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a415c2e0 0x7ff5a40ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.032+0000 7ff5ac1e7700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40afdb0 con 0x7ff5a406c2c0 2023-07-07T18:16:05.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.032+0000 7ff5ac1e7700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a415c6b0 con 0x7ff5a406ccc0 2023-07-07T18:16:05.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.032+0000 7ff5ac1e7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40b0000 con 0x7ff5a415c2e0 2023-07-07T18:16:05.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.032+0000 7ff5aa784700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff5a406c2c0 0x7ff5a40d0840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56422/0 (socket says 172.21.15.12:56422) 2023-07-07T18:16:05.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.032+0000 7ff5aa784700 1 -- 172.21.15.12:0/3573393151 learned_addr learned my addr 172.21.15.12:0/3573393151 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.032+0000 7ff5a9f83700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a415c2e0 0x7ff5a40ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.032+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243733029 0 0) 0x7ff5a40afdb0 con 0x7ff5a406c2c0 2023-07-07T18:16:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.032+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5900035b0 con 0x7ff5a406c2c0 2023-07-07T18:16:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 377607107 0 0) 0x7ff5900035b0 con 0x7ff5a406c2c0 2023-07-07T18:16:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a415c2e0 msgr2=0x7ff5a40ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a415c2e0 0x7ff5a40ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 >> v1:172.21.15.160:6789/0 conn(0x7ff5a406ccc0 legacy=0x7ff5a415fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a406ba10 con 0x7ff5a406c2c0 2023-07-07T18:16:05.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7ff59c0019f0 con 0x7ff5a406c2c0 2023-07-07T18:16:05.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 >> v1:172.21.15.12:6789/0 conn(0x7ff5a406c2c0 legacy=0x7ff5a40d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a415c2e0 0x7ff590003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff590003f70 0x7ff590004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590004d90 0x7ff590005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40b0000 con 0x7ff590003f70 2023-07-07T18:16:05.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000bba0 con 0x7ff590004d90 2023-07-07T18:16:05.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59000bd60 con 0x7ff5a415c2e0 2023-07-07T18:16:05.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a9782700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff590003f70 0x7ff590004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a9f83700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a415c2e0 0x7ff590003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5aa784700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590004d90 0x7ff590005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a9782700 1 -- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a415c2e0 msgr2=0x7ff590003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:05.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a9782700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a415c2e0 0x7ff590003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a9782700 1 -- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590004d90 msgr2=0x7ff590005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:05.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a9782700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590004d90 0x7ff590005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a9782700 1 -- 172.21.15.12:0/3573393151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900035b0 con 0x7ff590003f70 2023-07-07T18:16:05.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a9782700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff590003f70 0x7ff590004850 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff5940018d0 tx=0x7ff590005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebfe32954b6aa29 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:05.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400c690 con 0x7ff590003f70 2023-07-07T18:16:05.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.033+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59400c7f0 con 0x7ff590003f70 2023-07-07T18:16:05.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.034+0000 7ff5a8f81700 1 -- 172.21.15.12:0/3573393151 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59400cba0 con 0x7ff590003f70 2023-07-07T18:16:05.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.034+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/3573393151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff590003f70 msgr2=0x7ff590004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.034+0000 7ff5ac1e7700 1 --2- 172.21.15.12:0/3573393151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff590003f70 0x7ff590004850 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff5940018d0 tx=0x7ff590005880 comp rx=0 tx=0).stop 2023-07-07T18:16:05.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.034+0000 7ff5aa784700 1 -- 172.21.15.12:0/3573393151 reap_dead start 2023-07-07T18:16:05.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.034+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/3573393151 shutdown_connections 2023-07-07T18:16:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.034+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/3573393151 >> 172.21.15.12:0/3573393151 conn(0x7ff5a406e530 msgr2=0x7ff5a406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.034+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/3573393151 shutdown_connections 2023-07-07T18:16:05.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.034+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/3573393151 wait complete. 2023-07-07T18:16:05.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.035+0000 7ff5ac1e7700 1 Processor -- start 2023-07-07T18:16:05.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.035+0000 7ff5ac1e7700 1 -- start start 2023-07-07T18:16:05.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.036+0000 7ff5ac1e7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590003f70 0x7ff5a40c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.036+0000 7ff5ac1e7700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a40c6e70 0x7ff5a414cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.036+0000 7ff5ac1e7700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5a40c72e0 0x7ff5a41f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.036+0000 7ff5ac1e7700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40c7750 con 0x7ff5a40c72e0 2023-07-07T18:16:05.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.036+0000 7ff5ac1e7700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a415a220 con 0x7ff590003f70 2023-07-07T18:16:05.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.036+0000 7ff5ac1e7700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a415a500 con 0x7ff5a40c6e70 2023-07-07T18:16:05.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.036+0000 7ff5aa784700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5a40c72e0 0x7ff5a41f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.036+0000 7ff5aa784700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5a40c72e0 0x7ff5a41f1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59236/0 (socket says 172.21.15.12:59236) 2023-07-07T18:16:05.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.036+0000 7ff5aa784700 1 -- 172.21.15.12:0/4083746751 learned_addr learned my addr 172.21.15.12:0/4083746751 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:05.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5a9f83700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590003f70 0x7ff5a40c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5a9782700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a40c6e70 0x7ff5a414cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5aa784700 1 -- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a40c6e70 msgr2=0x7ff5a414cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5aa784700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a40c6e70 0x7ff5a414cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5aa784700 1 -- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590003f70 msgr2=0x7ff5a40c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5aa784700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590003f70 0x7ff5a40c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5aa784700 1 -- 172.21.15.12:0/4083746751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a415a7e0 con 0x7ff5a40c72e0 2023-07-07T18:16:05.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5a9782700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a40c6e70 0x7ff5a414cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:16:05.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5aa784700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5a40c72e0 0x7ff5a41f1bb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff5a406fa70 tx=0x7ff59c00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:05.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff59a7fc700 1 -- 172.21.15.12:0/4083746751 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c00adb0 con 0x7ff5a40c72e0 2023-07-07T18:16:05.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff59a7fc700 1 -- 172.21.15.12:0/4083746751 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c0133f0 con 0x7ff5a40c72e0 2023-07-07T18:16:05.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff59a7fc700 1 -- 172.21.15.12:0/4083746751 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0137a0 con 0x7ff5a40c72e0 2023-07-07T18:16:05.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a415aac0 con 0x7ff5a40c72e0 2023-07-07T18:16:05.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.037+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a41f20f0 con 0x7ff5a40c72e0 2023-07-07T18:16:05.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.038+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a415acb0 con 0x7ff5a40c72e0 2023-07-07T18:16:05.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.038+0000 7ff59a7fc700 1 -- 172.21.15.12:0/4083746751 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff59c013900 con 0x7ff5a40c72e0 2023-07-07T18:16:05.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.039+0000 7ff59a7fc700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff58806ace0 0x7ff58806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.039+0000 7ff59a7fc700 1 -- 172.21.15.12:0/4083746751 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff59c089dc0 con 0x7ff5a40c72e0 2023-07-07T18:16:05.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.039+0000 7ff5a9f83700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff58806ace0 0x7ff58806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.040+0000 7ff5a9f83700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff58806ace0 0x7ff58806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009ba0 tx=0x7ff5a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:05.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.044+0000 7ff59a7fc700 1 -- 172.21.15.12:0/4083746751 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff59c055110 con 0x7ff5a40c72e0 2023-07-07T18:16:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.324+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff5a4073910 con 0x7ff5a40c72e0 2023-07-07T18:16:05.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.328+0000 7ff59a7fc700 1 -- 172.21.15.12:0/4083746751 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff59c017070 con 0x7ff5a40c72e0 2023-07-07T18:16:05.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff58806ace0 msgr2=0x7ff58806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff58806ace0 0x7ff58806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009ba0 tx=0x7ff5a0008040 comp rx=0 tx=0).stop 2023-07-07T18:16:05.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5a40c72e0 msgr2=0x7ff5a41f1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5a40c72e0 0x7ff5a41f1bb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff5a406fa70 tx=0x7ff59c00a640 comp rx=0 tx=0).stop 2023-07-07T18:16:05.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 shutdown_connections 2023-07-07T18:16:05.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff58806ace0 0x7ff58806d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5a40c72e0 0x7ff5a41f1bb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff590003f70 0x7ff5a40c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 --2- 172.21.15.12:0/4083746751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5a40c6e70 0x7ff5a414cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 >> 172.21.15.12:0/4083746751 conn(0x7ff5a406e530 msgr2=0x7ff5a40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:05.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 shutdown_connections 2023-07-07T18:16:05.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.330+0000 7ff5ac1e7700 1 -- 172.21.15.12:0/4083746751 wait complete. 2023-07-07T18:16:05.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-07T18:16:05.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.469+0000 7f01760ed700 1 Processor -- start 2023-07-07T18:16:05.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.469+0000 7f01760ed700 1 -- start start 2023-07-07T18:16:05.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.470+0000 7f01760ed700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0170160a50 0x7f01701674d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.470+0000 7f01760ed700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0170160e70 con 0x7f01700cd830 2023-07-07T18:16:05.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.470+0000 7f01760ed700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01701610a0 con 0x7f017015c570 2023-07-07T18:16:05.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.470+0000 7f01760ed700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017015d670 con 0x7f0170160a50 2023-07-07T18:16:05.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.470+0000 7f016ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0170160a50 0x7f01701674d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.470+0000 7f016effd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f01700cd830 0x7f0170160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56440/0 (socket says 172.21.15.12:56440) 2023-07-07T18:16:05.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.470+0000 7f016effd700 1 -- 172.21.15.12:0/2095216214 learned_addr learned my addr 172.21.15.12:0/2095216214 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:05.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.471+0000 7f016ffff700 1 -- 172.21.15.12:0/2095216214 >> v1:172.21.15.160:6789/0 conn(0x7f017015c570 legacy=0x7f01700cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.471+0000 7f016ffff700 1 -- 172.21.15.12:0/2095216214 >> v1:172.21.15.12:6789/0 conn(0x7f01700cd830 legacy=0x7f0170160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.471+0000 7f016ffff700 1 -- 172.21.15.12:0/2095216214 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017015da90 con 0x7f0170160a50 2023-07-07T18:16:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.471+0000 7f016e7fc700 1 -- 172.21.15.12:0/2095216214 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162595242 0 0) 0x7f0170160e70 con 0x7f01700cd830 2023-07-07T18:16:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.471+0000 7f016ffff700 1 --2- 172.21.15.12:0/2095216214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 0x7f01701674d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0168009840 tx=0x7f0168009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6debb77ce509ba21 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.471+0000 7f016e7fc700 1 -- 172.21.15.12:0/2095216214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168011830 con 0x7f0170160a50 2023-07-07T18:16:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.471+0000 7f016e7fc700 1 -- 172.21.15.12:0/2095216214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0168011990 con 0x7f0170160a50 2023-07-07T18:16:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.471+0000 7f016e7fc700 1 -- 172.21.15.12:0/2095216214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168011d20 con 0x7f0170160a50 2023-07-07T18:16:05.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.472+0000 7f01760ed700 1 -- 172.21.15.12:0/2095216214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 msgr2=0x7f01701674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.472+0000 7f01760ed700 1 --2- 172.21.15.12:0/2095216214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 0x7f01701674d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0168009840 tx=0x7f0168009b50 comp rx=0 tx=0).stop 2023-07-07T18:16:05.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.472+0000 7f01760ed700 1 -- 172.21.15.12:0/2095216214 shutdown_connections 2023-07-07T18:16:05.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.472+0000 7f01760ed700 1 --2- 172.21.15.12:0/2095216214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 0x7f01701674d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.472+0000 7f01760ed700 1 -- 172.21.15.12:0/2095216214 >> 172.21.15.12:0/2095216214 conn(0x7f0170071620 msgr2=0x7f01700719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:05.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.472+0000 7f01760ed700 1 -- 172.21.15.12:0/2095216214 shutdown_connections 2023-07-07T18:16:05.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.472+0000 7f01760ed700 1 -- 172.21.15.12:0/2095216214 wait complete. 2023-07-07T18:16:05.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.474+0000 7f01760ed700 1 Processor -- start 2023-07-07T18:16:05.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.474+0000 7f01760ed700 1 -- start start 2023-07-07T18:16:05.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f01760ed700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cd830 0x7f017014d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f01760ed700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f017015c570 0x7f01700c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f01760ed700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 0x7f01700c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f01760ed700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01700b7320 con 0x7f0170160a50 2023-07-07T18:16:05.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f01760ed700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01700b67a0 con 0x7f017015c570 2023-07-07T18:16:05.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f01760ed700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01700b6a80 con 0x7f01700cd830 2023-07-07T18:16:05.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f016ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 0x7f01700c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f016ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 0x7f01700c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59250/0 (socket says 172.21.15.12:59250) 2023-07-07T18:16:05.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f016ffff700 1 -- 172.21.15.12:0/292206267 learned_addr learned my addr 172.21.15.12:0/292206267 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:05.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f016f7fe700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cd830 0x7f017014d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.475+0000 7f016effd700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f017015c570 0x7f01700c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f016ffff700 1 -- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cd830 msgr2=0x7f017014d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f016ffff700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cd830 0x7f017014d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f016ffff700 1 -- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f017015c570 msgr2=0x7f01700c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f016ffff700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f017015c570 0x7f01700c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f016ffff700 1 -- 172.21.15.12:0/292206267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680094a0 con 0x7f0170160a50 2023-07-07T18:16:05.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f016ffff700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 0x7f01700c8ca0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f01680090b0 tx=0x7f0168004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:05.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f0167fff700 1 -- 172.21.15.12:0/292206267 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016801a860 con 0x7f0170160a50 2023-07-07T18:16:05.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f0167fff700 1 -- 172.21.15.12:0/292206267 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016801a9c0 con 0x7f0170160a50 2023-07-07T18:16:05.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01700b6d60 con 0x7f0170160a50 2023-07-07T18:16:05.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f0167fff700 1 -- 172.21.15.12:0/292206267 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016801ad50 con 0x7f0170160a50 2023-07-07T18:16:05.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.476+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017014d5a0 con 0x7f0170160a50 2023-07-07T18:16:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.477+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0170073910 con 0x7f0170160a50 2023-07-07T18:16:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.478+0000 7f0167fff700 1 -- 172.21.15.12:0/292206267 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0168022070 con 0x7f0170160a50 2023-07-07T18:16:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.478+0000 7f0167fff700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f015006ace0 0x7f015006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.478+0000 7f0167fff700 1 -- 172.21.15.12:0/292206267 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f016808a430 con 0x7f0170160a50 2023-07-07T18:16:05.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.478+0000 7f016f7fe700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f015006ace0 0x7f015006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.479+0000 7f016f7fe700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f015006ace0 0x7f015006d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01600012e0 tx=0x7f0160009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:05.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.483+0000 7f0167fff700 1 -- 172.21.15.12:0/292206267 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0168055780 con 0x7f0170160a50 2023-07-07T18:16:05.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.762+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f01700b88c0 con 0x7f0170160a50 2023-07-07T18:16:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.765+0000 7f0167fff700 1 -- 172.21.15.12:0/292206267 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0168058da0 con 0x7f0170160a50 2023-07-07T18:16:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f015006ace0 msgr2=0x7f015006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f015006ace0 0x7f015006d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01600012e0 tx=0x7f0160009040 comp rx=0 tx=0).stop 2023-07-07T18:16:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 msgr2=0x7f01700c8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 0x7f01700c8ca0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f01680090b0 tx=0x7f0168004750 comp rx=0 tx=0).stop 2023-07-07T18:16:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 shutdown_connections 2023-07-07T18:16:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f015006ace0 0x7f015006d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0170160a50 0x7f01700c8ca0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cd830 0x7f017014d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 --2- 172.21.15.12:0/292206267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f017015c570 0x7f01700c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 >> 172.21.15.12:0/292206267 conn(0x7f0170071620 msgr2=0x7f017015ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 shutdown_connections 2023-07-07T18:16:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.767+0000 7f01760ed700 1 -- 172.21.15.12:0/292206267 wait complete. 2023-07-07T18:16:05.780 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-07T18:16:05.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.906+0000 7efcfa2f9700 1 Processor -- start 2023-07-07T18:16:05.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.906+0000 7efcfa2f9700 1 -- start start 2023-07-07T18:16:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcfa2f9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf415a820 0x7efcf40caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcfa2f9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efcf40d0b00 0x7efcf415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcfa2f9700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf40cfa60 con 0x7efcf40d0f70 2023-07-07T18:16:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcfa2f9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf4154a80 con 0x7efcf40d0b00 2023-07-07T18:16:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcfa2f9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf40cfd40 con 0x7efcf415a820 2023-07-07T18:16:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf415a820 0x7efcf40caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcf37fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efcf40d0b00 0x7efcf415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcf3fff700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf415a820 0x7efcf40caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:48344/0 (socket says 172.21.15.12:48344) 2023-07-07T18:16:05.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcf8896700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7efcf40d0f70 0x7efcf40ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:49694/0 (socket says 172.21.15.12:49694) 2023-07-07T18:16:05.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcf37fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7efcf40d0b00 0x7efcf415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:54860/0 (socket says 172.21.15.12:54860) 2023-07-07T18:16:05.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.907+0000 7efcf3fff700 1 -- 172.21.15.12:0/239402259 learned_addr learned my addr 172.21.15.12:0/239402259 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.908+0000 7efcf3fff700 1 -- 172.21.15.12:0/239402259 >> v2:172.21.15.160:3300/0 conn(0x7efcf40d0b00 msgr2=0x7efcf415abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.908+0000 7efcf3fff700 1 --2- 172.21.15.12:0/239402259 >> v2:172.21.15.160:3300/0 conn(0x7efcf40d0b00 0x7efcf415abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.908+0000 7efcf3fff700 1 -- 172.21.15.12:0/239402259 >> v1:172.21.15.160:6789/0 conn(0x7efcf40d0f70 legacy=0x7efcf40ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.908+0000 7efcf3fff700 1 -- 172.21.15.12:0/239402259 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40d0020 con 0x7efcf415a820 2023-07-07T18:16:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.908+0000 7efcf37fe700 1 --2- 172.21.15.12:0/239402259 >> v2:172.21.15.160:3300/0 conn(0x7efcf40d0b00 0x7efcf415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:16:05.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.908+0000 7efcf3fff700 1 --2- 172.21.15.12:0/239402259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf415a820 0x7efcf40caf00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efce40098f0 tx=0x7efce4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=477968e5c9c712c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:05.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.910+0000 7efcf2ffd700 1 -- 172.21.15.12:0/239402259 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011830 con 0x7efcf415a820 2023-07-07T18:16:05.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.910+0000 7efcf2ffd700 1 -- 172.21.15.12:0/239402259 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce4011990 con 0x7efcf415a820 2023-07-07T18:16:05.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.910+0000 7efcf2ffd700 1 -- 172.21.15.12:0/239402259 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce4011d20 con 0x7efcf415a820 2023-07-07T18:16:05.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.911+0000 7efcfa2f9700 1 -- 172.21.15.12:0/239402259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf415a820 msgr2=0x7efcf40caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.911+0000 7efcfa2f9700 1 --2- 172.21.15.12:0/239402259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf415a820 0x7efcf40caf00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efce40098f0 tx=0x7efce4009c00 comp rx=0 tx=0).stop 2023-07-07T18:16:05.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.911+0000 7efcfa2f9700 1 -- 172.21.15.12:0/239402259 shutdown_connections 2023-07-07T18:16:05.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.911+0000 7efcfa2f9700 1 --2- 172.21.15.12:0/239402259 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf415a820 0x7efcf40caf00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.911+0000 7efcfa2f9700 1 --2- 172.21.15.12:0/239402259 >> v2:172.21.15.160:3300/0 conn(0x7efcf40d0b00 0x7efcf415abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.911+0000 7efcfa2f9700 1 -- 172.21.15.12:0/239402259 >> 172.21.15.12:0/239402259 conn(0x7efcf406e530 msgr2=0x7efcf406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:05.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.911+0000 7efcfa2f9700 1 -- 172.21.15.12:0/239402259 shutdown_connections 2023-07-07T18:16:05.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.911+0000 7efcfa2f9700 1 -- 172.21.15.12:0/239402259 wait complete. 2023-07-07T18:16:05.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.912+0000 7efcfa2f9700 1 Processor -- start 2023-07-07T18:16:05.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcfa2f9700 1 -- start start 2023-07-07T18:16:05.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcfa2f9700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf40d0b00 0x7efcf4147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcfa2f9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcf40d0f70 0x7efcf4158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcfa2f9700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf415a820 0x7efcf4159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcfa2f9700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf4154150 con 0x7efcf415a820 2023-07-07T18:16:05.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcfa2f9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415abf0 con 0x7efcf40d0f70 2023-07-07T18:16:05.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcfa2f9700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf415b490 con 0x7efcf40d0b00 2023-07-07T18:16:05.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcf8896700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf415a820 0x7efcf4159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcf8896700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf415a820 0x7efcf4159510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59262/0 (socket says 172.21.15.12:59262) 2023-07-07T18:16:05.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcf8896700 1 -- 172.21.15.12:0/1051967576 learned_addr learned my addr 172.21.15.12:0/1051967576 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:05.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcf3fff700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf40d0b00 0x7efcf4147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.913+0000 7efcf37fe700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcf40d0f70 0x7efcf4158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcf8896700 1 -- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf40d0b00 msgr2=0x7efcf4147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcf8896700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf40d0b00 0x7efcf4147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcf8896700 1 -- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcf40d0f70 msgr2=0x7efcf4158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:05.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcf8896700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcf40d0f70 0x7efcf4158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:05.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcf8896700 1 -- 172.21.15.12:0/1051967576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce80094a0 con 0x7efcf415a820 2023-07-07T18:16:05.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcf8896700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf415a820 0x7efcf4159510 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efcec00cbd0 tx=0x7efcec00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:05.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcf0ff9700 1 -- 172.21.15.12:0/1051967576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec00aa60 con 0x7efcf415a820 2023-07-07T18:16:05.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcf0ff9700 1 -- 172.21.15.12:0/1051967576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcec00abc0 con 0x7efcf415a820 2023-07-07T18:16:05.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce4009550 con 0x7efcf415a820 2023-07-07T18:16:05.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcf0ff9700 1 -- 172.21.15.12:0/1051967576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcec007070 con 0x7efcf415a820 2023-07-07T18:16:05.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.914+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf406cdb0 con 0x7efcf415a820 2023-07-07T18:16:05.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.915+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf415b600 con 0x7efcf415a820 2023-07-07T18:16:05.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.916+0000 7efcf0ff9700 1 -- 172.21.15.12:0/1051967576 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efcec0071d0 con 0x7efcf415a820 2023-07-07T18:16:05.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.916+0000 7efcf0ff9700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efce006ace0 0x7efce006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:05.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.916+0000 7efcf0ff9700 1 -- 172.21.15.12:0/1051967576 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efcec088f00 con 0x7efcf415a820 2023-07-07T18:16:05.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.916+0000 7efcf3fff700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efce006ace0 0x7efce006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:05.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.917+0000 7efcf3fff700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efce006ace0 0x7efce006d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efce4009c40 tx=0x7efce401e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:05.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:05.920+0000 7efcf0ff9700 1 -- 172.21.15.12:0/1051967576 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efcec0541e0 con 0x7efcf415a820 2023-07-07T18:16:06.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.204+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7efcf4073910 con 0x7efcf415a820 2023-07-07T18:16:06.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.208+0000 7efcf0ff9700 1 -- 172.21.15.12:0/1051967576 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7efcec017030 con 0x7efcf415a820 2023-07-07T18:16:06.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efce006ace0 msgr2=0x7efce006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efce006ace0 0x7efce006d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efce4009c40 tx=0x7efce401e040 comp rx=0 tx=0).stop 2023-07-07T18:16:06.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf415a820 msgr2=0x7efcf4159510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf415a820 0x7efcf4159510 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7efcec00cbd0 tx=0x7efcec00cee0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 shutdown_connections 2023-07-07T18:16:06.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7efce006ace0 0x7efce006d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efcf415a820 0x7efcf4159510 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcf40d0b00 0x7efcf4147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 --2- 172.21.15.12:0/1051967576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcf40d0f70 0x7efcf4158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.210+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 >> 172.21.15.12:0/1051967576 conn(0x7efcf406e530 msgr2=0x7efcf40b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:06.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.211+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 shutdown_connections 2023-07-07T18:16:06.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.211+0000 7efcfa2f9700 1 -- 172.21.15.12:0/1051967576 wait complete. 2023-07-07T18:16:06.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:16:06.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.347+0000 7f5fe7e9b700 1 Processor -- start 2023-07-07T18:16:06.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.348+0000 7f5fe7e9b700 1 -- start start 2023-07-07T18:16:06.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.348+0000 7f5fe7e9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fe015c420 0x7f5fe0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.348+0000 7f5fe7e9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5fe00cae00 0x7f5fe006a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.348+0000 7f5fe7e9b700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00cf2a0 con 0x7f5fe00b08d0 2023-07-07T18:16:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.348+0000 7f5fe7e9b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe00ce690 con 0x7f5fe00cae00 2023-07-07T18:16:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.348+0000 7f5fe7e9b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00ce970 con 0x7f5fe015c420 2023-07-07T18:16:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe5436700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5fe00b08d0 0x7f5fe00cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56464/0 (socket says 172.21.15.12:56464) 2023-07-07T18:16:06.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe5436700 1 -- 172.21.15.12:0/3163147837 learned_addr learned my addr 172.21.15.12:0/3163147837 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:06.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe5c37700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fe015c420 0x7f5fe0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe6438700 1 --2- 172.21.15.12:0/3163147837 >> v2:172.21.15.160:3300/0 conn(0x7f5fe00cae00 0x7f5fe006a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621059898 0 0) 0x7f5fe00cf2a0 con 0x7f5fe00b08d0 2023-07-07T18:16:06.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fcc0035b0 con 0x7f5fe00b08d0 2023-07-07T18:16:06.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1963094865 0 0) 0x7f5fcc0035b0 con 0x7f5fe00b08d0 2023-07-07T18:16:06.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fe015c420 msgr2=0x7f5fe0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:06.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fe015c420 0x7f5fe0069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 >> v2:172.21.15.160:3300/0 conn(0x7f5fe00cae00 msgr2=0x7f5fe006a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:06.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 --2- 172.21.15.12:0/3163147837 >> v2:172.21.15.160:3300/0 conn(0x7f5fe00cae00 0x7f5fe006a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00cec50 con 0x7f5fe00b08d0 2023-07-07T18:16:06.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f5fd4001670 con 0x7f5fe00b08d0 2023-07-07T18:16:06.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 >> v1:172.21.15.12:6789/0 conn(0x7f5fe00b08d0 legacy=0x7f5fe00cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fcc003a00 0x7f5fcc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fcc004430 0x7f5fcc0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc005000 0x7f5fcc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00ce690 con 0x7f5fcc004430 2023-07-07T18:16:06.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00ce970 con 0x7f5fcc003a00 2023-07-07T18:16:06.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc00bf50 con 0x7f5fcc005000 2023-07-07T18:16:06.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe5c37700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fe015c420 0x7f5fe0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:16:06.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe6438700 1 --2- 172.21.15.12:0/3163147837 >> v2:172.21.15.160:3300/0 conn(0x7f5fe00cae00 0x7f5fe006a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:16:06.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.349+0000 7f5fe5436700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fcc004430 0x7f5fcc0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe5c37700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fcc003a00 0x7f5fcc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe6438700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc005000 0x7f5fcc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe5436700 1 -- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc005000 msgr2=0x7f5fcc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:06.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe5436700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc005000 0x7f5fcc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe5436700 1 -- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fcc003a00 msgr2=0x7f5fcc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:06.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe5436700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fcc003a00 0x7f5fcc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe5436700 1 -- 172.21.15.12:0/3163147837 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0035b0 con 0x7f5fcc004430 2023-07-07T18:16:06.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe5c37700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fcc003a00 0x7f5fcc003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:16:06.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe6438700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc005000 0x7f5fcc00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:16:06.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe5436700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fcc004430 0x7f5fcc0048f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400c320 tx=0x7f5fcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64513cb691b9311 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:06.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd400ce60 con 0x7f5fcc004430 2023-07-07T18:16:06.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd4005960 con 0x7f5fcc004430 2023-07-07T18:16:06.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe4c35700 1 -- 172.21.15.12:0/3163147837 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4005cf0 con 0x7f5fcc004430 2023-07-07T18:16:06.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/3163147837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fcc004430 msgr2=0x7f5fcc0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe7e9b700 1 --2- 172.21.15.12:0/3163147837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fcc004430 0x7f5fcc0048f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400c320 tx=0x7f5fcc005880 comp rx=0 tx=0).stop 2023-07-07T18:16:06.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.350+0000 7f5fe6438700 1 -- 172.21.15.12:0/3163147837 reap_dead start 2023-07-07T18:16:06.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.351+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/3163147837 shutdown_connections 2023-07-07T18:16:06.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.351+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/3163147837 >> 172.21.15.12:0/3163147837 conn(0x7f5fe006b920 msgr2=0x7f5fe00cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:06.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.351+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/3163147837 shutdown_connections 2023-07-07T18:16:06.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.351+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/3163147837 wait complete. 2023-07-07T18:16:06.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.352+0000 7f5fe7e9b700 1 Processor -- start 2023-07-07T18:16:06.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.352+0000 7f5fe7e9b700 1 -- start start 2023-07-07T18:16:06.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.353+0000 7f5fe7e9b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc004430 0x7f5fe0159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.353+0000 7f5fe7e9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fe009ca10 0x7f5fe009ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.353+0000 7f5fe7e9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe00b3f10 0x7f5fe00b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.353+0000 7f5fe7e9b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00b48c0 con 0x7f5fe00b3f10 2023-07-07T18:16:06.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.353+0000 7f5fe7e9b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe0159ff0 con 0x7f5fe009ca10 2023-07-07T18:16:06.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.353+0000 7f5fe7e9b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe009d490 con 0x7f5fcc004430 2023-07-07T18:16:06.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.353+0000 7f5fe6438700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe00b3f10 0x7f5fe00b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.353+0000 7f5fe6438700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe00b3f10 0x7f5fe00b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59282/0 (socket says 172.21.15.12:59282) 2023-07-07T18:16:06.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.353+0000 7f5fe6438700 1 -- 172.21.15.12:0/2941156533 learned_addr learned my addr 172.21.15.12:0/2941156533 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:06.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe5436700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fe009ca10 0x7f5fe009ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe5c37700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc004430 0x7f5fe0159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe6438700 1 -- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc004430 msgr2=0x7f5fe0159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe6438700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc004430 0x7f5fe0159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe6438700 1 -- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fe009ca10 msgr2=0x7f5fe009ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe6438700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fe009ca10 0x7f5fe009ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe6438700 1 -- 172.21.15.12:0/2941156533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00996d0 con 0x7f5fe00b3f10 2023-07-07T18:16:06.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe6438700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe00b3f10 0x7f5fe00b4380 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00d08a0 tx=0x7f5fd800f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:06.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fd27fc700 1 -- 172.21.15.12:0/2941156533 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800fd10 con 0x7f5fe00b3f10 2023-07-07T18:16:06.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fd27fc700 1 -- 172.21.15.12:0/2941156533 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800fe70 con 0x7f5fe00b3f10 2023-07-07T18:16:06.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fd27fc700 1 -- 172.21.15.12:0/2941156533 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8016640 con 0x7f5fe00b3f10 2023-07-07T18:16:06.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe00999b0 con 0x7f5fe00b3f10 2023-07-07T18:16:06.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.354+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe0099f70 con 0x7f5fe00b3f10 2023-07-07T18:16:06.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.355+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe0073910 con 0x7f5fe00b3f10 2023-07-07T18:16:06.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.356+0000 7f5fd27fc700 1 -- 172.21.15.12:0/2941156533 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5fd80167a0 con 0x7f5fe00b3f10 2023-07-07T18:16:06.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.356+0000 7f5fd27fc700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5fc406ace0 0x7f5fc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.356+0000 7f5fd27fc700 1 -- 172.21.15.12:0/2941156533 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5fd8089cc0 con 0x7f5fe00b3f10 2023-07-07T18:16:06.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.356+0000 7f5fe5c37700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5fc406ace0 0x7f5fc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.357+0000 7f5fe5c37700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5fc406ace0 0x7f5fc406d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009470 tx=0x7f5fdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:06.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.360+0000 7f5fd27fc700 1 -- 172.21.15.12:0/2941156533 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5fd8058aa0 con 0x7f5fe00b3f10 2023-07-07T18:16:06.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.559+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fe006db60 con 0x7f5fe00b3f10 2023-07-07T18:16:06.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.560+0000 7f5fd27fc700 1 -- 172.21.15.12:0/2941156533 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+14844 (secure 0 0 0) 0x7f5fd8058630 con 0x7f5fe00b3f10 2023-07-07T18:16:06.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:06.561 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":40,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:16:03.102691+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:16:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5fc406ace0 msgr2=0x7f5fc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5fc406ace0 0x7f5fc406d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009470 tx=0x7f5fdc008040 comp rx=0 tx=0).stop 2023-07-07T18:16:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe00b3f10 msgr2=0x7f5fe00b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe00b3f10 0x7f5fe00b4380 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00d08a0 tx=0x7f5fd800f660 comp rx=0 tx=0).stop 2023-07-07T18:16:06.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 shutdown_connections 2023-07-07T18:16:06.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f5fc406ace0 0x7f5fc406d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5fe00b3f10 0x7f5fe00b4380 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5fcc004430 0x7f5fe0159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 --2- 172.21.15.12:0/2941156533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fe009ca10 0x7f5fe009ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 >> 172.21.15.12:0/2941156533 conn(0x7f5fe006b920 msgr2=0x7f5fe00b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:06.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 shutdown_connections 2023-07-07T18:16:06.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.562+0000 7f5fe7e9b700 1 -- 172.21.15.12:0/2941156533 wait complete. 2023-07-07T18:16:06.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-07T18:16:06.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T18:16:06.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.703+0000 7fcf94184700 1 Processor -- start 2023-07-07T18:16:06.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.703+0000 7fcf94184700 1 -- start start 2023-07-07T18:16:06.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf94184700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 0x7fcf8c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf94184700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf8c15a070 0x7fcf8c0b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf94184700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8c0caee0 con 0x7fcf8c0b1510 2023-07-07T18:16:06.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf94184700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8c0b1ec0 con 0x7fcf8c15a070 2023-07-07T18:16:06.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf94184700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c0c8f30 con 0x7fcf8c159590 2023-07-07T18:16:06.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf92721700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf8c15a070 0x7fcf8c0b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf92721700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf8c15a070 0x7fcf8c0b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59290/0 (socket says 172.21.15.12:59290) 2023-07-07T18:16:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf92721700 1 -- 172.21.15.12:0/3461468258 learned_addr learned my addr 172.21.15.12:0/3461468258 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf9171f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcf8c0b1510 0x7fcf8c159960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56486/0 (socket says 172.21.15.12:56486) 2023-07-07T18:16:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf91f20700 1 --2- 172.21.15.12:0/3461468258 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 0x7fcf8c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf92721700 1 -- 172.21.15.12:0/3461468258 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 msgr2=0x7fcf8c0c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf92721700 1 --2- 172.21.15.12:0/3461468258 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 0x7fcf8c0c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf92721700 1 -- 172.21.15.12:0/3461468258 >> v1:172.21.15.12:6789/0 conn(0x7fcf8c0b1510 legacy=0x7fcf8c159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf90f1e700 1 -- 172.21.15.12:0/3461468258 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455535797 0 0) 0x7fcf8c0caee0 con 0x7fcf8c0b1510 2023-07-07T18:16:06.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf92721700 1 -- 172.21.15.12:0/3461468258 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c15a4d0 con 0x7fcf8c15a070 2023-07-07T18:16:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.704+0000 7fcf91f20700 1 --2- 172.21.15.12:0/3461468258 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 0x7fcf8c0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf92721700 1 --2- 172.21.15.12:0/3461468258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c15a070 0x7fcf8c0b1980 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009e50 tx=0x7fcf8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3e5a43e637a6cd server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf90f1e700 1 -- 172.21.15.12:0/3461468258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400e070 con 0x7fcf8c15a070 2023-07-07T18:16:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf90f1e700 1 -- 172.21.15.12:0/3461468258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8400b9c0 con 0x7fcf8c15a070 2023-07-07T18:16:06.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf90f1e700 1 -- 172.21.15.12:0/3461468258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400bd70 con 0x7fcf8c15a070 2023-07-07T18:16:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf94184700 1 -- 172.21.15.12:0/3461468258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c15a070 msgr2=0x7fcf8c0b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf94184700 1 --2- 172.21.15.12:0/3461468258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c15a070 0x7fcf8c0b1980 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009e50 tx=0x7fcf8400b330 comp rx=0 tx=0).stop 2023-07-07T18:16:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf94184700 1 -- 172.21.15.12:0/3461468258 shutdown_connections 2023-07-07T18:16:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf94184700 1 --2- 172.21.15.12:0/3461468258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c15a070 0x7fcf8c0b1980 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf94184700 1 --2- 172.21.15.12:0/3461468258 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 0x7fcf8c0c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.705+0000 7fcf94184700 1 -- 172.21.15.12:0/3461468258 >> 172.21.15.12:0/3461468258 conn(0x7fcf8c06ab80 msgr2=0x7fcf8c0ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.706+0000 7fcf94184700 1 -- 172.21.15.12:0/3461468258 shutdown_connections 2023-07-07T18:16:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.706+0000 7fcf94184700 1 -- 172.21.15.12:0/3461468258 wait complete. 2023-07-07T18:16:06.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.707+0000 7fcf94184700 1 Processor -- start 2023-07-07T18:16:06.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.707+0000 7fcf94184700 1 -- start start 2023-07-07T18:16:06.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf94184700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c0b1510 0x7fcf8c1e1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf94184700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 0x7fcf8c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf94184700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c15a070 0x7fcf8c1f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf94184700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c0c3ba0 con 0x7fcf8c0b1510 2023-07-07T18:16:06.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf94184700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c0c3870 con 0x7fcf8c15a070 2023-07-07T18:16:06.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf94184700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c1f2b30 con 0x7fcf8c159590 2023-07-07T18:16:06.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf91f20700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c0b1510 0x7fcf8c1e1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf91f20700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c0b1510 0x7fcf8c1e1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59292/0 (socket says 172.21.15.12:59292) 2023-07-07T18:16:06.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf91f20700 1 -- 172.21.15.12:0/1713514104 learned_addr learned my addr 172.21.15.12:0/1713514104 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:06.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf9171f700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 0x7fcf8c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf92721700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c15a070 0x7fcf8c1f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf91f20700 1 -- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 msgr2=0x7fcf8c158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf91f20700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 0x7fcf8c158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf91f20700 1 -- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c15a070 msgr2=0x7fcf8c1f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf91f20700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c15a070 0x7fcf8c1f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf91f20700 1 -- 172.21.15.12:0/1713514104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84009b30 con 0x7fcf8c0b1510 2023-07-07T18:16:06.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf92721700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c15a070 0x7fcf8c1f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:06.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf91f20700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c0b1510 0x7fcf8c1e1f50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00e810 tx=0x7fcf7c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:06.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf827fc700 1 -- 172.21.15.12:0/1713514104 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00c020 con 0x7fcf8c0b1510 2023-07-07T18:16:06.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf827fc700 1 -- 172.21.15.12:0/1713514104 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c004250 con 0x7fcf8c0b1510 2023-07-07T18:16:06.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c1f2e10 con 0x7fcf8c0b1510 2023-07-07T18:16:06.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf827fc700 1 -- 172.21.15.12:0/1713514104 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c0036a0 con 0x7fcf8c0b1510 2023-07-07T18:16:06.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.708+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c158f80 con 0x7fcf8c0b1510 2023-07-07T18:16:06.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.709+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8c0c3e80 con 0x7fcf8c0b1510 2023-07-07T18:16:06.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.710+0000 7fcf827fc700 1 -- 172.21.15.12:0/1713514104 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf7c003800 con 0x7fcf8c0b1510 2023-07-07T18:16:06.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.710+0000 7fcf827fc700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf7006ace0 0x7fcf7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:06.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.710+0000 7fcf827fc700 1 -- 172.21.15.12:0/1713514104 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcf7c088ed0 con 0x7fcf8c0b1510 2023-07-07T18:16:06.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.711+0000 7fcf9171f700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf7006ace0 0x7fcf7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:06.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.711+0000 7fcf9171f700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf7006ace0 0x7fcf7006d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcf88000f60 tx=0x7fcf88007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:06.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.715+0000 7fcf827fc700 1 -- 172.21.15.12:0/1713514104 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf7c054220 con 0x7fcf8c0b1510 2023-07-07T18:16:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.910+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf8c071620 con 0x7fcf8c0b1510 2023-07-07T18:16:06.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.910+0000 7fcf827fc700 1 -- 172.21.15.12:0/1713514104 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf7c057840 con 0x7fcf8c0b1510 2023-07-07T18:16:06.912 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T18:16:06.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf7006ace0 msgr2=0x7fcf7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf7006ace0 0x7fcf7006d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcf88000f60 tx=0x7fcf88007e70 comp rx=0 tx=0).stop 2023-07-07T18:16:06.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c0b1510 msgr2=0x7fcf8c1e1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:06.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c0b1510 0x7fcf8c1e1f50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00e810 tx=0x7fcf7c00eb20 comp rx=0 tx=0).stop 2023-07-07T18:16:06.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 shutdown_connections 2023-07-07T18:16:06.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcf7006ace0 0x7fcf7006d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c15a070 0x7fcf8c1f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf8c0b1510 0x7fcf8c1e1f50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 --2- 172.21.15.12:0/1713514104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcf8c159590 0x7fcf8c158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:06.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 >> 172.21.15.12:0/1713514104 conn(0x7fcf8c06ab80 msgr2=0x7fcf8c15aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:06.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 shutdown_connections 2023-07-07T18:16:06.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:06.912+0000 7fcf94184700 1 -- 172.21.15.12:0/1713514104 wait complete. 2023-07-07T18:16:06.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T18:16:07.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.051+0000 7f31cc382700 1 Processor -- start 2023-07-07T18:16:07.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.051+0000 7f31cc382700 1 -- start start 2023-07-07T18:16:07.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.052+0000 7f31cc382700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f31c4158960 0x7f31c4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.052+0000 7f31cc382700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31c4070dc0 0x7f31c415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.052+0000 7f31cc382700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c415c450 con 0x7f31c415d100 2023-07-07T18:16:07.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.052+0000 7f31cc382700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c406b8f0 con 0x7f31c4158960 2023-07-07T18:16:07.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.052+0000 7f31cc382700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4159640 con 0x7f31c4070dc0 2023-07-07T18:16:07.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31ca91f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f31c415d100 0x7f31c406ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56502/0 (socket says 172.21.15.12:56502) 2023-07-07T18:16:07.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31ca91f700 1 -- 172.21.15.12:0/2607344024 learned_addr learned my addr 172.21.15.12:0/2607344024 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:07.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31ca11e700 1 --2- 172.21.15.12:0/2607344024 >> v2:172.21.15.160:3300/0 conn(0x7f31c4158960 0x7f31c4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c991d700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31c4070dc0 0x7f31c415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284709608 0 0) 0x7f31c415c450 con 0x7f31c415d100 2023-07-07T18:16:07.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b00046c0 con 0x7f31c415d100 2023-07-07T18:16:07.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2108927431 0 0) 0x7f31b00046c0 con 0x7f31c415d100 2023-07-07T18:16:07.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31c4070dc0 msgr2=0x7f31c415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:07.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31c4070dc0 0x7f31c415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 >> v2:172.21.15.160:3300/0 conn(0x7f31c4158960 msgr2=0x7f31c4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:07.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 --2- 172.21.15.12:0/2607344024 >> v2:172.21.15.160:3300/0 conn(0x7f31c4158960 0x7f31c4158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4159920 con 0x7f31c415d100 2023-07-07T18:16:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f31bc0019f0 con 0x7f31c415d100 2023-07-07T18:16:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 >> v1:172.21.15.12:6789/0 conn(0x7f31c415d100 legacy=0x7f31c406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31b0004b10 0x7f31b0004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b0005540 0x7f31b0005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31c4070dc0 0x7f31b00060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c406b8f0 con 0x7f31b0004b10 2023-07-07T18:16:07.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4159640 con 0x7f31b0005540 2023-07-07T18:16:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b000cb20 con 0x7f31c4070dc0 2023-07-07T18:16:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31ca11e700 1 --2- 172.21.15.12:0/2607344024 >> v2:172.21.15.160:3300/0 conn(0x7f31c4158960 0x7f31c4158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:16:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31ca11e700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31b0004b10 0x7f31b0004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31c991d700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b0005540 0x7f31b0005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.053+0000 7f31ca91f700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31c4070dc0 0x7f31b00060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31ca11e700 1 -- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31c4070dc0 msgr2=0x7f31b00060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:07.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31ca11e700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31c4070dc0 0x7f31b00060d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31ca11e700 1 -- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b0005540 msgr2=0x7f31b0005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:07.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31ca11e700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b0005540 0x7f31b0005a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31ca11e700 1 -- 172.21.15.12:0/2607344024 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b00046c0 con 0x7f31b0004b10 2023-07-07T18:16:07.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31ca11e700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31b0004b10 0x7f31b0004f20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009d10 tx=0x7f31b0006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4316ed4c234777 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:07.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0009e60 con 0x7f31b0004b10 2023-07-07T18:16:07.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c000e9a0 con 0x7f31b0004b10 2023-07-07T18:16:07.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31c911c700 1 -- 172.21.15.12:0/2607344024 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c000ed10 con 0x7f31b0004b10 2023-07-07T18:16:07.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31cc382700 1 -- 172.21.15.12:0/2607344024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31b0004b10 msgr2=0x7f31b0004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31cc382700 1 --2- 172.21.15.12:0/2607344024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31b0004b10 0x7f31b0004f20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009d10 tx=0x7f31b0006990 comp rx=0 tx=0).stop 2023-07-07T18:16:07.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.054+0000 7f31ca91f700 1 -- 172.21.15.12:0/2607344024 reap_dead start 2023-07-07T18:16:07.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.055+0000 7f31cc382700 1 -- 172.21.15.12:0/2607344024 shutdown_connections 2023-07-07T18:16:07.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.055+0000 7f31cc382700 1 -- 172.21.15.12:0/2607344024 >> 172.21.15.12:0/2607344024 conn(0x7f31c40b1990 msgr2=0x7f31c40cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:07.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.055+0000 7f31cc382700 1 -- 172.21.15.12:0/2607344024 shutdown_connections 2023-07-07T18:16:07.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.055+0000 7f31cc382700 1 -- 172.21.15.12:0/2607344024 wait complete. 2023-07-07T18:16:07.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.056+0000 7f31cc382700 1 Processor -- start 2023-07-07T18:16:07.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.056+0000 7f31cc382700 1 -- start start 2023-07-07T18:16:07.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31cc382700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31b0004b10 0x7f31c40c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31cc382700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31c4145150 0x7f31c41f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31cc382700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c40c3ad0 0x7f31c40c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31cc382700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40c4480 con 0x7f31c40c3ad0 2023-07-07T18:16:07.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31cc382700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40c2e00 con 0x7f31c4145150 2023-07-07T18:16:07.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31cc382700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40c30e0 con 0x7f31b0004b10 2023-07-07T18:16:07.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca91f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c40c3ad0 0x7f31c40c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca91f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c40c3ad0 0x7f31c40c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59316/0 (socket says 172.21.15.12:59316) 2023-07-07T18:16:07.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca91f700 1 -- 172.21.15.12:0/691352880 learned_addr learned my addr 172.21.15.12:0/691352880 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:07.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca11e700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31b0004b10 0x7f31c40c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31c991d700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31c4145150 0x7f31c41f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca91f700 1 -- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31b0004b10 msgr2=0x7f31c40c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca91f700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31b0004b10 0x7f31c40c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca91f700 1 -- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31c4145150 msgr2=0x7f31c41f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca91f700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31c4145150 0x7f31c41f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca91f700 1 -- 172.21.15.12:0/691352880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c40c33c0 con 0x7f31c40c3ad0 2023-07-07T18:16:07.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31ca91f700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c40c3ad0 0x7f31c40c3f40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f31c406d9b0 tx=0x7f31bc00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:07.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31b6ffd700 1 -- 172.21.15.12:0/691352880 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00ad50 con 0x7f31c40c3ad0 2023-07-07T18:16:07.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31b6ffd700 1 -- 172.21.15.12:0/691352880 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0133f0 con 0x7f31c40c3ad0 2023-07-07T18:16:07.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.057+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c40c36a0 con 0x7f31c40c3ad0 2023-07-07T18:16:07.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.058+0000 7f31b6ffd700 1 -- 172.21.15.12:0/691352880 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0137a0 con 0x7f31c40c3ad0 2023-07-07T18:16:07.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.058+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c40c72c0 con 0x7f31c40c3ad0 2023-07-07T18:16:07.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.059+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c40c9410 con 0x7f31c40c3ad0 2023-07-07T18:16:07.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.059+0000 7f31b6ffd700 1 -- 172.21.15.12:0/691352880 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f31bc013900 con 0x7f31c40c3ad0 2023-07-07T18:16:07.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.059+0000 7f31b6ffd700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f31a806ace0 0x7f31a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.060+0000 7f31b6ffd700 1 -- 172.21.15.12:0/691352880 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f31bc089a70 con 0x7f31c40c3ad0 2023-07-07T18:16:07.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.060+0000 7f31ca11e700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f31a806ace0 0x7f31a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.060+0000 7f31ca11e700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f31a806ace0 0x7f31a806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f31c00090b0 tx=0x7f31c0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:07.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.064+0000 7f31b6ffd700 1 -- 172.21.15.12:0/691352880 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f31bc054d30 con 0x7f31c40c3ad0 2023-07-07T18:16:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.260+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f31c40c3890 con 0x7f31c40c3ad0 2023-07-07T18:16:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.260+0000 7f31b6ffd700 1 -- 172.21.15.12:0/691352880 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f31bc058350 con 0x7f31c40c3ad0 2023-07-07T18:16:07.262 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T18:16:07.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f31a806ace0 msgr2=0x7f31a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f31a806ace0 0x7f31a806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f31c00090b0 tx=0x7f31c0008030 comp rx=0 tx=0).stop 2023-07-07T18:16:07.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c40c3ad0 msgr2=0x7f31c40c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c40c3ad0 0x7f31c40c3f40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f31c406d9b0 tx=0x7f31bc00a640 comp rx=0 tx=0).stop 2023-07-07T18:16:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 shutdown_connections 2023-07-07T18:16:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f31a806ace0 0x7f31a806d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31c40c3ad0 0x7f31c40c3f40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31b0004b10 0x7f31c40c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 --2- 172.21.15.12:0/691352880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31c4145150 0x7f31c41f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 >> 172.21.15.12:0/691352880 conn(0x7f31c40b1990 msgr2=0x7f31c406ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:07.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 shutdown_connections 2023-07-07T18:16:07.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.262+0000 7f31cc382700 1 -- 172.21.15.12:0/691352880 wait complete. 2023-07-07T18:16:07.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-07T18:16:07.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.399+0000 7f0b963c2700 1 Processor -- start 2023-07-07T18:16:07.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.399+0000 7f0b963c2700 1 -- start start 2023-07-07T18:16:07.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.400+0000 7f0b963c2700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0b900caea0 0x7f0b900cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.400+0000 7f0b963c2700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9006f220 con 0x7f0b9015cb60 2023-07-07T18:16:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.400+0000 7f0b963c2700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b900c9e60 con 0x7f0b9015d700 2023-07-07T18:16:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.400+0000 7f0b963c2700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9006f000 con 0x7f0b900caea0 2023-07-07T18:16:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.400+0000 7f0b8ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0b9015cb60 0x7f0b9015cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56518/0 (socket says 172.21.15.12:56518) 2023-07-07T18:16:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.400+0000 7f0b8ffff700 1 -- 172.21.15.12:0/566107897 learned_addr learned my addr 172.21.15.12:0/566107897 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b9495f700 1 --2- 172.21.15.12:0/566107897 >> v2:172.21.15.160:3300/0 conn(0x7f0b900caea0 0x7f0b900cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298198154 0 0) 0x7f0b78001110 con 0x7f0b9015cb60 2023-07-07T18:16:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b7c0057c0 con 0x7f0b9015cb60 2023-07-07T18:16:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 106421938 0 0) 0x7f0b7c0057c0 con 0x7f0b9015cb60 2023-07-07T18:16:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 >> v2:172.21.15.160:3300/0 conn(0x7f0b900caea0 msgr2=0x7f0b900cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 --2- 172.21.15.12:0/566107897 >> v2:172.21.15.160:3300/0 conn(0x7f0b900caea0 0x7f0b900cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 >> v1:172.21.15.160:6789/0 conn(0x7f0b9015d700 legacy=0x7f0b9006e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900ca0e0 con 0x7f0b9015cb60 2023-07-07T18:16:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f0b78001800 con 0x7f0b9015cb60 2023-07-07T18:16:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b9495f700 1 --2- 172.21.15.12:0/566107897 >> v2:172.21.15.160:3300/0 conn(0x7f0b900caea0 0x7f0b900cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:16:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 >> v1:172.21.15.12:6789/0 conn(0x7f0b9015cb60 legacy=0x7f0b9015cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b7c005c10 0x7f0b7c006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b7c006a60 0x7f0b7c006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b7c007410 0x7f0b7c00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9006f000 con 0x7f0b7c007410 2023-07-07T18:16:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c00e290 con 0x7f0b7c005c10 2023-07-07T18:16:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c00e450 con 0x7f0b7c006a60 2023-07-07T18:16:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b9495f700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b7c007410 0x7f0b7c00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8f7fe700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b7c006a60 0x7f0b7c006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b8ffff700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b7c005c10 0x7f0b7c006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b9495f700 1 -- 172.21.15.12:0/566107897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b7c006a60 msgr2=0x7f0b7c006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b9495f700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b7c006a60 0x7f0b7c006ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b9495f700 1 -- 172.21.15.12:0/566107897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b7c005c10 msgr2=0x7f0b7c006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b9495f700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b7c005c10 0x7f0b7c006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.401+0000 7f0b9495f700 1 -- 172.21.15.12:0/566107897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0057c0 con 0x7f0b7c007410 2023-07-07T18:16:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b9495f700 1 -- 172.21.15.12:0/566107897 reap_dead start 2023-07-07T18:16:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b9495f700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b7c007410 0x7f0b7c00dc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800e350 tx=0x7f0b7c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570c3af6ebb6d049 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800edf0 con 0x7f0b7c007410 2023-07-07T18:16:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8800f040 con 0x7f0b7c007410 2023-07-07T18:16:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b8effd700 1 -- 172.21.15.12:0/566107897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b880146c0 con 0x7f0b7c007410 2023-07-07T18:16:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b963c2700 1 -- 172.21.15.12:0/566107897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b7c007410 msgr2=0x7f0b7c00dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b963c2700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b7c007410 0x7f0b7c00dc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800e350 tx=0x7f0b7c007a90 comp rx=0 tx=0).stop 2023-07-07T18:16:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b963c2700 1 -- 172.21.15.12:0/566107897 shutdown_connections 2023-07-07T18:16:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b963c2700 1 --2- 172.21.15.12:0/566107897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b7c007410 0x7f0b7c00dc20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b963c2700 1 -- 172.21.15.12:0/566107897 >> 172.21.15.12:0/566107897 conn(0x7f0b900b1740 msgr2=0x7f0b9006cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b963c2700 1 -- 172.21.15.12:0/566107897 shutdown_connections 2023-07-07T18:16:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.402+0000 7f0b963c2700 1 -- 172.21.15.12:0/566107897 wait complete. 2023-07-07T18:16:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.404+0000 7f0b963c2700 1 Processor -- start 2023-07-07T18:16:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.404+0000 7f0b963c2700 1 -- start start 2023-07-07T18:16:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.404+0000 7f0b963c2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b7c007410 0x7f0b900ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b963c2700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b900add40 0x7f0b900ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b963c2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b900cbef0 0x7f0b900cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b963c2700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900cc880 con 0x7f0b900cbef0 2023-07-07T18:16:07.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b963c2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900b34e0 con 0x7f0b7c007410 2023-07-07T18:16:07.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b963c2700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900b37c0 con 0x7f0b900add40 2023-07-07T18:16:07.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b9495f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b900cbef0 0x7f0b900cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b9495f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b900cbef0 0x7f0b900cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59336/0 (socket says 172.21.15.12:59336) 2023-07-07T18:16:07.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b9495f700 1 -- 172.21.15.12:0/1380878625 learned_addr learned my addr 172.21.15.12:0/1380878625 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:07.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b8f7fe700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b900add40 0x7f0b900ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b8ffff700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b7c007410 0x7f0b900ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b9495f700 1 -- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b900add40 msgr2=0x7f0b900ae1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b9495f700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b900add40 0x7f0b900ae1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b9495f700 1 -- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b7c007410 msgr2=0x7f0b900ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b9495f700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b7c007410 0x7f0b900ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b9495f700 1 -- 172.21.15.12:0/1380878625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900b3aa0 con 0x7f0b900cbef0 2023-07-07T18:16:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b9495f700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b900cbef0 0x7f0b900cc340 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0b9006d6c0 tx=0x7f0b88009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:07.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b8cff9700 1 -- 172.21.15.12:0/1380878625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88009490 con 0x7f0b900cbef0 2023-07-07T18:16:07.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b8cff9700 1 -- 172.21.15.12:0/1380878625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88004450 con 0x7f0b900cbef0 2023-07-07T18:16:07.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b900b3d80 con 0x7f0b900cbef0 2023-07-07T18:16:07.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b8cff9700 1 -- 172.21.15.12:0/1380878625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88004800 con 0x7f0b900cbef0 2023-07-07T18:16:07.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.405+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b900ac660 con 0x7f0b900cbef0 2023-07-07T18:16:07.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.406+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b90073910 con 0x7f0b900cbef0 2023-07-07T18:16:07.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.407+0000 7f0b8cff9700 1 -- 172.21.15.12:0/1380878625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b88014480 con 0x7f0b900cbef0 2023-07-07T18:16:07.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.407+0000 7f0b8cff9700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0b7006ace0 0x7f0b7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.407+0000 7f0b8cff9700 1 -- 172.21.15.12:0/1380878625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0b8808ade0 con 0x7f0b900cbef0 2023-07-07T18:16:07.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.408+0000 7f0b8ffff700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0b7006ace0 0x7f0b7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.408+0000 7f0b8ffff700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0b7006ace0 0x7f0b7006d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b78001050 tx=0x7f0b78000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:07.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.412+0000 7f0b8cff9700 1 -- 172.21.15.12:0/1380878625 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0b88056090 con 0x7f0b900cbef0 2023-07-07T18:16:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.612+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0b9006b1b0 con 0x7f0b900cbef0 2023-07-07T18:16:07.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.613+0000 7f0b8cff9700 1 -- 172.21.15.12:0/1380878625 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0b880596b0 con 0x7f0b900cbef0 2023-07-07T18:16:07.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:07.614 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-07-07T18:16:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-07-07T18:16:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-07-07T18:16:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-07-07T18:16:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-07-07T18:16:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 2, 2023-07-07T18:16:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": "rbd" 2023-07-07T18:16:07.615 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-07-07T18:16:07.616 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-07-07T18:16:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0b7006ace0 msgr2=0x7f0b7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0b7006ace0 0x7f0b7006d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0b78001050 tx=0x7f0b78000f80 comp rx=0 tx=0).stop 2023-07-07T18:16:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b900cbef0 msgr2=0x7f0b900cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b900cbef0 0x7f0b900cc340 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0b9006d6c0 tx=0x7f0b88009750 comp rx=0 tx=0).stop 2023-07-07T18:16:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 shutdown_connections 2023-07-07T18:16:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f0b7006ace0 0x7f0b7006d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0b900cbef0 0x7f0b900cc340 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b7c007410 0x7f0b900ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 --2- 172.21.15.12:0/1380878625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b900add40 0x7f0b900ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 >> 172.21.15.12:0/1380878625 conn(0x7f0b900b1740 msgr2=0x7f0b900aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 shutdown_connections 2023-07-07T18:16:07.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.615+0000 7f0b963c2700 1 -- 172.21.15.12:0/1380878625 wait complete. 2023-07-07T18:16:07.628 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-07T18:16:07.629 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-07T18:16:07.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.756+0000 7fe80ee78700 1 Processor -- start 2023-07-07T18:16:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.756+0000 7fe80ee78700 1 -- start start 2023-07-07T18:16:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.757+0000 7fe80ee78700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe8080cd330 0x7fe808070980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.757+0000 7fe80ee78700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe80815a330 0x7fe8080cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.757+0000 7fe80ee78700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8080caf70 con 0x7fe8080afc40 2023-07-07T18:16:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.757+0000 7fe80ee78700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80815e360 con 0x7fe80815a330 2023-07-07T18:16:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.757+0000 7fe80ee78700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8080cdc40 con 0x7fe8080cd330 2023-07-07T18:16:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.757+0000 7fe807fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe80815a330 0x7fe8080cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.757+0000 7fe80d415700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe8080afc40 0x7fe80815dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56542/0 (socket says 172.21.15.12:56542) 2023-07-07T18:16:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.757+0000 7fe80d415700 1 -- 172.21.15.12:0/11894768 learned_addr learned my addr 172.21.15.12:0/11894768 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.757+0000 7fe807fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe80815a330 0x7fe8080cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59340/0 (socket says 172.21.15.12:59340) 2023-07-07T18:16:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe80cc14700 1 --2- 172.21.15.12:0/11894768 >> v2:172.21.15.160:3300/0 conn(0x7fe8080cd330 0x7fe808070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe807fff700 1 -- 172.21.15.12:0/11894768 >> v2:172.21.15.160:3300/0 conn(0x7fe8080cd330 msgr2=0x7fe808070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe807fff700 1 --2- 172.21.15.12:0/11894768 >> v2:172.21.15.160:3300/0 conn(0x7fe8080cd330 0x7fe808070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe807fff700 1 -- 172.21.15.12:0/11894768 >> v1:172.21.15.12:6789/0 conn(0x7fe8080afc40 legacy=0x7fe80815dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe807fff700 1 -- 172.21.15.12:0/11894768 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8080cb210 con 0x7fe80815a330 2023-07-07T18:16:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe807fff700 1 --2- 172.21.15.12:0/11894768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 0x7fe8080cd700 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe8080d0880 tx=0x7fe7f4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79aaccbb925207e server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe8077fe700 1 -- 172.21.15.12:0/11894768 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4011830 con 0x7fe80815a330 2023-07-07T18:16:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe8077fe700 1 -- 172.21.15.12:0/11894768 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f4011990 con 0x7fe80815a330 2023-07-07T18:16:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe8077fe700 1 -- 172.21.15.12:0/11894768 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4011d20 con 0x7fe80815a330 2023-07-07T18:16:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe80ee78700 1 -- 172.21.15.12:0/11894768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 msgr2=0x7fe8080cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.758+0000 7fe80ee78700 1 --2- 172.21.15.12:0/11894768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 0x7fe8080cd700 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe8080d0880 tx=0x7fe7f4009b20 comp rx=0 tx=0).stop 2023-07-07T18:16:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.759+0000 7fe80ee78700 1 -- 172.21.15.12:0/11894768 shutdown_connections 2023-07-07T18:16:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.759+0000 7fe80ee78700 1 --2- 172.21.15.12:0/11894768 >> v2:172.21.15.160:3300/0 conn(0x7fe8080cd330 0x7fe808070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.759+0000 7fe80ee78700 1 --2- 172.21.15.12:0/11894768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 0x7fe8080cd700 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.759+0000 7fe80ee78700 1 -- 172.21.15.12:0/11894768 >> 172.21.15.12:0/11894768 conn(0x7fe80806e5c0 msgr2=0x7fe80806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.759+0000 7fe80ee78700 1 -- 172.21.15.12:0/11894768 shutdown_connections 2023-07-07T18:16:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.759+0000 7fe80ee78700 1 -- 172.21.15.12:0/11894768 wait complete. 2023-07-07T18:16:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.760+0000 7fe80ee78700 1 Processor -- start 2023-07-07T18:16:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.760+0000 7fe80ee78700 1 -- start start 2023-07-07T18:16:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80ee78700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8080afc40 0x7fe8081e5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80ee78700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8080cd330 0x7fe8080ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80ee78700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 0x7fe8080cef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80ee78700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8080b4120 con 0x7fe80815a330 2023-07-07T18:16:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80ee78700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8081e66b0 con 0x7fe8080afc40 2023-07-07T18:16:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80ee78700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8080b37f0 con 0x7fe8080cd330 2023-07-07T18:16:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80d415700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 0x7fe8080cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80d415700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 0x7fe8080cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59350/0 (socket says 172.21.15.12:59350) 2023-07-07T18:16:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80d415700 1 -- 172.21.15.12:0/920412912 learned_addr learned my addr 172.21.15.12:0/920412912 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80cc14700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8080afc40 0x7fe8081e5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe807fff700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8080cd330 0x7fe8080ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80d415700 1 -- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8080cd330 msgr2=0x7fe8080ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80d415700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8080cd330 0x7fe8080ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80d415700 1 -- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8080afc40 msgr2=0x7fe8081e5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80d415700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8080afc40 0x7fe8081e5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80d415700 1 -- 172.21.15.12:0/920412912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f40094a0 con 0x7fe80815a330 2023-07-07T18:16:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.761+0000 7fe80d415700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 0x7fe8080cef30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe80000cbc0 tx=0x7fe80000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.762+0000 7fe8057fa700 1 -- 172.21.15.12:0/920412912 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000a9e0 con 0x7fe80815a330 2023-07-07T18:16:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.762+0000 7fe8057fa700 1 -- 172.21.15.12:0/920412912 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80000ab40 con 0x7fe80815a330 2023-07-07T18:16:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.762+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8080b3ad0 con 0x7fe80815a330 2023-07-07T18:16:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.762+0000 7fe8057fa700 1 -- 172.21.15.12:0/920412912 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800012400 con 0x7fe80815a330 2023-07-07T18:16:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.762+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8080b60e0 con 0x7fe80815a330 2023-07-07T18:16:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.763+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8080b4290 con 0x7fe80815a330 2023-07-07T18:16:07.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.763+0000 7fe8057fa700 1 -- 172.21.15.12:0/920412912 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe80001b3b0 con 0x7fe80815a330 2023-07-07T18:16:07.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.763+0000 7fe8057fa700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe7ec06ace0 0x7fe7ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:07.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.764+0000 7fe8057fa700 1 -- 172.21.15.12:0/920412912 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe800088da0 con 0x7fe80815a330 2023-07-07T18:16:07.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.764+0000 7fe80cc14700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe7ec06ace0 0x7fe7ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:07.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.764+0000 7fe80cc14700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe7ec06ace0 0x7fe7ec06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc006b20 tx=0x7fe7fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:07.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.768+0000 7fe8057fa700 1 -- 172.21.15.12:0/920412912 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe800054110 con 0x7fe80815a330 2023-07-07T18:16:07.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:07.967+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe80804ea20 con 0x7fe80815a330 2023-07-07T18:16:08.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.919+0000 7fe8057fa700 1 -- 172.21.15.12:0/920412912 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe800057730 con 0x7fe80815a330 2023-07-07T18:16:08.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.924+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe7ec06ace0 msgr2=0x7fe7ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:08.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.924+0000 7fe80ee78700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe7ec06ace0 0x7fe7ec06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc006b20 tx=0x7fe7fc008040 comp rx=0 tx=0).stop 2023-07-07T18:16:08.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.924+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 msgr2=0x7fe8080cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:08.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.924+0000 7fe80ee78700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 0x7fe8080cef30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe80000cbc0 tx=0x7fe80000ced0 comp rx=0 tx=0).stop 2023-07-07T18:16:08.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.925+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 shutdown_connections 2023-07-07T18:16:08.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.925+0000 7fe80ee78700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fe7ec06ace0 0x7fe7ec06d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:08.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.925+0000 7fe80ee78700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe80815a330 0x7fe8080cef30 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:08.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.925+0000 7fe80ee78700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8080afc40 0x7fe8081e5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:08.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.925+0000 7fe80ee78700 1 --2- 172.21.15.12:0/920412912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8080cd330 0x7fe8080ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:08.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.925+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 >> 172.21.15.12:0/920412912 conn(0x7fe80806e5c0 msgr2=0x7fe8080b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:08.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.925+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 shutdown_connections 2023-07-07T18:16:08.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:08.925+0000 7fe80ee78700 1 -- 172.21.15.12:0/920412912 wait complete. 2023-07-07T18:16:08.928 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-07-07T18:16:08.939 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-07T18:16:09.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.074+0000 7f6784af5700 1 Processor -- start 2023-07-07T18:16:09.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.074+0000 7f6784af5700 1 -- start start 2023-07-07T18:16:09.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f6784af5700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67800cd5e0 0x7f67800cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f6784af5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 0x7f678006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f6784af5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f678015cf70 0x7f678015d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f6784af5700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67800ce2c0 con 0x7f67800cd5e0 2023-07-07T18:16:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f6784af5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678006f0e0 con 0x7f678015cf70 2023-07-07T18:16:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f6784af5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67800cdef0 con 0x7f678006e030 2023-07-07T18:16:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67800cd5e0 0x7f67800cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:09.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67800cd5e0 0x7f67800cd9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59354/0 (socket says 172.21.15.12:59354) 2023-07-07T18:16:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677e59c700 1 -- 172.21.15.12:0/704846035 learned_addr learned my addr 172.21.15.12:0/704846035 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677ed9d700 1 --2- 172.21.15.12:0/704846035 >> v2:172.21.15.160:3300/0 conn(0x7f678015cf70 0x7f678015d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677dd9b700 1 --2- 172.21.15.12:0/704846035 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 0x7f678006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677e59c700 1 -- 172.21.15.12:0/704846035 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 msgr2=0x7f678006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677e59c700 1 --2- 172.21.15.12:0/704846035 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 0x7f678006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677e59c700 1 -- 172.21.15.12:0/704846035 >> v2:172.21.15.160:3300/0 conn(0x7f678015cf70 msgr2=0x7f678015d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:09.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677e59c700 1 --2- 172.21.15.12:0/704846035 >> v2:172.21.15.160:3300/0 conn(0x7f678015cf70 0x7f678015d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677e59c700 1 -- 172.21.15.12:0/704846035 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678006eb20 con 0x7f67800cd5e0 2023-07-07T18:16:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.075+0000 7f677ed9d700 1 --2- 172.21.15.12:0/704846035 >> v2:172.21.15.160:3300/0 conn(0x7f678015cf70 0x7f678015d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f677e59c700 1 --2- 172.21.15.12:0/704846035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67800cd5e0 0x7f67800cd9b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6780071930 tx=0x7f6770009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6083a923459d785c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f677d59a700 1 -- 172.21.15.12:0/704846035 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770005e30 con 0x7f67800cd5e0 2023-07-07T18:16:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f677d59a700 1 -- 172.21.15.12:0/704846035 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770004030 con 0x7f67800cd5e0 2023-07-07T18:16:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f677d59a700 1 -- 172.21.15.12:0/704846035 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700043e0 con 0x7f67800cd5e0 2023-07-07T18:16:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f6784af5700 1 -- 172.21.15.12:0/704846035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67800cd5e0 msgr2=0x7f67800cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f6784af5700 1 --2- 172.21.15.12:0/704846035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67800cd5e0 0x7f67800cd9b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6780071930 tx=0x7f6770009bd0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f6784af5700 1 -- 172.21.15.12:0/704846035 shutdown_connections 2023-07-07T18:16:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f6784af5700 1 --2- 172.21.15.12:0/704846035 >> v2:172.21.15.160:3300/0 conn(0x7f678015cf70 0x7f678015d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f6784af5700 1 --2- 172.21.15.12:0/704846035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67800cd5e0 0x7f67800cd9b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f6784af5700 1 --2- 172.21.15.12:0/704846035 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 0x7f678006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f6784af5700 1 -- 172.21.15.12:0/704846035 >> 172.21.15.12:0/704846035 conn(0x7f678006b920 msgr2=0x7f67800cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:09.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f6784af5700 1 -- 172.21.15.12:0/704846035 shutdown_connections 2023-07-07T18:16:09.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.076+0000 7f6784af5700 1 -- 172.21.15.12:0/704846035 wait complete. 2023-07-07T18:16:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.078+0000 7f6784af5700 1 Processor -- start 2023-07-07T18:16:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.078+0000 7f6784af5700 1 -- start start 2023-07-07T18:16:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f6784af5700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 0x7f678014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f6784af5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800cd5e0 0x7f67801581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f6784af5700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f678015cf70 0x7f67800b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:09.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f6784af5700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6780155bc0 con 0x7f678015cf70 2023-07-07T18:16:09.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f6784af5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67800acf10 con 0x7f67800cd5e0 2023-07-07T18:16:09.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f6784af5700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6780155560 con 0x7f678006e030 2023-07-07T18:16:09.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f678015cf70 0x7f67800b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:09.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f678015cf70 0x7f67800b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59364/0 (socket says 172.21.15.12:59364) 2023-07-07T18:16:09.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677ed9d700 1 -- 172.21.15.12:0/2233354734 learned_addr learned my addr 172.21.15.12:0/2233354734 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:09.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677e59c700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 0x7f678014cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:09.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677dd9b700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800cd5e0 0x7f67801581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:09.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677ed9d700 1 -- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 msgr2=0x7f678014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:09.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677ed9d700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 0x7f678014cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677ed9d700 1 -- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800cd5e0 msgr2=0x7f67801581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:09.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677ed9d700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800cd5e0 0x7f67801581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677ed9d700 1 -- 172.21.15.12:0/2233354734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770009500 con 0x7f678015cf70 2023-07-07T18:16:09.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.079+0000 7f677ed9d700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f678015cf70 0x7f67800b4300 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6778007ef0 tx=0x7f677800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:09.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.080+0000 7f676effd700 1 -- 172.21.15.12:0/2233354734 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677800dd80 con 0x7f678015cf70 2023-07-07T18:16:09.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.080+0000 7f676effd700 1 -- 172.21.15.12:0/2233354734 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677800f040 con 0x7f678015cf70 2023-07-07T18:16:09.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.080+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67801586e0 con 0x7f678015cf70 2023-07-07T18:16:09.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.080+0000 7f676effd700 1 -- 172.21.15.12:0/2233354734 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6778003c60 con 0x7f678015cf70 2023-07-07T18:16:09.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.080+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67801560f0 con 0x7f678015cf70 2023-07-07T18:16:09.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.080+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6780156310 con 0x7f678015cf70 2023-07-07T18:16:09.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.081+0000 7f676effd700 1 -- 172.21.15.12:0/2233354734 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6778004030 con 0x7f678015cf70 2023-07-07T18:16:09.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.082+0000 7f676effd700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f676006ace0 0x7f676006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:09.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.082+0000 7f676effd700 1 -- 172.21.15.12:0/2233354734 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f6778089760 con 0x7f678015cf70 2023-07-07T18:16:09.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.082+0000 7f677e59c700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f676006ace0 0x7f676006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:09.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.083+0000 7f677e59c700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f676006ace0 0x7f676006d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6780071930 tx=0x7f6770008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:09.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.086+0000 7f676effd700 1 -- 172.21.15.12:0/2233354734 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6778054a20 con 0x7f678015cf70 2023-07-07T18:16:09.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.283+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6780154980 con 0x7f678015cf70 2023-07-07T18:16:09.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.922+0000 7f676effd700 1 -- 172.21.15.12:0/2233354734 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6778058040 con 0x7f678015cf70 2023-07-07T18:16:09.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.928+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f676006ace0 msgr2=0x7f676006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:09.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.928+0000 7f6784af5700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f676006ace0 0x7f676006d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6780071930 tx=0x7f6770008070 comp rx=0 tx=0).stop 2023-07-07T18:16:09.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.928+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f678015cf70 msgr2=0x7f67800b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:09.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.928+0000 7f6784af5700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f678015cf70 0x7f67800b4300 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6778007ef0 tx=0x7f677800d3b0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.934+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 shutdown_connections 2023-07-07T18:16:09.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.934+0000 7f6784af5700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f676006ace0 0x7f676006d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.934+0000 7f6784af5700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f678015cf70 0x7f67800b4300 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.934+0000 7f6784af5700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f678006e030 0x7f678014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.934+0000 7f6784af5700 1 --2- 172.21.15.12:0/2233354734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67800cd5e0 0x7f67801581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:09.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.934+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 >> 172.21.15.12:0/2233354734 conn(0x7f678006b920 msgr2=0x7f67800b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:09.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.934+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 shutdown_connections 2023-07-07T18:16:09.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:09.935+0000 7f6784af5700 1 -- 172.21.15.12:0/2233354734 wait complete. 2023-07-07T18:16:09.938 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-07-07T18:16:09.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-07T18:16:10.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.087+0000 7f8fe2569700 1 Processor -- start 2023-07-07T18:16:10.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.087+0000 7f8fe2569700 1 -- start start 2023-07-07T18:16:10.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fe2569700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc070dc0 0x7f8fdc15cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fe2569700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8fdc15d100 0x7f8fdc06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fe2569700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fdc15c450 con 0x7f8fdc158960 2023-07-07T18:16:10.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fe2569700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc159440 con 0x7f8fdc15d100 2023-07-07T18:16:10.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fe2569700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc06b8f0 con 0x7f8fdc070dc0 2023-07-07T18:16:10.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fdb7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc070dc0 0x7f8fdc15cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fe0b06700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8fdc15d100 0x7f8fdc06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fdbfff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f8fdc158960 0x7f8fdc158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:49806/0 (socket says 172.21.15.12:49806) 2023-07-07T18:16:10.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fdb7fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc070dc0 0x7f8fdc15cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:48460/0 (socket says 172.21.15.12:48460) 2023-07-07T18:16:10.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.088+0000 7f8fdbfff700 1 -- 172.21.15.12:0/3390560741 learned_addr learned my addr 172.21.15.12:0/3390560741 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:10.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.089+0000 7f8fdb7fe700 1 -- 172.21.15.12:0/3390560741 >> v2:172.21.15.160:3300/0 conn(0x7f8fdc15d100 msgr2=0x7f8fdc06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:10.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.089+0000 7f8fdb7fe700 1 --2- 172.21.15.12:0/3390560741 >> v2:172.21.15.160:3300/0 conn(0x7f8fdc15d100 0x7f8fdc06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.089+0000 7f8fdb7fe700 1 -- 172.21.15.12:0/3390560741 >> v1:172.21.15.160:6789/0 conn(0x7f8fdc158960 legacy=0x7f8fdc158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.089+0000 7f8fdb7fe700 1 -- 172.21.15.12:0/3390560741 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc159640 con 0x7f8fdc070dc0 2023-07-07T18:16:10.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.089+0000 7f8fe0b06700 1 --2- 172.21.15.12:0/3390560741 >> v2:172.21.15.160:3300/0 conn(0x7f8fdc15d100 0x7f8fdc06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:16:10.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.089+0000 7f8fdb7fe700 1 --2- 172.21.15.12:0/3390560741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc070dc0 0x7f8fdc15cbc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000a9e0 tx=0x7f8fd000acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23672e44888114ea server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:10.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.089+0000 7f8fdaffd700 1 -- 172.21.15.12:0/3390560741 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000cb70 con 0x7f8fdc070dc0 2023-07-07T18:16:10.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.089+0000 7f8fdaffd700 1 -- 172.21.15.12:0/3390560741 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd000ccd0 con 0x7f8fdc070dc0 2023-07-07T18:16:10.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.089+0000 7f8fdaffd700 1 -- 172.21.15.12:0/3390560741 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0018620 con 0x7f8fdc070dc0 2023-07-07T18:16:10.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.090+0000 7f8fe2569700 1 -- 172.21.15.12:0/3390560741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc070dc0 msgr2=0x7f8fdc15cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.090+0000 7f8fe2569700 1 --2- 172.21.15.12:0/3390560741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc070dc0 0x7f8fdc15cbc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000a9e0 tx=0x7f8fd000acf0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.090+0000 7f8fe2569700 1 -- 172.21.15.12:0/3390560741 shutdown_connections 2023-07-07T18:16:10.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.090+0000 7f8fe2569700 1 --2- 172.21.15.12:0/3390560741 >> v2:172.21.15.160:3300/0 conn(0x7f8fdc15d100 0x7f8fdc06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.090+0000 7f8fe2569700 1 --2- 172.21.15.12:0/3390560741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc070dc0 0x7f8fdc15cbc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.090+0000 7f8fe2569700 1 -- 172.21.15.12:0/3390560741 >> 172.21.15.12:0/3390560741 conn(0x7f8fdc0b1990 msgr2=0x7f8fdc0cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:10.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.090+0000 7f8fe2569700 1 -- 172.21.15.12:0/3390560741 shutdown_connections 2023-07-07T18:16:10.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.090+0000 7f8fe2569700 1 -- 172.21.15.12:0/3390560741 wait complete. 2023-07-07T18:16:10.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.091+0000 7f8fe2569700 1 Processor -- start 2023-07-07T18:16:10.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.092+0000 7f8fe2569700 1 -- start start 2023-07-07T18:16:10.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.092+0000 7f8fe2569700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fdc070dc0 0x7f8fdc14c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.092+0000 7f8fe2569700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc158960 0x7f8fdc0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.092+0000 7f8fe2569700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc15d100 0x7f8fdc0c2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.092+0000 7f8fe2569700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14cf40 con 0x7f8fdc158960 2023-07-07T18:16:10.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.092+0000 7f8fe2569700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc0b2be0 con 0x7f8fdc070dc0 2023-07-07T18:16:10.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fe2569700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14c9b0 con 0x7f8fdc15d100 2023-07-07T18:16:10.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc158960 0x7f8fdc0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc158960 0x7f8fdc0c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59376/0 (socket says 172.21.15.12:59376) 2023-07-07T18:16:10.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdb7fe700 1 -- 172.21.15.12:0/2144454622 learned_addr learned my addr 172.21.15.12:0/2144454622 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:10.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fe0b06700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc15d100 0x7f8fdc0c2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdbfff700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fdc070dc0 0x7f8fdc14c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdb7fe700 1 -- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc15d100 msgr2=0x7f8fdc0c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdb7fe700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc15d100 0x7f8fdc0c2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdb7fe700 1 -- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fdc070dc0 msgr2=0x7f8fdc14c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdb7fe700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fdc070dc0 0x7f8fdc14c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdb7fe700 1 -- 172.21.15.12:0/2144454622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4009a70 con 0x7f8fdc158960 2023-07-07T18:16:10.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fe0b06700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc15d100 0x7f8fdc0c2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:10.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdbfff700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fdc070dc0 0x7f8fdc14c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:10.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fdb7fe700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc158960 0x7f8fdc0c8a40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000c4d0 tx=0x7f8fd00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:10.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fd8ff9700 1 -- 172.21.15.12:0/2144454622 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0003ab0 con 0x7f8fdc158960 2023-07-07T18:16:10.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fd8ff9700 1 -- 172.21.15.12:0/2144454622 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0003c10 con 0x7f8fdc158960 2023-07-07T18:16:10.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd000a640 con 0x7f8fdc158960 2023-07-07T18:16:10.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fd8ff9700 1 -- 172.21.15.12:0/2144454622 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0021480 con 0x7f8fdc158960 2023-07-07T18:16:10.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.093+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc0b2600 con 0x7f8fdc158960 2023-07-07T18:16:10.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.094+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fdc04ea20 con 0x7f8fdc158960 2023-07-07T18:16:10.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.095+0000 7f8fd8ff9700 1 -- 172.21.15.12:0/2144454622 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fd0018400 con 0x7f8fdc158960 2023-07-07T18:16:10.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.095+0000 7f8fd8ff9700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8fc806ace0 0x7f8fc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.095+0000 7f8fd8ff9700 1 -- 172.21.15.12:0/2144454622 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f8fd008ad80 con 0x7f8fdc158960 2023-07-07T18:16:10.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.096+0000 7f8fdbfff700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8fc806ace0 0x7f8fc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.096+0000 7f8fdbfff700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8fc806ace0 0x7f8fc806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc007fd0 tx=0x7f8fcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:10.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.100+0000 7f8fd8ff9700 1 -- 172.21.15.12:0/2144454622 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8fd0055d60 con 0x7f8fdc158960 2023-07-07T18:16:10.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.340+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8fdc067970 con 0x7f8fdc158960 2023-07-07T18:16:10.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.345+0000 7f8fd8ff9700 1 -- 172.21.15.12:0/2144454622 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8fd0059380 con 0x7f8fdc158960 2023-07-07T18:16:10.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.349+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8fc806ace0 msgr2=0x7f8fc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.349+0000 7f8fe2569700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8fc806ace0 0x7f8fc806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc007fd0 tx=0x7f8fcc009040 comp rx=0 tx=0).stop 2023-07-07T18:16:10.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.349+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc158960 msgr2=0x7f8fdc0c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.349+0000 7f8fe2569700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc158960 0x7f8fdc0c8a40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000c4d0 tx=0x7f8fd00047c0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.352+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 shutdown_connections 2023-07-07T18:16:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.352+0000 7f8fe2569700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f8fc806ace0 0x7f8fc806d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.352+0000 7f8fe2569700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8fdc15d100 0x7f8fdc0c2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.352+0000 7f8fe2569700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fdc070dc0 0x7f8fdc14c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.352+0000 7f8fe2569700 1 --2- 172.21.15.12:0/2144454622 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8fdc158960 0x7f8fdc0c8a40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.352+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 >> 172.21.15.12:0/2144454622 conn(0x7f8fdc0b1990 msgr2=0x7f8fdc0713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.354+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 shutdown_connections 2023-07-07T18:16:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.354+0000 7f8fe2569700 1 -- 172.21.15.12:0/2144454622 wait complete. 2023-07-07T18:16:10.362 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 6 and data pool 7 2023-07-07T18:16:10.379 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:16:10.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.502+0000 7f1d8155e700 1 Processor -- start 2023-07-07T18:16:10.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.502+0000 7f1d8155e700 1 -- start start 2023-07-07T18:16:10.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.503+0000 7f1d8155e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d7c06a600 0x7f1d7c0c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.503+0000 7f1d8155e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0cf2a0 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.503+0000 7f1d8155e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c0ce690 con 0x7f1d7c15c420 2023-07-07T18:16:10.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.503+0000 7f1d8155e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0ce970 con 0x7f1d7c06a600 2023-07-07T18:16:10.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.503+0000 7f1d7a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d7c06a600 0x7f1d7c0c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.503+0000 7f1d7a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d7c06a600 0x7f1d7c0c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59398/0 (socket says 172.21.15.12:59398) 2023-07-07T18:16:10.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.503+0000 7f1d7a7fc700 1 -- 172.21.15.12:0/1153265630 learned_addr learned my addr 172.21.15.12:0/1153265630 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d7a7fc700 1 -- 172.21.15.12:0/1153265630 >> v1:172.21.15.160:6789/0 conn(0x7f1d7c15c420 legacy=0x7f1d7c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d7a7fc700 1 -- 172.21.15.12:0/1153265630 >> v1:172.21.15.12:6789/0 conn(0x7f1d7c0b08d0 legacy=0x7f1d7c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d7a7fc700 1 -- 172.21.15.12:0/1153265630 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0cec50 con 0x7f1d7c06a600 2023-07-07T18:16:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d79ffb700 1 -- 172.21.15.12:0/1153265630 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339449496 0 0) 0x7f1d7c0cf2a0 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d7a7fc700 1 --2- 172.21.15.12:0/1153265630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c06a600 0x7f1d7c0c9df0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0098f0 tx=0x7f1d6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbdeabcde07f423 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d79ffb700 1 -- 172.21.15.12:0/1153265630 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c004230 con 0x7f1d7c06a600 2023-07-07T18:16:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d79ffb700 1 -- 172.21.15.12:0/1153265630 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c004390 con 0x7f1d7c06a600 2023-07-07T18:16:10.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d79ffb700 1 -- 172.21.15.12:0/1153265630 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0036a0 con 0x7f1d7c06a600 2023-07-07T18:16:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d8155e700 1 -- 172.21.15.12:0/1153265630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c06a600 msgr2=0x7f1d7c0c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d8155e700 1 --2- 172.21.15.12:0/1153265630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c06a600 0x7f1d7c0c9df0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0098f0 tx=0x7f1d6c009c00 comp rx=0 tx=0).stop 2023-07-07T18:16:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.504+0000 7f1d8155e700 1 -- 172.21.15.12:0/1153265630 shutdown_connections 2023-07-07T18:16:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.505+0000 7f1d8155e700 1 --2- 172.21.15.12:0/1153265630 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c06a600 0x7f1d7c0c9df0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.505+0000 7f1d8155e700 1 -- 172.21.15.12:0/1153265630 >> 172.21.15.12:0/1153265630 conn(0x7f1d7c06b920 msgr2=0x7f1d7c0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.505+0000 7f1d8155e700 1 -- 172.21.15.12:0/1153265630 shutdown_connections 2023-07-07T18:16:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.505+0000 7f1d8155e700 1 -- 172.21.15.12:0/1153265630 wait complete. 2023-07-07T18:16:10.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.506+0000 7f1d8155e700 1 Processor -- start 2023-07-07T18:16:10.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.506+0000 7f1d8155e700 1 -- start start 2023-07-07T18:16:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d8155e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d7c06a600 0x7f1d7c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d8155e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c0b08d0 0x7f1d7c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d8155e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1d7c15c420 0x7f1d7c157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d8155e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c15f180 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d8155e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c157db0 con 0x7f1d7c06a600 2023-07-07T18:16:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d8155e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c15f370 con 0x7f1d7c15c420 2023-07-07T18:16:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c0b08d0 0x7f1d7c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c0b08d0 0x7f1d7c15ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59404/0 (socket says 172.21.15.12:59404) 2023-07-07T18:16:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7a7fc700 1 -- 172.21.15.12:0/1429777461 learned_addr learned my addr 172.21.15.12:0/1429777461 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7affd700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d7c06a600 0x7f1d7c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7b7fe700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1d7c15c420 0x7f1d7c157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7a7fc700 1 -- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1d7c15c420 msgr2=0x7f1d7c157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7a7fc700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1d7c15c420 0x7f1d7c157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7a7fc700 1 -- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d7c06a600 msgr2=0x7f1d7c1f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7a7fc700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d7c06a600 0x7f1d7c1f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7a7fc700 1 -- 172.21.15.12:0/1429777461 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c009550 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d7a7fc700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c0b08d0 0x7f1d7c15ec40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c004000 tx=0x7f1d6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d637fe700 1 -- 172.21.15.12:0/1429777461 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00b660 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d637fe700 1 -- 172.21.15.12:0/1429777461 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00b800 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c15f650 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.507+0000 7f1d637fe700 1 -- 172.21.15.12:0/1429777461 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00bbb0 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.508+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c15fc10 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.509+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c15ce30 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.509+0000 7f1d637fe700 1 -- 172.21.15.12:0/1429777461 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d6c00bd10 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.509+0000 7f1d637fe700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1d6806ace0 0x7f1d6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.510+0000 7f1d637fe700 1 -- 172.21.15.12:0/1429777461 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1d6c08afd0 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.510+0000 7f1d7affd700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1d6806ace0 0x7f1d6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.510+0000 7f1d7affd700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1d6806ace0 0x7f1d6806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1d70004f30 tx=0x7f1d70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.519+0000 7f1d637fe700 1 -- 172.21.15.12:0/1429777461 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1d6c055f50 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.721+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d7c15fda0 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.723+0000 7f1d637fe700 1 -- 172.21.15.12:0/1429777461 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18513 (secure 0 0 0) 0x7f1d7c15fda0 con 0x7f1d7c0b08d0 2023-07-07T18:16:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:10.724 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":43,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:16:10.341374+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:16:07.998152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-07T18:16:09.313570+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:16:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1d6806ace0 msgr2=0x7f1d6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1d6806ace0 0x7f1d6806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1d70004f30 tx=0x7f1d70009040 comp rx=0 tx=0).stop 2023-07-07T18:16:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c0b08d0 msgr2=0x7f1d7c15ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c0b08d0 0x7f1d7c15ec40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c004000 tx=0x7f1d6c004750 comp rx=0 tx=0).stop 2023-07-07T18:16:10.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 shutdown_connections 2023-07-07T18:16:10.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1d6806ace0 0x7f1d6806d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1d7c15c420 0x7f1d7c157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1d7c06a600 0x7f1d7c1f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 --2- 172.21.15.12:0/1429777461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7c0b08d0 0x7f1d7c15ec40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 >> 172.21.15.12:0/1429777461 conn(0x7f1d7c06b920 msgr2=0x7f1d7c0b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:10.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 shutdown_connections 2023-07-07T18:16:10.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.725+0000 7f1d8155e700 1 -- 172.21.15.12:0/1429777461 wait complete. 2023-07-07T18:16:10.739 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:16:10.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.862+0000 7f436bb41700 1 Processor -- start 2023-07-07T18:16:10.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.863+0000 7f436bb41700 1 -- start start 2023-07-07T18:16:10.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.863+0000 7f436bb41700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43640caf00 0x7f436415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.863+0000 7f436bb41700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f436415b130 0x7f43640ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.863+0000 7f436bb41700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436415b520 con 0x7f436415a820 2023-07-07T18:16:10.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.863+0000 7f436bb41700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4364154a80 con 0x7f43640caf00 2023-07-07T18:16:10.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.863+0000 7f436bb41700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43640d1210 con 0x7f436415b130 2023-07-07T18:16:10.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43690dc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43640caf00 0x7f436415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43690dc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43640caf00 0x7f436415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59412/0 (socket says 172.21.15.12:59412) 2023-07-07T18:16:10.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43690dc700 1 -- 172.21.15.12:0/4146662115 learned_addr learned my addr 172.21.15.12:0/4146662115 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:10.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f436a0de700 1 --2- 172.21.15.12:0/4146662115 >> v2:172.21.15.160:3300/0 conn(0x7f436415b130 0x7f43640ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43690dc700 1 -- 172.21.15.12:0/4146662115 >> v2:172.21.15.160:3300/0 conn(0x7f436415b130 msgr2=0x7f43640ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:10.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43690dc700 1 --2- 172.21.15.12:0/4146662115 >> v2:172.21.15.160:3300/0 conn(0x7f436415b130 0x7f43640ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43690dc700 1 -- 172.21.15.12:0/4146662115 >> v1:172.21.15.160:6789/0 conn(0x7f436415a820 legacy=0x7f43640d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:10.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43690dc700 1 -- 172.21.15.12:0/4146662115 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43640cb380 con 0x7f43640caf00 2023-07-07T18:16:10.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f436a0de700 1 --2- 172.21.15.12:0/4146662115 >> v2:172.21.15.160:3300/0 conn(0x7f436415b130 0x7f43640ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:16:10.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43690dc700 1 --2- 172.21.15.12:0/4146662115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 0x7f436415abf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f436406f5d0 tx=0x7f4358009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b581d587e7f2ff8 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:10.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43688db700 1 -- 172.21.15.12:0/4146662115 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358004230 con 0x7f43640caf00 2023-07-07T18:16:10.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43688db700 1 -- 172.21.15.12:0/4146662115 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4358004390 con 0x7f43640caf00 2023-07-07T18:16:10.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.864+0000 7f43688db700 1 -- 172.21.15.12:0/4146662115 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580036a0 con 0x7f43640caf00 2023-07-07T18:16:10.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.865+0000 7f436bb41700 1 -- 172.21.15.12:0/4146662115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 msgr2=0x7f436415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.865+0000 7f436bb41700 1 --2- 172.21.15.12:0/4146662115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 0x7f436415abf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f436406f5d0 tx=0x7f4358009bd0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.865+0000 7f436bb41700 1 -- 172.21.15.12:0/4146662115 shutdown_connections 2023-07-07T18:16:10.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.865+0000 7f436bb41700 1 --2- 172.21.15.12:0/4146662115 >> v2:172.21.15.160:3300/0 conn(0x7f436415b130 0x7f43640ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.865+0000 7f436bb41700 1 --2- 172.21.15.12:0/4146662115 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 0x7f436415abf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.865+0000 7f436bb41700 1 -- 172.21.15.12:0/4146662115 >> 172.21.15.12:0/4146662115 conn(0x7f436406e530 msgr2=0x7f436406e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:10.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.865+0000 7f436bb41700 1 -- 172.21.15.12:0/4146662115 shutdown_connections 2023-07-07T18:16:10.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.865+0000 7f436bb41700 1 -- 172.21.15.12:0/4146662115 wait complete. 2023-07-07T18:16:10.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.866+0000 7f436bb41700 1 Processor -- start 2023-07-07T18:16:10.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.866+0000 7f436bb41700 1 -- start start 2023-07-07T18:16:10.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f436bb41700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 0x7f43640c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f436bb41700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f436415a820 0x7f43640c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f436bb41700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f436415b130 0x7f436414fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f436bb41700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43640c6a10 con 0x7f43640caf00 2023-07-07T18:16:10.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f436bb41700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43640c6490 con 0x7f436415b130 2023-07-07T18:16:10.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f436bb41700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43640c88d0 con 0x7f436415a820 2023-07-07T18:16:10.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f43698dd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 0x7f43640c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f43698dd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 0x7f43640c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59416/0 (socket says 172.21.15.12:59416) 2023-07-07T18:16:10.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f43698dd700 1 -- 172.21.15.12:0/2896585583 learned_addr learned my addr 172.21.15.12:0/2896585583 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:10.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f436a0de700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f436415b130 0x7f436414fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f43690dc700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f436415a820 0x7f43640c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f43698dd700 1 -- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f436415a820 msgr2=0x7f43640c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f43698dd700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f436415a820 0x7f43640c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f43698dd700 1 -- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f436415b130 msgr2=0x7f436414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:10.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f43698dd700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f436415b130 0x7f436414fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:10.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.867+0000 7f43698dd700 1 -- 172.21.15.12:0/2896585583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4358009550 con 0x7f43640caf00 2023-07-07T18:16:10.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.868+0000 7f43698dd700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 0x7f43640c8390 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f436000c4d0 tx=0x7f436000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:10.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.868+0000 7f43567fc700 1 -- 172.21.15.12:0/2896585583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360011790 con 0x7f43640caf00 2023-07-07T18:16:10.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.868+0000 7f43567fc700 1 -- 172.21.15.12:0/2896585583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43600118f0 con 0x7f43640caf00 2023-07-07T18:16:10.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.868+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43640c6730 con 0x7f43640caf00 2023-07-07T18:16:10.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.868+0000 7f43567fc700 1 -- 172.21.15.12:0/2896585583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4360011ca0 con 0x7f43640caf00 2023-07-07T18:16:10.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.868+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43640c4820 con 0x7f43640caf00 2023-07-07T18:16:10.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.869+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43640c4380 con 0x7f43640caf00 2023-07-07T18:16:10.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.869+0000 7f43567fc700 1 -- 172.21.15.12:0/2896585583 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f436001c460 con 0x7f43640caf00 2023-07-07T18:16:10.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.870+0000 7f43567fc700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f434806ace0 0x7f434806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:10.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.870+0000 7f43567fc700 1 -- 172.21.15.12:0/2896585583 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4360089470 con 0x7f43640caf00 2023-07-07T18:16:10.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.870+0000 7f43690dc700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f434806ace0 0x7f434806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:10.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.871+0000 7f43690dc700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f434806ace0 0x7f434806d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4358009130 tx=0x7f4358008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:10.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:10.874+0000 7f43567fc700 1 -- 172.21.15.12:0/2896585583 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43600543e0 con 0x7f43640caf00 2023-07-07T18:16:11.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.076+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4364073910 con 0x7f43640caf00 2023-07-07T18:16:11.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.077+0000 7f43567fc700 1 -- 172.21.15.12:0/2896585583 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18513 (secure 0 0 0) 0x7f4360057a00 con 0x7f43640caf00 2023-07-07T18:16:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:11.079 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":43,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:16:10.341374+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:16:07.998152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-07T18:16:09.313570+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:16:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f434806ace0 msgr2=0x7f434806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f434806ace0 0x7f434806d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4358009130 tx=0x7f4358008030 comp rx=0 tx=0).stop 2023-07-07T18:16:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 msgr2=0x7f43640c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 0x7f43640c8390 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f436000c4d0 tx=0x7f436000c890 comp rx=0 tx=0).stop 2023-07-07T18:16:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 shutdown_connections 2023-07-07T18:16:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f434806ace0 0x7f434806d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f436415b130 0x7f436414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43640caf00 0x7f43640c8390 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 --2- 172.21.15.12:0/2896585583 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f436415a820 0x7f43640c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 >> 172.21.15.12:0/2896585583 conn(0x7f436406e530 msgr2=0x7f4364150820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:11.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 shutdown_connections 2023-07-07T18:16:11.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.079+0000 7f436bb41700 1 -- 172.21.15.12:0/2896585583 wait complete. 2023-07-07T18:16:11.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-07T18:16:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.220+0000 7f87ca572700 1 Processor -- start 2023-07-07T18:16:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.220+0000 7f87ca572700 1 -- start start 2023-07-07T18:16:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87ca572700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c40cd5e0 0x7f87c40cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87ca572700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f87c406e030 0x7f87c406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87ca572700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c406f0e0 con 0x7f87c415cf70 2023-07-07T18:16:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87ca572700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c40ce2c0 con 0x7f87c406e030 2023-07-07T18:16:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87ca572700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40cdef0 con 0x7f87c40cd5e0 2023-07-07T18:16:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c8b0f700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f87c415cf70 0x7f87c415d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56626/0 (socket says 172.21.15.12:56626) 2023-07-07T18:16:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c8b0f700 1 -- 172.21.15.12:0/1383445329 learned_addr learned my addr 172.21.15.12:0/1383445329 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c37fe700 1 --2- 172.21.15.12:0/1383445329 >> v2:172.21.15.160:3300/0 conn(0x7f87c406e030 0x7f87c406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c3fff700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c40cd5e0 0x7f87c40cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184360419 0 0) 0x7f87c406f0e0 con 0x7f87c415cf70 2023-07-07T18:16:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ac0035b0 con 0x7f87c415cf70 2023-07-07T18:16:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2980395844 0 0) 0x7f87ac0035b0 con 0x7f87c415cf70 2023-07-07T18:16:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c40cd5e0 msgr2=0x7f87c40cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c40cd5e0 0x7f87c40cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 >> v2:172.21.15.160:3300/0 conn(0x7f87c406e030 msgr2=0x7f87c406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 --2- 172.21.15.12:0/1383445329 >> v2:172.21.15.160:3300/0 conn(0x7f87c406e030 0x7f87c406e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c406eb20 con 0x7f87c415cf70 2023-07-07T18:16:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f87bc0019f0 con 0x7f87c415cf70 2023-07-07T18:16:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 >> v1:172.21.15.12:6789/0 conn(0x7f87c415cf70 legacy=0x7f87c415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87ac003a00 0x7f87ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c40cd5e0 0x7f87ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac004d90 0x7f87ac005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40ce2c0 con 0x7f87ac004d90 2023-07-07T18:16:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40cdef0 con 0x7f87ac003a00 2023-07-07T18:16:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac00ba10 con 0x7f87c40cd5e0 2023-07-07T18:16:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.221+0000 7f87c37fe700 1 --2- 172.21.15.12:0/1383445329 >> v2:172.21.15.160:3300/0 conn(0x7f87c406e030 0x7f87c406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:16:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c8b0f700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac004d90 0x7f87ac005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:11.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c3fff700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87ac003a00 0x7f87ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c37fe700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c40cd5e0 0x7f87ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c8b0f700 1 -- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c40cd5e0 msgr2=0x7f87ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c8b0f700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c40cd5e0 0x7f87ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c8b0f700 1 -- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87ac003a00 msgr2=0x7f87ac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c8b0f700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87ac003a00 0x7f87ac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c8b0f700 1 -- 172.21.15.12:0/1383445329 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0035b0 con 0x7f87ac004d90 2023-07-07T18:16:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c8b0f700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac004d90 0x7f87ac005200 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00a860 tx=0x7f87ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e3cbfcfd3c249b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc012600 con 0x7f87ac004d90 2023-07-07T18:16:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc012760 con 0x7f87ac004d90 2023-07-07T18:16:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.222+0000 7f87c2ffd700 1 -- 172.21.15.12:0/1383445329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc012b10 con 0x7f87ac004d90 2023-07-07T18:16:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.223+0000 7f87ca572700 1 -- 172.21.15.12:0/1383445329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac004d90 msgr2=0x7f87ac005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.223+0000 7f87ca572700 1 --2- 172.21.15.12:0/1383445329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87ac004d90 0x7f87ac005200 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f87bc00a860 tx=0x7f87ac005880 comp rx=0 tx=0).stop 2023-07-07T18:16:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.223+0000 7f87c8b0f700 1 -- 172.21.15.12:0/1383445329 reap_dead start 2023-07-07T18:16:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.223+0000 7f87ca572700 1 -- 172.21.15.12:0/1383445329 shutdown_connections 2023-07-07T18:16:11.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.223+0000 7f87ca572700 1 -- 172.21.15.12:0/1383445329 >> 172.21.15.12:0/1383445329 conn(0x7f87c406b920 msgr2=0x7f87c40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:11.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.223+0000 7f87ca572700 1 -- 172.21.15.12:0/1383445329 shutdown_connections 2023-07-07T18:16:11.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.223+0000 7f87ca572700 1 -- 172.21.15.12:0/1383445329 wait complete. 2023-07-07T18:16:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.224+0000 7f87ca572700 1 Processor -- start 2023-07-07T18:16:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.224+0000 7f87ca572700 1 -- start start 2023-07-07T18:16:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87ca572700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c414d180 0x7f87c40b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87ca572700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87c414d550 0x7f87c414d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87ca572700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c414df10 0x7f87c40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87ca572700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c4150a80 con 0x7f87c414df10 2023-07-07T18:16:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87ca572700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41504c0 con 0x7f87c414d550 2023-07-07T18:16:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87ca572700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41507a0 con 0x7f87c414d180 2023-07-07T18:16:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c8b0f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c414df10 0x7f87c40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c8b0f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c414df10 0x7f87c40ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59440/0 (socket says 172.21.15.12:59440) 2023-07-07T18:16:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c8b0f700 1 -- 172.21.15.12:0/577719260 learned_addr learned my addr 172.21.15.12:0/577719260 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c3fff700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c414d180 0x7f87c40b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:11.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c37fe700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87c414d550 0x7f87c414d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c8b0f700 1 -- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c414d180 msgr2=0x7f87c40b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c8b0f700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c414d180 0x7f87c40b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c8b0f700 1 -- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87c414d550 msgr2=0x7f87c414d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c8b0f700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87c414d550 0x7f87c414d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.225+0000 7f87c8b0f700 1 -- 172.21.15.12:0/577719260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c415b260 con 0x7f87c414df10 2023-07-07T18:16:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.226+0000 7f87c8b0f700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c414df10 0x7f87c40ad090 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f87bc015040 tx=0x7f87bc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.226+0000 7f87c0ff9700 1 -- 172.21.15.12:0/577719260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0019c0 con 0x7f87c414df10 2023-07-07T18:16:11.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.226+0000 7f87c0ff9700 1 -- 172.21.15.12:0/577719260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc027410 con 0x7f87c414df10 2023-07-07T18:16:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.226+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c415b540 con 0x7f87c414df10 2023-07-07T18:16:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.226+0000 7f87c0ff9700 1 -- 172.21.15.12:0/577719260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0277e0 con 0x7f87c414df10 2023-07-07T18:16:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.226+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c4159870 con 0x7f87c414df10 2023-07-07T18:16:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.227+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c415b0c0 con 0x7f87c414df10 2023-07-07T18:16:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.227+0000 7f87c0ff9700 1 -- 172.21.15.12:0/577719260 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87bc019070 con 0x7f87c414df10 2023-07-07T18:16:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.228+0000 7f87c0ff9700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f87b006ace0 0x7f87b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.228+0000 7f87c0ff9700 1 -- 172.21.15.12:0/577719260 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f87bc08abd0 con 0x7f87c414df10 2023-07-07T18:16:11.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.228+0000 7f87c3fff700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f87b006ace0 0x7f87b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.229+0000 7f87c3fff700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f87b006ace0 0x7f87b006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009bc0 tx=0x7f87b80091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.232+0000 7f87c0ff9700 1 -- 172.21.15.12:0/577719260 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87c415b0c0 con 0x7f87c414df10 2023-07-07T18:16:11.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:11.478+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f87c415b0c0 con 0x7f87c414df10 2023-07-07T18:16:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.350+0000 7f87c0ff9700 1 -- 172.21.15.12:0/577719260 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f87c415b0c0 con 0x7f87c414df10 2023-07-07T18:16:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f87b006ace0 msgr2=0x7f87b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:12.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f87b006ace0 0x7f87b006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009bc0 tx=0x7f87b80091c0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c414df10 msgr2=0x7f87c40ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c414df10 0x7f87c40ad090 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f87bc015040 tx=0x7f87bc001d80 comp rx=0 tx=0).stop 2023-07-07T18:16:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 shutdown_connections 2023-07-07T18:16:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f87b006ace0 0x7f87b006d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87c414df10 0x7f87c40ad090 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f87c414d180 0x7f87c40b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 --2- 172.21.15.12:0/577719260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f87c414d550 0x7f87c414d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 >> 172.21.15.12:0/577719260 conn(0x7f87c406b920 msgr2=0x7f87c40af470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 shutdown_connections 2023-07-07T18:16:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.353+0000 7f87ca572700 1 -- 172.21.15.12:0/577719260 wait complete. 2023-07-07T18:16:12.369 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-07T18:16:12.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-07T18:16:12.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.503+0000 7fcdeeca8700 1 Processor -- start 2023-07-07T18:16:12.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.503+0000 7fcdeeca8700 1 -- start start 2023-07-07T18:16:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.503+0000 7fcdeeca8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcde815fc60 0x7fcde806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.503+0000 7fcdeeca8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde80aecc0 0x7fcde80ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.503+0000 7fcdeeca8700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcde806e260 0x7fcde806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.503+0000 7fcdeeca8700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde806ec40 con 0x7fcde806e260 2023-07-07T18:16:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.503+0000 7fcdeeca8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde80ce620 con 0x7fcde815fc60 2023-07-07T18:16:12.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.503+0000 7fcdeeca8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde8160580 con 0x7fcde80aecc0 2023-07-07T18:16:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcded245700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcde806e260 0x7fcde806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcded245700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcde806e260 0x7fcde806e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59448/0 (socket says 172.21.15.12:59448) 2023-07-07T18:16:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcded245700 1 -- 172.21.15.12:0/2969249819 learned_addr learned my addr 172.21.15.12:0/2969249819 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcdeca44700 1 --2- 172.21.15.12:0/2969249819 >> v2:172.21.15.160:3300/0 conn(0x7fcde815fc60 0x7fcde806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcded245700 1 -- 172.21.15.12:0/2969249819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde80aecc0 msgr2=0x7fcde80ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcde7fff700 1 --2- 172.21.15.12:0/2969249819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde80aecc0 0x7fcde80ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:12.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcded245700 1 --2- 172.21.15.12:0/2969249819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde80aecc0 0x7fcde80ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcded245700 1 -- 172.21.15.12:0/2969249819 >> v2:172.21.15.160:3300/0 conn(0x7fcde815fc60 msgr2=0x7fcde806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcded245700 1 --2- 172.21.15.12:0/2969249819 >> v2:172.21.15.160:3300/0 conn(0x7fcde815fc60 0x7fcde806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcded245700 1 -- 172.21.15.12:0/2969249819 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8160860 con 0x7fcde806e260 2023-07-07T18:16:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcdeca44700 1 --2- 172.21.15.12:0/2969249819 >> v2:172.21.15.160:3300/0 conn(0x7fcde815fc60 0x7fcde806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:16:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcde7fff700 1 --2- 172.21.15.12:0/2969249819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde80aecc0 0x7fcde80ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:16:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcded245700 1 --2- 172.21.15.12:0/2969249819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 0x7fcde806e700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcde8066830 tx=0x7fcde000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f0b957a4716ced server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:12.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcde77fe700 1 -- 172.21.15.12:0/2969249819 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000e070 con 0x7fcde806e260 2023-07-07T18:16:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcde77fe700 1 -- 172.21.15.12:0/2969249819 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde000b9c0 con 0x7fcde806e260 2023-07-07T18:16:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.504+0000 7fcde77fe700 1 -- 172.21.15.12:0/2969249819 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000bd70 con 0x7fcde806e260 2023-07-07T18:16:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.505+0000 7fcdeeca8700 1 -- 172.21.15.12:0/2969249819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 msgr2=0x7fcde806e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.505+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/2969249819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 0x7fcde806e700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcde8066830 tx=0x7fcde000b330 comp rx=0 tx=0).stop 2023-07-07T18:16:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.505+0000 7fcdeeca8700 1 -- 172.21.15.12:0/2969249819 shutdown_connections 2023-07-07T18:16:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.505+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/2969249819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 0x7fcde806e700 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.505+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/2969249819 >> v2:172.21.15.160:3300/0 conn(0x7fcde815fc60 0x7fcde806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.505+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/2969249819 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde80aecc0 0x7fcde80ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.505+0000 7fcdeeca8700 1 -- 172.21.15.12:0/2969249819 >> 172.21.15.12:0/2969249819 conn(0x7fcde806b920 msgr2=0x7fcde80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.505+0000 7fcdeeca8700 1 -- 172.21.15.12:0/2969249819 shutdown_connections 2023-07-07T18:16:12.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.505+0000 7fcdeeca8700 1 -- 172.21.15.12:0/2969249819 wait complete. 2023-07-07T18:16:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.506+0000 7fcdeeca8700 1 Processor -- start 2023-07-07T18:16:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.506+0000 7fcdeeca8700 1 -- start start 2023-07-07T18:16:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeeca8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 0x7fcde81e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeeca8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde80aecc0 0x7fcde81e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeeca8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde815fc60 0x7fcde81e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:12.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeeca8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde8154a80 con 0x7fcde806e260 2023-07-07T18:16:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeeca8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80c4ac0 con 0x7fcde80aecc0 2023-07-07T18:16:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeeca8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80c4da0 con 0x7fcde815fc60 2023-07-07T18:16:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeca44700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 0x7fcde81e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeca44700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 0x7fcde81e5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59450/0 (socket says 172.21.15.12:59450) 2023-07-07T18:16:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeca44700 1 -- 172.21.15.12:0/1780176460 learned_addr learned my addr 172.21.15.12:0/1780176460 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.507+0000 7fcdeca44700 1 -- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde815fc60 msgr2=0x7fcde81e7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:12.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcdeca44700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde815fc60 0x7fcde81e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcdeca44700 1 -- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde80aecc0 msgr2=0x7fcde81e8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcdeca44700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde80aecc0 0x7fcde81e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcdeca44700 1 -- 172.21.15.12:0/1780176460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0009b30 con 0x7fcde806e260 2023-07-07T18:16:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcdeca44700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 0x7fcde81e5f10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c7f0 tx=0x7fcdd000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcde57fa700 1 -- 172.21.15.12:0/1780176460 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0005c20 con 0x7fcde806e260 2023-07-07T18:16:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcde57fa700 1 -- 172.21.15.12:0/1780176460 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd0005d80 con 0x7fcde806e260 2023-07-07T18:16:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde80c5080 con 0x7fcde806e260 2023-07-07T18:16:12.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcde57fa700 1 -- 172.21.15.12:0/1780176460 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0011820 con 0x7fcde806e260 2023-07-07T18:16:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.508+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde81e82b0 con 0x7fcde806e260 2023-07-07T18:16:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.509+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde81e8910 con 0x7fcde806e260 2023-07-07T18:16:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.509+0000 7fcde57fa700 1 -- 172.21.15.12:0/1780176460 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcdd0011980 con 0x7fcde806e260 2023-07-07T18:16:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.510+0000 7fcde57fa700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcdc806ace0 0x7fcdc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.510+0000 7fcde57fa700 1 -- 172.21.15.12:0/1780176460 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcdd0089900 con 0x7fcde806e260 2023-07-07T18:16:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.510+0000 7fcde7fff700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcdc806ace0 0x7fcdc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:12.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.511+0000 7fcde7fff700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcdc806ace0 0x7fcdc806d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8006fd0 tx=0x7fcdd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:12.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.514+0000 7fcde57fa700 1 -- 172.21.15.12:0/1780176460 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcde81e8910 con 0x7fcde806e260 2023-07-07T18:16:12.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:12.759+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcde81e8910 con 0x7fcde806e260 2023-07-07T18:16:12.904 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T18:16:12.903+0000 7f23f2e3d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-07T18:16:13.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.355+0000 7fcde57fa700 1 -- 172.21.15.12:0/1780176460 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcde81e8910 con 0x7fcde806e260 2023-07-07T18:16:13.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcdc806ace0 msgr2=0x7fcdc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcdc806ace0 0x7fcdc806d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8006fd0 tx=0x7fcdd8008040 comp rx=0 tx=0).stop 2023-07-07T18:16:13.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 msgr2=0x7fcde81e5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 0x7fcde81e5f10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c7f0 tx=0x7fcdd000cbb0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 shutdown_connections 2023-07-07T18:16:13.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fcdc806ace0 0x7fcdc806d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcde815fc60 0x7fcde81e7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcde806e260 0x7fcde81e5f10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 --2- 172.21.15.12:0/1780176460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde80aecc0 0x7fcde81e8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 >> 172.21.15.12:0/1780176460 conn(0x7fcde806b920 msgr2=0x7fcde80b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:13.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 shutdown_connections 2023-07-07T18:16:13.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.358+0000 7fcdeeca8700 1 -- 172.21.15.12:0/1780176460 wait complete. 2023-07-07T18:16:13.374 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-07T18:16:13.375 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:16:13.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.507+0000 7fd6dae75700 1 Processor -- start 2023-07-07T18:16:13.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.507+0000 7fd6dae75700 1 -- start start 2023-07-07T18:16:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.508+0000 7fd6dae75700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd6d40cddd0 0x7fd6d415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.508+0000 7fd6dae75700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ae6c0 0x7fd6d40aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.508+0000 7fd6dae75700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d415d6a0 con 0x7fd6d40ce1a0 2023-07-07T18:16:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.508+0000 7fd6dae75700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d40cdc80 con 0x7fd6d40cddd0 2023-07-07T18:16:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.508+0000 7fd6dae75700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4159700 con 0x7fd6d40ae6c0 2023-07-07T18:16:13.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.508+0000 7fd6d8c11700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd6d40cddd0 0x7fd6d415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.508+0000 7fd6d9412700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd6d40ce1a0 0x7fd6d40714a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56658/0 (socket says 172.21.15.12:56658) 2023-07-07T18:16:13.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.508+0000 7fd6d9412700 1 -- 172.21.15.12:0/3529928751 learned_addr learned my addr 172.21.15.12:0/3529928751 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:13.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d3fff700 1 --2- 172.21.15.12:0/3529928751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ae6c0 0x7fd6d40aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d8c11700 1 -- 172.21.15.12:0/3529928751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ae6c0 msgr2=0x7fd6d40aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:13.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d8c11700 1 --2- 172.21.15.12:0/3529928751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ae6c0 0x7fd6d40aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d8c11700 1 -- 172.21.15.12:0/3529928751 >> v1:172.21.15.12:6789/0 conn(0x7fd6d40ce1a0 legacy=0x7fd6d40714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d37fe700 1 -- 172.21.15.12:0/3529928751 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490012169 0 0) 0x7fd6d415d6a0 con 0x7fd6d40ce1a0 2023-07-07T18:16:13.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d8c11700 1 -- 172.21.15.12:0/3529928751 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d41599e0 con 0x7fd6d40cddd0 2023-07-07T18:16:13.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d8c11700 1 --2- 172.21.15.12:0/3529928751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 0x7fd6d415a1e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009840 tx=0x7fd6c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a336eb6ec85c4e0c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:13.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d37fe700 1 -- 172.21.15.12:0/3529928751 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8011830 con 0x7fd6d40cddd0 2023-07-07T18:16:13.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d37fe700 1 -- 172.21.15.12:0/3529928751 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c8011990 con 0x7fd6d40cddd0 2023-07-07T18:16:13.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.509+0000 7fd6d37fe700 1 -- 172.21.15.12:0/3529928751 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8011d20 con 0x7fd6d40cddd0 2023-07-07T18:16:13.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.510+0000 7fd6dae75700 1 -- 172.21.15.12:0/3529928751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 msgr2=0x7fd6d415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.510+0000 7fd6dae75700 1 --2- 172.21.15.12:0/3529928751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 0x7fd6d415a1e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009840 tx=0x7fd6c8009b50 comp rx=0 tx=0).stop 2023-07-07T18:16:13.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.510+0000 7fd6dae75700 1 -- 172.21.15.12:0/3529928751 shutdown_connections 2023-07-07T18:16:13.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.510+0000 7fd6dae75700 1 --2- 172.21.15.12:0/3529928751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 0x7fd6d415a1e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.510+0000 7fd6dae75700 1 --2- 172.21.15.12:0/3529928751 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ae6c0 0x7fd6d40aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.510+0000 7fd6dae75700 1 -- 172.21.15.12:0/3529928751 >> 172.21.15.12:0/3529928751 conn(0x7fd6d406d4a0 msgr2=0x7fd6d406d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:13.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.510+0000 7fd6dae75700 1 -- 172.21.15.12:0/3529928751 shutdown_connections 2023-07-07T18:16:13.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.510+0000 7fd6dae75700 1 -- 172.21.15.12:0/3529928751 wait complete. 2023-07-07T18:16:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.511+0000 7fd6dae75700 1 Processor -- start 2023-07-07T18:16:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.511+0000 7fd6dae75700 1 -- start start 2023-07-07T18:16:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6dae75700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6d40ae6c0 0x7fd6d40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6dae75700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 0x7fd6d41e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6dae75700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ce1a0 0x7fd6d41f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6dae75700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d41f3040 con 0x7fd6d40cddd0 2023-07-07T18:16:13.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6dae75700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d41f3320 con 0x7fd6d40ae6c0 2023-07-07T18:16:13.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6dae75700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40b4690 con 0x7fd6d40ce1a0 2023-07-07T18:16:13.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 0x7fd6d41e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 0x7fd6d41e4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59464/0 (socket says 172.21.15.12:59464) 2023-07-07T18:16:13.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d3fff700 1 -- 172.21.15.12:0/4167300281 learned_addr learned my addr 172.21.15.12:0/4167300281 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:13.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d9412700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ce1a0 0x7fd6d41f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d8c11700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6d40ae6c0 0x7fd6d40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d3fff700 1 -- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ce1a0 msgr2=0x7fd6d41f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d3fff700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ce1a0 0x7fd6d41f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d3fff700 1 -- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6d40ae6c0 msgr2=0x7fd6d40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d3fff700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6d40ae6c0 0x7fd6d40b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d3fff700 1 -- 172.21.15.12:0/4167300281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c80094a0 con 0x7fd6d40cddd0 2023-07-07T18:16:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.512+0000 7fd6d3fff700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 0x7fd6d41e4a60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000faa0 tx=0x7fd6c000fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.513+0000 7fd6d17fa700 1 -- 172.21.15.12:0/4167300281 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0007ac0 con 0x7fd6d40cddd0 2023-07-07T18:16:13.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.513+0000 7fd6d17fa700 1 -- 172.21.15.12:0/4167300281 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c0007c20 con 0x7fd6d40cddd0 2023-07-07T18:16:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.513+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d40b4970 con 0x7fd6d40cddd0 2023-07-07T18:16:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.513+0000 7fd6d17fa700 1 -- 172.21.15.12:0/4167300281 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c001a460 con 0x7fd6d40cddd0 2023-07-07T18:16:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.513+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d4150f80 con 0x7fd6d40cddd0 2023-07-07T18:16:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.513+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d406f120 con 0x7fd6d40cddd0 2023-07-07T18:16:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.514+0000 7fd6d17fa700 1 -- 172.21.15.12:0/4167300281 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6c0011450 con 0x7fd6d40cddd0 2023-07-07T18:16:13.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.514+0000 7fd6d17fa700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6b806ace0 0x7fd6b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.515+0000 7fd6d17fa700 1 -- 172.21.15.12:0/4167300281 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd6c008bb70 con 0x7fd6d40cddd0 2023-07-07T18:16:13.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.515+0000 7fd6d8c11700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6b806ace0 0x7fd6b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.515+0000 7fd6d8c11700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6b806ace0 0x7fd6b806d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8000c00 tx=0x7fd6c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:13.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.519+0000 7fd6d17fa700 1 -- 172.21.15.12:0/4167300281 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd6c0056b70 con 0x7fd6d40cddd0 2023-07-07T18:16:13.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.758+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6d4065ea0 con 0x7fd6d40cddd0 2023-07-07T18:16:13.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.759+0000 7fd6d17fa700 1 -- 172.21.15.12:0/4167300281 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fd6c0015090 con 0x7fd6d40cddd0 2023-07-07T18:16:13.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:13.761 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4940,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3149524046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3149524046},{"type":"v1","addr":"172.21.15.160:6836","nonce":3149524046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/4237530545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":4237530545},{"type":"v1","addr":"172.21.15.160:6837","nonce":4237530545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/2202914234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2202914234},{"type":"v1","addr":"172.21.15.12:6834","nonce":2202914234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:16:10.341699+0000","modified":"2023-07-07T18:16:13.349164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5421":{"gid":5421,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.12:6835/2736425727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2736425727},{"type":"v1","addr":"172.21.15.12:6835","nonce":2736425727}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-07T18:16:13.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6b806ace0 msgr2=0x7fd6b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6b806ace0 0x7fd6b806d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8000c00 tx=0x7fd6c8008030 comp rx=0 tx=0).stop 2023-07-07T18:16:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 msgr2=0x7fd6d41e4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 0x7fd6d41e4a60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000faa0 tx=0x7fd6c000fe60 comp rx=0 tx=0).stop 2023-07-07T18:16:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 shutdown_connections 2023-07-07T18:16:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6b806ace0 0x7fd6b806d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6d40ce1a0 0x7fd6d41f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6d40ae6c0 0x7fd6d40b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 --2- 172.21.15.12:0/4167300281 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6d40cddd0 0x7fd6d41e4a60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 >> 172.21.15.12:0/4167300281 conn(0x7fd6d406d4a0 msgr2=0x7fd6d40cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:13.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 shutdown_connections 2023-07-07T18:16:13.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.761+0000 7fd6dae75700 1 -- 172.21.15.12:0/4167300281 wait complete. 2023-07-07T18:16:13.766 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2023-07-07T18:16:13.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T18:16:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.898+0000 7f4ca61c4700 1 Processor -- start 2023-07-07T18:16:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.898+0000 7f4ca61c4700 1 -- start start 2023-07-07T18:16:13.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4ca61c4700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ca015c420 0x7f4ca0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4ca61c4700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca00cf2a0 con 0x7f4ca00b08d0 2023-07-07T18:16:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4ca61c4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca00cce40 con 0x7f4ca00cae00 2023-07-07T18:16:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4ca61c4700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca00ce690 con 0x7f4ca015c420 2023-07-07T18:16:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ca015c420 0x7f4ca0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9effd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4ca00b08d0 0x7f4ca00cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56668/0 (socket says 172.21.15.12:56668) 2023-07-07T18:16:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9effd700 1 -- 172.21.15.12:0/4028021085 learned_addr learned my addr 172.21.15.12:0/4028021085 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:13.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9f7fe700 1 -- 172.21.15.12:0/4028021085 >> v1:172.21.15.160:6789/0 conn(0x7f4ca00cae00 legacy=0x7f4ca00cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9f7fe700 1 -- 172.21.15.12:0/4028021085 >> v1:172.21.15.12:6789/0 conn(0x7f4ca00b08d0 legacy=0x7f4ca00cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9e7fc700 1 -- 172.21.15.12:0/4028021085 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117387510 0 0) 0x7f4ca00cf2a0 con 0x7f4ca00b08d0 2023-07-07T18:16:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9f7fe700 1 -- 172.21.15.12:0/4028021085 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00ce970 con 0x7f4ca015c420 2023-07-07T18:16:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9f7fe700 1 --2- 172.21.15.12:0/4028021085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca015c420 0x7f4ca0069ef0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009840 tx=0x7f4c90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dafbd3b42c0a78 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:13.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9e7fc700 1 -- 172.21.15.12:0/4028021085 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90011830 con 0x7f4ca015c420 2023-07-07T18:16:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.899+0000 7f4c9e7fc700 1 -- 172.21.15.12:0/4028021085 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c90011990 con 0x7f4ca015c420 2023-07-07T18:16:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.900+0000 7f4c9e7fc700 1 -- 172.21.15.12:0/4028021085 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90011d20 con 0x7f4ca015c420 2023-07-07T18:16:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.900+0000 7f4ca61c4700 1 -- 172.21.15.12:0/4028021085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca015c420 msgr2=0x7f4ca0069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.900+0000 7f4ca61c4700 1 --2- 172.21.15.12:0/4028021085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca015c420 0x7f4ca0069ef0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009840 tx=0x7f4c90009b50 comp rx=0 tx=0).stop 2023-07-07T18:16:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.900+0000 7f4ca61c4700 1 -- 172.21.15.12:0/4028021085 shutdown_connections 2023-07-07T18:16:13.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.900+0000 7f4ca61c4700 1 --2- 172.21.15.12:0/4028021085 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca015c420 0x7f4ca0069ef0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.900+0000 7f4ca61c4700 1 -- 172.21.15.12:0/4028021085 >> 172.21.15.12:0/4028021085 conn(0x7f4ca006b920 msgr2=0x7f4ca00cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.900+0000 7f4ca61c4700 1 -- 172.21.15.12:0/4028021085 shutdown_connections 2023-07-07T18:16:13.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.900+0000 7f4ca61c4700 1 -- 172.21.15.12:0/4028021085 wait complete. 2023-07-07T18:16:13.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.901+0000 7f4ca61c4700 1 Processor -- start 2023-07-07T18:16:13.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.901+0000 7f4ca61c4700 1 -- start start 2023-07-07T18:16:13.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4ca61c4700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca00b08d0 0x7f4ca0154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4ca61c4700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ca00cae00 0x7f4ca00b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4ca61c4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ca015c420 0x7f4ca0159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4ca61c4700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca015fdb0 con 0x7f4ca00b08d0 2023-07-07T18:16:13.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4ca61c4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00b50f0 con 0x7f4ca015c420 2023-07-07T18:16:13.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4ca61c4700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca00b3350 con 0x7f4ca00cae00 2023-07-07T18:16:13.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4c9f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca00b08d0 0x7f4ca0154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4c9f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca00b08d0 0x7f4ca0154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59476/0 (socket says 172.21.15.12:59476) 2023-07-07T18:16:13.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4c9f7fe700 1 -- 172.21.15.12:0/1015751943 learned_addr learned my addr 172.21.15.12:0/1015751943 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:13.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.902+0000 7f4c9f7fe700 1 -- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ca00cae00 msgr2=0x7f4ca00b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c9effd700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ca00cae00 0x7f4ca00b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c9ffff700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ca015c420 0x7f4ca0159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c9f7fe700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ca00cae00 0x7f4ca00b4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c9f7fe700 1 -- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ca015c420 msgr2=0x7f4ca0159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:13.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c9f7fe700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ca015c420 0x7f4ca0159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:13.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c9f7fe700 1 -- 172.21.15.12:0/1015751943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900094a0 con 0x7f4ca00b08d0 2023-07-07T18:16:13.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c9f7fe700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca00b08d0 0x7f4ca0154d20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00cd320 tx=0x7f4c90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c87fff700 1 -- 172.21.15.12:0/1015751943 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900036a0 con 0x7f4ca00b08d0 2023-07-07T18:16:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c87fff700 1 -- 172.21.15.12:0/1015751943 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9001f070 con 0x7f4ca00b08d0 2023-07-07T18:16:13.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca00b3630 con 0x7f4ca00b08d0 2023-07-07T18:16:13.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4c87fff700 1 -- 172.21.15.12:0/1015751943 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90003a40 con 0x7f4ca00b08d0 2023-07-07T18:16:13.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.903+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca00b3bf0 con 0x7f4ca00b08d0 2023-07-07T18:16:13.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.904+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca0073910 con 0x7f4ca00b08d0 2023-07-07T18:16:13.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.904+0000 7f4c87fff700 1 -- 172.21.15.12:0/1015751943 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c90003ba0 con 0x7f4ca00b08d0 2023-07-07T18:16:13.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.905+0000 7f4c87fff700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c8c06ace0 0x7f4c8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:13.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.905+0000 7f4c87fff700 1 -- 172.21.15.12:0/1015751943 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4c90021070 con 0x7f4ca00b08d0 2023-07-07T18:16:13.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.905+0000 7f4c9effd700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c8c06ace0 0x7f4c8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.906+0000 7f4c9effd700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c8c06ace0 0x7f4c8c06d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4ca01600a0 tx=0x7f4c94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:13.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:13.909+0000 7f4c87fff700 1 -- 172.21.15.12:0/1015751943 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4c90056110 con 0x7f4ca00b08d0 2023-07-07T18:16:14.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.105+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca006d8d0 con 0x7f4ca00b08d0 2023-07-07T18:16:14.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.107+0000 7f4c87fff700 1 -- 172.21.15.12:0/1015751943 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18500 (secure 0 0 0) 0x7f4c90059730 con 0x7f4ca00b08d0 2023-07-07T18:16:14.108 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:14.108 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T18:16:11.343505+0000","last_up_change":"2023-07-07T18:14:32.055126+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:16:07.998152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-07T18:16:09.313570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists","up"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T18:16:14.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c8c06ace0 msgr2=0x7f4c8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c8c06ace0 0x7f4c8c06d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4ca01600a0 tx=0x7f4c94009040 comp rx=0 tx=0).stop 2023-07-07T18:16:14.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca00b08d0 msgr2=0x7f4ca0154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca00b08d0 0x7f4ca0154d20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00cd320 tx=0x7f4c90004750 comp rx=0 tx=0).stop 2023-07-07T18:16:14.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 shutdown_connections 2023-07-07T18:16:14.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f4c8c06ace0 0x7f4c8c06d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4ca015c420 0x7f4ca0159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ca00b08d0 0x7f4ca0154d20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 --2- 172.21.15.12:0/1015751943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4ca00cae00 0x7f4ca00b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 >> 172.21.15.12:0/1015751943 conn(0x7f4ca006b920 msgr2=0x7f4ca006ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:14.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 shutdown_connections 2023-07-07T18:16:14.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.109+0000 7f4ca61c4700 1 -- 172.21.15.12:0/1015751943 wait complete. 2023-07-07T18:16:14.122 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-07T18:16:14.122 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T18:16:14.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.246+0000 7fce3402e700 1 Processor -- start 2023-07-07T18:16:14.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.246+0000 7fce3402e700 1 -- start start 2023-07-07T18:16:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce3402e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce2c15c420 0x7fce2c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce3402e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2c0cf2a0 con 0x7fce2c0b08d0 2023-07-07T18:16:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce3402e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2c0cce40 con 0x7fce2c0cae00 2023-07-07T18:16:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce3402e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0ce690 con 0x7fce2c15c420 2023-07-07T18:16:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce315c9700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fce2c0b08d0 0x7fce2c0cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56684/0 (socket says 172.21.15.12:56684) 2023-07-07T18:16:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce315c9700 1 -- 172.21.15.12:0/2463766663 learned_addr learned my addr 172.21.15.12:0/2463766663 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:14.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce31dca700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce2c15c420 0x7fce2c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352415448 0 0) 0x7fce2c0cf2a0 con 0x7fce2c0b08d0 2023-07-07T18:16:14.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce180035b0 con 0x7fce2c0b08d0 2023-07-07T18:16:14.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041956945 0 0) 0x7fce2c0cce40 con 0x7fce2c0cae00 2023-07-07T18:16:14.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce2c0cf2a0 con 0x7fce2c0cae00 2023-07-07T18:16:14.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1207056276 0 0) 0x7fce180035b0 con 0x7fce2c0b08d0 2023-07-07T18:16:14.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce2c15c420 msgr2=0x7fce2c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:14.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce2c15c420 0x7fce2c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 >> v1:172.21.15.160:6789/0 conn(0x7fce2c0cae00 legacy=0x7fce2c0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c0ce970 con 0x7fce2c0b08d0 2023-07-07T18:16:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fce1c001670 con 0x7fce2c0b08d0 2023-07-07T18:16:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 >> v1:172.21.15.12:6789/0 conn(0x7fce2c0b08d0 legacy=0x7fce2c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.247+0000 7fce30dc8700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce18003bc0 0x7fce18003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce30dc8700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce18004850 0x7fce18004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce30dc8700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18005200 0x7fce1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0ce690 con 0x7fce18005200 2023-07-07T18:16:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1800c060 con 0x7fce18003bc0 2023-07-07T18:16:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1800c220 con 0x7fce18004850 2023-07-07T18:16:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce31dca700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce2c15c420 0x7fce2c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:16:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce325cb700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18005200 0x7fce1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce315c9700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce18004850 0x7fce18004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce31dca700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce18003bc0 0x7fce18003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce325cb700 1 -- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce18004850 msgr2=0x7fce18004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce325cb700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce18004850 0x7fce18004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce325cb700 1 -- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce18003bc0 msgr2=0x7fce18003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce325cb700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce18003bc0 0x7fce18003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce325cb700 1 -- 172.21.15.12:0/2463766663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce180035b0 con 0x7fce18005200 2023-07-07T18:16:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce325cb700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18005200 0x7fce1800ba10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fce2400c2f0 tx=0x7fce18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3cce40931ff2e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24001f20 con 0x7fce18005200 2023-07-07T18:16:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2400ce70 con 0x7fce18005200 2023-07-07T18:16:14.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.248+0000 7fce30dc8700 1 -- 172.21.15.12:0/2463766663 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24003c20 con 0x7fce18005200 2023-07-07T18:16:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.249+0000 7fce3402e700 1 -- 172.21.15.12:0/2463766663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18005200 msgr2=0x7fce1800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.249+0000 7fce3402e700 1 --2- 172.21.15.12:0/2463766663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce18005200 0x7fce1800ba10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fce2400c2f0 tx=0x7fce18005880 comp rx=0 tx=0).stop 2023-07-07T18:16:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.249+0000 7fce325cb700 1 -- 172.21.15.12:0/2463766663 reap_dead start 2023-07-07T18:16:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.249+0000 7fce3402e700 1 -- 172.21.15.12:0/2463766663 shutdown_connections 2023-07-07T18:16:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.249+0000 7fce3402e700 1 -- 172.21.15.12:0/2463766663 >> 172.21.15.12:0/2463766663 conn(0x7fce2c06b920 msgr2=0x7fce2c0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.249+0000 7fce3402e700 1 -- 172.21.15.12:0/2463766663 shutdown_connections 2023-07-07T18:16:14.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.249+0000 7fce3402e700 1 -- 172.21.15.12:0/2463766663 wait complete. 2023-07-07T18:16:14.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.250+0000 7fce3402e700 1 Processor -- start 2023-07-07T18:16:14.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.250+0000 7fce3402e700 1 -- start start 2023-07-07T18:16:14.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce3402e700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce18005200 0x7fce2c156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce3402e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce2c154fb0 0x7fce2c0ae780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce3402e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce2c0aecc0 0x7fce2c1e58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce3402e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0af140 con 0x7fce2c0aecc0 2023-07-07T18:16:14.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce3402e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0af3e0 con 0x7fce2c154fb0 2023-07-07T18:16:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce3402e700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c1e4b10 con 0x7fce18005200 2023-07-07T18:16:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce325cb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce2c0aecc0 0x7fce2c1e58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce325cb700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce2c0aecc0 0x7fce2c1e58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59500/0 (socket says 172.21.15.12:59500) 2023-07-07T18:16:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce325cb700 1 -- 172.21.15.12:0/2024391790 learned_addr learned my addr 172.21.15.12:0/2024391790 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce31dca700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce18005200 0x7fce2c156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce315c9700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce2c154fb0 0x7fce2c0ae780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce325cb700 1 -- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce18005200 msgr2=0x7fce2c156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce325cb700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce18005200 0x7fce2c156910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce325cb700 1 -- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce2c154fb0 msgr2=0x7fce2c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce325cb700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce2c154fb0 0x7fce2c0ae780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.251+0000 7fce325cb700 1 -- 172.21.15.12:0/2024391790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c1e4df0 con 0x7fce2c0aecc0 2023-07-07T18:16:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.252+0000 7fce325cb700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce2c0aecc0 0x7fce2c1e58d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fce24004000 tx=0x7fce24001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.252+0000 7fce227fc700 1 -- 172.21.15.12:0/2024391790 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24003e10 con 0x7fce2c0aecc0 2023-07-07T18:16:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.252+0000 7fce227fc700 1 -- 172.21.15.12:0/2024391790 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce240050d0 con 0x7fce2c0aecc0 2023-07-07T18:16:14.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.252+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c1e50d0 con 0x7fce2c0aecc0 2023-07-07T18:16:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.252+0000 7fce227fc700 1 -- 172.21.15.12:0/2024391790 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24005480 con 0x7fce2c0aecc0 2023-07-07T18:16:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.252+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2c156e50 con 0x7fce2c0aecc0 2023-07-07T18:16:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.253+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2c1e55f0 con 0x7fce2c0aecc0 2023-07-07T18:16:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.253+0000 7fce227fc700 1 -- 172.21.15.12:0/2024391790 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce24019070 con 0x7fce2c0aecc0 2023-07-07T18:16:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.254+0000 7fce227fc700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce1006ace0 0x7fce1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.254+0000 7fce227fc700 1 -- 172.21.15.12:0/2024391790 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fce2408a860 con 0x7fce2c0aecc0 2023-07-07T18:16:14.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.254+0000 7fce31dca700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce1006ace0 0x7fce1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.254+0000 7fce31dca700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce1006ace0 0x7fce1006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce2c06af50 tx=0x7fce28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:14.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.258+0000 7fce227fc700 1 -- 172.21.15.12:0/2024391790 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce2c1e55f0 con 0x7fce2c0aecc0 2023-07-07T18:16:14.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.452+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 --> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce2c0cef30 con 0x7fce1006ace0 2023-07-07T18:16:14.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.461+0000 7fce227fc700 1 -- 172.21.15.12:0/2024391790 <== mgr.4100 v2:172.21.15.160:6832/4080099133 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309796 (secure 0 0 0) 0x7fce28013830 con 0x7fce1006ace0 2023-07-07T18:16:14.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:14.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce1006ace0 msgr2=0x7fce1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce1006ace0 0x7fce1006d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fce2c06af50 tx=0x7fce28008040 comp rx=0 tx=0).stop 2023-07-07T18:16:14.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce2c0aecc0 msgr2=0x7fce2c1e58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce2c0aecc0 0x7fce2c1e58d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fce24004000 tx=0x7fce24001650 comp rx=0 tx=0).stop 2023-07-07T18:16:14.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 shutdown_connections 2023-07-07T18:16:14.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fce1006ace0 0x7fce1006d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce2c0aecc0 0x7fce2c1e58d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce18005200 0x7fce2c156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 --2- 172.21.15.12:0/2024391790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce2c154fb0 0x7fce2c0ae780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 >> 172.21.15.12:0/2024391790 conn(0x7fce2c06b920 msgr2=0x7fce2c0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:14.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.464+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 shutdown_connections 2023-07-07T18:16:14.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.465+0000 7fce3402e700 1 -- 172.21.15.12:0/2024391790 wait complete. 2023-07-07T18:16:14.470 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-07-07T18:16:14.477 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-07-07T18:16:12.612466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592640,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":186,"acting":186,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220704,"kb_used_data":5088,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754016,"statfs":{"total":773094113280,"available":772868112384,"internally_reserved":0,"allocated":5210112,"data_stored":2938878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2272,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000926"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:09.913882+0000","last_change":"2023-07-07T18:16:09.913882+0000","last_active":"2023-07-07T18:16:09.913882+0000","last_peered":"2023-07-07T18:16:09.913882+0000","last_clean":"2023-07-07T18:16:09.913882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:09.913882+0000","last_undegraded":"2023-07-07T18:16:09.913882+0000","last_fullsized":"2023-07-07T18:16:09.913882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369980+0000","last_change":"2023-07-07T18:16:10.364995+0000","last_active":"2023-07-07T18:16:10.369980+0000","last_peered":"2023-07-07T18:16:10.369980+0000","last_clean":"2023-07-07T18:16:10.369980+0000","last_became_active":"2023-07-07T18:16:10.364685+0000","last_became_peered":"2023-07-07T18:16:10.364685+0000","last_unstale":"2023-07-07T18:16:10.369980+0000","last_undegraded":"2023-07-07T18:16:10.369980+0000","last_fullsized":"2023-07-07T18:16:10.369980+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:00:04.921278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372012+0000","last_change":"2023-07-07T18:16:10.365989+0000","last_active":"2023-07-07T18:16:10.372012+0000","last_peered":"2023-07-07T18:16:10.372012+0000","last_clean":"2023-07-07T18:16:10.372012+0000","last_became_active":"2023-07-07T18:16:10.365697+0000","last_became_peered":"2023-07-07T18:16:10.365697+0000","last_unstale":"2023-07-07T18:16:10.372012+0000","last_undegraded":"2023-07-07T18:16:10.372012+0000","last_fullsized":"2023-07-07T18:16:10.372012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:53:04.908540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350892+0000","last_change":"2023-07-07T18:16:10.367577+0000","last_active":"2023-07-07T18:16:11.350892+0000","last_peered":"2023-07-07T18:16:11.350892+0000","last_clean":"2023-07-07T18:16:11.350892+0000","last_became_active":"2023-07-07T18:16:10.367304+0000","last_became_peered":"2023-07-07T18:16:10.367304+0000","last_unstale":"2023-07-07T18:16:11.350892+0000","last_undegraded":"2023-07-07T18:16:11.350892+0000","last_fullsized":"2023-07-07T18:16:11.350892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:18:42.397216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.370008+0000","last_change":"2023-07-07T18:16:10.364760+0000","last_active":"2023-07-07T18:16:10.370008+0000","last_peered":"2023-07-07T18:16:10.370008+0000","last_clean":"2023-07-07T18:16:10.370008+0000","last_became_active":"2023-07-07T18:16:10.364530+0000","last_became_peered":"2023-07-07T18:16:10.364530+0000","last_unstale":"2023-07-07T18:16:10.370008+0000","last_undegraded":"2023-07-07T18:16:10.370008+0000","last_fullsized":"2023-07-07T18:16:10.370008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:42:22.027542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372524+0000","last_change":"2023-07-07T18:16:10.366228+0000","last_active":"2023-07-07T18:16:10.372524+0000","last_peered":"2023-07-07T18:16:10.372524+0000","last_clean":"2023-07-07T18:16:10.372524+0000","last_became_active":"2023-07-07T18:16:10.365351+0000","last_became_peered":"2023-07-07T18:16:10.365351+0000","last_unstale":"2023-07-07T18:16:10.372524+0000","last_undegraded":"2023-07-07T18:16:10.372524+0000","last_fullsized":"2023-07-07T18:16:10.372524+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:57:07.020137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:09.913882+0000","last_change":"2023-07-07T18:16:09.913882+0000","last_active":"2023-07-07T18:16:09.913882+0000","last_peered":"2023-07-07T18:16:09.913882+0000","last_clean":"2023-07-07T18:16:09.913882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:09.913882+0000","last_undegraded":"2023-07-07T18:16:09.913882+0000","last_fullsized":"2023-07-07T18:16:09.913882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350527+0000","last_change":"2023-07-07T18:16:10.374104+0000","last_active":"2023-07-07T18:16:11.350527+0000","last_peered":"2023-07-07T18:16:11.350527+0000","last_clean":"2023-07-07T18:16:11.350527+0000","last_became_active":"2023-07-07T18:16:10.373854+0000","last_became_peered":"2023-07-07T18:16:10.373854+0000","last_unstale":"2023-07-07T18:16:11.350527+0000","last_undegraded":"2023-07-07T18:16:11.350527+0000","last_fullsized":"2023-07-07T18:16:11.350527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:31:35.523372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351309+0000","last_change":"2023-07-07T18:16:10.377690+0000","last_active":"2023-07-07T18:16:11.351309+0000","last_peered":"2023-07-07T18:16:11.351309+0000","last_clean":"2023-07-07T18:16:11.351309+0000","last_became_active":"2023-07-07T18:16:10.377463+0000","last_became_peered":"2023-07-07T18:16:10.377463+0000","last_unstale":"2023-07-07T18:16:11.351309+0000","last_undegraded":"2023-07-07T18:16:11.351309+0000","last_fullsized":"2023-07-07T18:16:11.351309+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:09:51.373787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351249+0000","last_change":"2023-07-07T18:16:10.368310+0000","last_active":"2023-07-07T18:16:11.351249+0000","last_peered":"2023-07-07T18:16:11.351249+0000","last_clean":"2023-07-07T18:16:11.351249+0000","last_became_active":"2023-07-07T18:16:10.368032+0000","last_became_peered":"2023-07-07T18:16:10.368032+0000","last_unstale":"2023-07-07T18:16:11.351249+0000","last_undegraded":"2023-07-07T18:16:11.351249+0000","last_fullsized":"2023-07-07T18:16:11.351249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:12:37.937683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351160+0000","last_change":"2023-07-07T18:16:10.377693+0000","last_active":"2023-07-07T18:16:11.351160+0000","last_peered":"2023-07-07T18:16:11.351160+0000","last_clean":"2023-07-07T18:16:11.351160+0000","last_became_active":"2023-07-07T18:16:10.377410+0000","last_became_peered":"2023-07-07T18:16:10.377410+0000","last_unstale":"2023-07-07T18:16:11.351160+0000","last_undegraded":"2023-07-07T18:16:11.351160+0000","last_fullsized":"2023-07-07T18:16:11.351160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:47:11.610368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369600+0000","last_change":"2023-07-07T18:16:10.361101+0000","last_active":"2023-07-07T18:16:10.369600+0000","last_peered":"2023-07-07T18:16:10.369600+0000","last_clean":"2023-07-07T18:16:10.369600+0000","last_became_active":"2023-07-07T18:16:10.360806+0000","last_became_peered":"2023-07-07T18:16:10.360806+0000","last_unstale":"2023-07-07T18:16:10.369600+0000","last_undegraded":"2023-07-07T18:16:10.369600+0000","last_fullsized":"2023-07-07T18:16:10.369600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:09:51.373787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350010+0000","last_change":"2023-07-07T18:16:10.371822+0000","last_active":"2023-07-07T18:16:11.350010+0000","last_peered":"2023-07-07T18:16:11.350010+0000","last_clean":"2023-07-07T18:16:11.350010+0000","last_became_active":"2023-07-07T18:16:10.371562+0000","last_became_peered":"2023-07-07T18:16:10.371562+0000","last_unstale":"2023-07-07T18:16:11.350010+0000","last_undegraded":"2023-07-07T18:16:11.350010+0000","last_fullsized":"2023-07-07T18:16:11.350010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:51:29.180358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350730+0000","last_change":"2023-07-07T18:16:10.376744+0000","last_active":"2023-07-07T18:16:11.350730+0000","last_peered":"2023-07-07T18:16:11.350730+0000","last_clean":"2023-07-07T18:16:11.350730+0000","last_became_active":"2023-07-07T18:16:10.376460+0000","last_became_peered":"2023-07-07T18:16:10.376460+0000","last_unstale":"2023-07-07T18:16:11.350730+0000","last_undegraded":"2023-07-07T18:16:11.350730+0000","last_fullsized":"2023-07-07T18:16:11.350730+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:40:58.528010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.377206+0000","last_change":"2023-07-07T18:16:10.369485+0000","last_active":"2023-07-07T18:16:10.377206+0000","last_peered":"2023-07-07T18:16:10.377206+0000","last_clean":"2023-07-07T18:16:10.377206+0000","last_became_active":"2023-07-07T18:16:10.369217+0000","last_became_peered":"2023-07-07T18:16:10.369217+0000","last_unstale":"2023-07-07T18:16:10.377206+0000","last_undegraded":"2023-07-07T18:16:10.377206+0000","last_fullsized":"2023-07-07T18:16:10.377206+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:15:59.432858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.373022+0000","last_change":"2023-07-07T18:16:10.370880+0000","last_active":"2023-07-07T18:16:10.373022+0000","last_peered":"2023-07-07T18:16:10.373022+0000","last_clean":"2023-07-07T18:16:10.373022+0000","last_became_active":"2023-07-07T18:16:10.370612+0000","last_became_peered":"2023-07-07T18:16:10.370612+0000","last_unstale":"2023-07-07T18:16:10.373022+0000","last_undegraded":"2023-07-07T18:16:10.373022+0000","last_fullsized":"2023-07-07T18:16:10.373022+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:47:56.632979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.371981+0000","last_change":"2023-07-07T18:16:10.362834+0000","last_active":"2023-07-07T18:16:10.371981+0000","last_peered":"2023-07-07T18:16:10.371981+0000","last_clean":"2023-07-07T18:16:10.371981+0000","last_became_active":"2023-07-07T18:16:10.362399+0000","last_became_peered":"2023-07-07T18:16:10.362399+0000","last_unstale":"2023-07-07T18:16:10.371981+0000","last_undegraded":"2023-07-07T18:16:10.371981+0000","last_fullsized":"2023-07-07T18:16:10.371981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:42:09.310537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.374346+0000","last_change":"2023-07-07T18:16:10.372562+0000","last_active":"2023-07-07T18:16:10.374346+0000","last_peered":"2023-07-07T18:16:10.374346+0000","last_clean":"2023-07-07T18:16:10.374346+0000","last_became_active":"2023-07-07T18:16:10.372243+0000","last_became_peered":"2023-07-07T18:16:10.372243+0000","last_unstale":"2023-07-07T18:16:10.374346+0000","last_undegraded":"2023-07-07T18:16:10.374346+0000","last_fullsized":"2023-07-07T18:16:10.374346+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:56:50.072465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.377899+0000","last_change":"2023-07-07T18:16:10.374026+0000","last_active":"2023-07-07T18:16:10.377899+0000","last_peered":"2023-07-07T18:16:10.377899+0000","last_clean":"2023-07-07T18:16:10.377899+0000","last_became_active":"2023-07-07T18:16:10.373624+0000","last_became_peered":"2023-07-07T18:16:10.373624+0000","last_unstale":"2023-07-07T18:16:10.377899+0000","last_undegraded":"2023-07-07T18:16:10.377899+0000","last_fullsized":"2023-07-07T18:16:10.377899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:03:38.018816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349592+0000","last_change":"2023-07-07T18:16:10.360033+0000","last_active":"2023-07-07T18:16:11.349592+0000","last_peered":"2023-07-07T18:16:11.349592+0000","last_clean":"2023-07-07T18:16:11.349592+0000","last_became_active":"2023-07-07T18:16:10.359739+0000","last_became_peered":"2023-07-07T18:16:10.359739+0000","last_unstale":"2023-07-07T18:16:11.349592+0000","last_undegraded":"2023-07-07T18:16:11.349592+0000","last_fullsized":"2023-07-07T18:16:11.349592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:13:36.820671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.375397+0000","last_change":"2023-07-07T18:16:10.368582+0000","last_active":"2023-07-07T18:16:10.375397+0000","last_peered":"2023-07-07T18:16:10.375397+0000","last_clean":"2023-07-07T18:16:10.375397+0000","last_became_active":"2023-07-07T18:16:10.368238+0000","last_became_peered":"2023-07-07T18:16:10.368238+0000","last_unstale":"2023-07-07T18:16:10.375397+0000","last_undegraded":"2023-07-07T18:16:10.375397+0000","last_fullsized":"2023-07-07T18:16:10.375397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:07:11.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350812+0000","last_change":"2023-07-07T18:16:10.368207+0000","last_active":"2023-07-07T18:16:11.350812+0000","last_peered":"2023-07-07T18:16:11.350812+0000","last_clean":"2023-07-07T18:16:11.350812+0000","last_became_active":"2023-07-07T18:16:10.367813+0000","last_became_peered":"2023-07-07T18:16:10.367813+0000","last_unstale":"2023-07-07T18:16:11.350812+0000","last_undegraded":"2023-07-07T18:16:11.350812+0000","last_fullsized":"2023-07-07T18:16:11.350812+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:55:33.182595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369476+0000","last_change":"2023-07-07T18:16:10.363901+0000","last_active":"2023-07-07T18:16:10.369476+0000","last_peered":"2023-07-07T18:16:10.369476+0000","last_clean":"2023-07-07T18:16:10.369476+0000","last_became_active":"2023-07-07T18:16:10.363609+0000","last_became_peered":"2023-07-07T18:16:10.363609+0000","last_unstale":"2023-07-07T18:16:10.369476+0000","last_undegraded":"2023-07-07T18:16:10.369476+0000","last_fullsized":"2023-07-07T18:16:10.369476+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:43:20.259966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369413+0000","last_change":"2023-07-07T18:16:10.364812+0000","last_active":"2023-07-07T18:16:10.369413+0000","last_peered":"2023-07-07T18:16:10.369413+0000","last_clean":"2023-07-07T18:16:10.369413+0000","last_became_active":"2023-07-07T18:16:10.364470+0000","last_became_peered":"2023-07-07T18:16:10.364470+0000","last_unstale":"2023-07-07T18:16:10.369413+0000","last_undegraded":"2023-07-07T18:16:10.369413+0000","last_fullsized":"2023-07-07T18:16:10.369413+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:58:08.460792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378338+0000","last_change":"2023-07-07T18:16:10.377686+0000","last_active":"2023-07-07T18:16:10.378338+0000","last_peered":"2023-07-07T18:16:10.378338+0000","last_clean":"2023-07-07T18:16:10.378338+0000","last_became_active":"2023-07-07T18:16:10.377402+0000","last_became_peered":"2023-07-07T18:16:10.377402+0000","last_unstale":"2023-07-07T18:16:10.378338+0000","last_undegraded":"2023-07-07T18:16:10.378338+0000","last_fullsized":"2023-07-07T18:16:10.378338+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:46:51.143068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349679+0000","last_change":"2023-07-07T18:16:10.373879+0000","last_active":"2023-07-07T18:16:11.349679+0000","last_peered":"2023-07-07T18:16:11.349679+0000","last_clean":"2023-07-07T18:16:11.349679+0000","last_became_active":"2023-07-07T18:16:10.373630+0000","last_became_peered":"2023-07-07T18:16:10.373630+0000","last_unstale":"2023-07-07T18:16:11.349679+0000","last_undegraded":"2023-07-07T18:16:11.349679+0000","last_fullsized":"2023-07-07T18:16:11.349679+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:40:29.245992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369167+0000","last_change":"2023-07-07T18:16:10.362198+0000","last_active":"2023-07-07T18:16:10.369167+0000","last_peered":"2023-07-07T18:16:10.369167+0000","last_clean":"2023-07-07T18:16:10.369167+0000","last_became_active":"2023-07-07T18:16:10.361925+0000","last_became_peered":"2023-07-07T18:16:10.361925+0000","last_unstale":"2023-07-07T18:16:10.369167+0000","last_undegraded":"2023-07-07T18:16:10.369167+0000","last_fullsized":"2023-07-07T18:16:10.369167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:01:35.612692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372822+0000","last_change":"2023-07-07T18:16:10.366166+0000","last_active":"2023-07-07T18:16:10.372822+0000","last_peered":"2023-07-07T18:16:10.372822+0000","last_clean":"2023-07-07T18:16:10.372822+0000","last_became_active":"2023-07-07T18:16:10.365905+0000","last_became_peered":"2023-07-07T18:16:10.365905+0000","last_unstale":"2023-07-07T18:16:10.372822+0000","last_undegraded":"2023-07-07T18:16:10.372822+0000","last_fullsized":"2023-07-07T18:16:10.372822+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:25:09.034642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378318+0000","last_change":"2023-07-07T18:16:10.376686+0000","last_active":"2023-07-07T18:16:10.378318+0000","last_peered":"2023-07-07T18:16:10.378318+0000","last_clean":"2023-07-07T18:16:10.378318+0000","last_became_active":"2023-07-07T18:16:10.376451+0000","last_became_peered":"2023-07-07T18:16:10.376451+0000","last_unstale":"2023-07-07T18:16:10.378318+0000","last_undegraded":"2023-07-07T18:16:10.378318+0000","last_fullsized":"2023-07-07T18:16:10.378318+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:40:04.027285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.371908+0000","last_change":"2023-07-07T18:16:10.362335+0000","last_active":"2023-07-07T18:16:10.371908+0000","last_peered":"2023-07-07T18:16:10.371908+0000","last_clean":"2023-07-07T18:16:10.371908+0000","last_became_active":"2023-07-07T18:16:10.362064+0000","last_became_peered":"2023-07-07T18:16:10.362064+0000","last_unstale":"2023-07-07T18:16:10.371908+0000","last_undegraded":"2023-07-07T18:16:10.371908+0000","last_fullsized":"2023-07-07T18:16:10.371908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:31:58.541448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378496+0000","last_change":"2023-07-07T18:16:10.373299+0000","last_active":"2023-07-07T18:16:10.378496+0000","last_peered":"2023-07-07T18:16:10.378496+0000","last_clean":"2023-07-07T18:16:10.378496+0000","last_became_active":"2023-07-07T18:16:10.372989+0000","last_became_peered":"2023-07-07T18:16:10.372989+0000","last_unstale":"2023-07-07T18:16:10.378496+0000","last_undegraded":"2023-07-07T18:16:10.378496+0000","last_fullsized":"2023-07-07T18:16:10.378496+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:33:31.046616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349563+0000","last_change":"2023-07-07T18:16:10.360838+0000","last_active":"2023-07-07T18:16:11.349563+0000","last_peered":"2023-07-07T18:16:11.349563+0000","last_clean":"2023-07-07T18:16:11.349563+0000","last_became_active":"2023-07-07T18:16:10.360578+0000","last_became_peered":"2023-07-07T18:16:10.360578+0000","last_unstale":"2023-07-07T18:16:11.349563+0000","last_undegraded":"2023-07-07T18:16:11.349563+0000","last_fullsized":"2023-07-07T18:16:11.349563+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:56:13.180400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349660+0000","last_change":"2023-07-07T18:16:10.364938+0000","last_active":"2023-07-07T18:16:11.349660+0000","last_peered":"2023-07-07T18:16:11.349660+0000","last_clean":"2023-07-07T18:16:11.349660+0000","last_became_active":"2023-07-07T18:16:10.364695+0000","last_became_peered":"2023-07-07T18:16:10.364695+0000","last_unstale":"2023-07-07T18:16:11.349660+0000","last_undegraded":"2023-07-07T18:16:11.349660+0000","last_fullsized":"2023-07-07T18:16:11.349660+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:47:11.610368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369886+0000","last_change":"2023-07-07T18:16:09.939817+0000","last_active":"2023-07-07T18:16:10.369886+0000","last_peered":"2023-07-07T18:16:10.369886+0000","last_clean":"2023-07-07T18:16:10.369886+0000","last_became_active":"2023-07-07T18:16:09.939461+0000","last_became_peered":"2023-07-07T18:16:09.939461+0000","last_unstale":"2023-07-07T18:16:10.369886+0000","last_undegraded":"2023-07-07T18:16:10.369886+0000","last_fullsized":"2023-07-07T18:16:10.369886+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:01.885546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372911+0000","last_change":"2023-07-07T18:16:10.370123+0000","last_active":"2023-07-07T18:16:10.372911+0000","last_peered":"2023-07-07T18:16:10.372911+0000","last_clean":"2023-07-07T18:16:10.372911+0000","last_became_active":"2023-07-07T18:16:10.369823+0000","last_became_peered":"2023-07-07T18:16:10.369823+0000","last_unstale":"2023-07-07T18:16:10.372911+0000","last_undegraded":"2023-07-07T18:16:10.372911+0000","last_fullsized":"2023-07-07T18:16:10.372911+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:29:58.643297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.367690+0000","last_change":"2023-07-07T18:16:09.940982+0000","last_active":"2023-07-07T18:16:10.367690+0000","last_peered":"2023-07-07T18:16:10.367690+0000","last_clean":"2023-07-07T18:16:10.367690+0000","last_became_active":"2023-07-07T18:16:09.940217+0000","last_became_peered":"2023-07-07T18:16:09.940217+0000","last_unstale":"2023-07-07T18:16:10.367690+0000","last_undegraded":"2023-07-07T18:16:10.367690+0000","last_fullsized":"2023-07-07T18:16:10.367690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:23:12.822412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369623+0000","last_change":"2023-07-07T18:16:10.361679+0000","last_active":"2023-07-07T18:16:10.369623+0000","last_peered":"2023-07-07T18:16:10.369623+0000","last_clean":"2023-07-07T18:16:10.369623+0000","last_became_active":"2023-07-07T18:16:10.361375+0000","last_became_peered":"2023-07-07T18:16:10.361375+0000","last_unstale":"2023-07-07T18:16:10.369623+0000","last_undegraded":"2023-07-07T18:16:10.369623+0000","last_fullsized":"2023-07-07T18:16:10.369623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:47:11.610368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349749+0000","last_change":"2023-07-07T18:16:09.933198+0000","last_active":"2023-07-07T18:16:11.349749+0000","last_peered":"2023-07-07T18:16:11.349749+0000","last_clean":"2023-07-07T18:16:11.349749+0000","last_became_active":"2023-07-07T18:16:09.932790+0000","last_became_peered":"2023-07-07T18:16:09.932790+0000","last_unstale":"2023-07-07T18:16:11.349749+0000","last_undegraded":"2023-07-07T18:16:11.349749+0000","last_fullsized":"2023-07-07T18:16:11.349749+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:12:36.932890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349459+0000","last_change":"2023-07-07T18:16:10.365938+0000","last_active":"2023-07-07T18:16:11.349459+0000","last_peered":"2023-07-07T18:16:11.349459+0000","last_clean":"2023-07-07T18:16:11.349459+0000","last_became_active":"2023-07-07T18:16:10.365681+0000","last_became_peered":"2023-07-07T18:16:10.365681+0000","last_unstale":"2023-07-07T18:16:11.349459+0000","last_undegraded":"2023-07-07T18:16:11.349459+0000","last_fullsized":"2023-07-07T18:16:11.349459+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:55:27.552409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:08.909089+0000","last_change":"2023-07-07T18:16:08.909089+0000","last_active":"2023-07-07T18:16:08.909089+0000","last_peered":"2023-07-07T18:16:08.909089+0000","last_clean":"2023-07-07T18:16:08.909089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:08.909089+0000","last_undegraded":"2023-07-07T18:16:08.909089+0000","last_fullsized":"2023-07-07T18:16:08.909089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.371927+0000","last_change":"2023-07-07T18:16:10.366244+0000","last_active":"2023-07-07T18:16:10.371927+0000","last_peered":"2023-07-07T18:16:10.371927+0000","last_clean":"2023-07-07T18:16:10.371927+0000","last_became_active":"2023-07-07T18:16:10.365948+0000","last_became_peered":"2023-07-07T18:16:10.365948+0000","last_unstale":"2023-07-07T18:16:10.371927+0000","last_undegraded":"2023-07-07T18:16:10.371927+0000","last_fullsized":"2023-07-07T18:16:10.371927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:04:54.237396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369007+0000","last_change":"2023-07-07T18:16:09.943622+0000","last_active":"2023-07-07T18:16:10.369007+0000","last_peered":"2023-07-07T18:16:10.369007+0000","last_clean":"2023-07-07T18:16:10.369007+0000","last_became_active":"2023-07-07T18:16:09.943047+0000","last_became_peered":"2023-07-07T18:16:09.943047+0000","last_unstale":"2023-07-07T18:16:10.369007+0000","last_undegraded":"2023-07-07T18:16:10.369007+0000","last_fullsized":"2023-07-07T18:16:10.369007+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:39:37.282906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351164+0000","last_change":"2023-07-07T18:16:10.364537+0000","last_active":"2023-07-07T18:16:11.351164+0000","last_peered":"2023-07-07T18:16:11.351164+0000","last_clean":"2023-07-07T18:16:11.351164+0000","last_became_active":"2023-07-07T18:16:10.364256+0000","last_became_peered":"2023-07-07T18:16:10.364256+0000","last_unstale":"2023-07-07T18:16:11.351164+0000","last_undegraded":"2023-07-07T18:16:11.351164+0000","last_fullsized":"2023-07-07T18:16:11.351164+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:12:24.075862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.361606+0000","last_change":"2023-07-07T18:16:09.939350+0000","last_active":"2023-07-07T18:16:10.361606+0000","last_peered":"2023-07-07T18:16:10.361606+0000","last_clean":"2023-07-07T18:16:10.361606+0000","last_became_active":"2023-07-07T18:16:09.938936+0000","last_became_peered":"2023-07-07T18:16:09.938936+0000","last_unstale":"2023-07-07T18:16:10.361606+0000","last_undegraded":"2023-07-07T18:16:10.361606+0000","last_fullsized":"2023-07-07T18:16:10.361606+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:48:15.280152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350616+0000","last_change":"2023-07-07T18:16:10.368512+0000","last_active":"2023-07-07T18:16:11.350616+0000","last_peered":"2023-07-07T18:16:11.350616+0000","last_clean":"2023-07-07T18:16:11.350616+0000","last_became_active":"2023-07-07T18:16:10.368005+0000","last_became_peered":"2023-07-07T18:16:10.368005+0000","last_unstale":"2023-07-07T18:16:11.350616+0000","last_undegraded":"2023-07-07T18:16:11.350616+0000","last_fullsized":"2023-07-07T18:16:11.350616+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:25:43.257815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.348928+0000","last_change":"2023-07-07T18:16:09.932937+0000","last_active":"2023-07-07T18:16:10.348928+0000","last_peered":"2023-07-07T18:16:10.348928+0000","last_clean":"2023-07-07T18:16:10.348928+0000","last_became_active":"2023-07-07T18:16:09.932596+0000","last_became_peered":"2023-07-07T18:16:09.932596+0000","last_unstale":"2023-07-07T18:16:10.348928+0000","last_undegraded":"2023-07-07T18:16:10.348928+0000","last_fullsized":"2023-07-07T18:16:10.348928+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:12:36.932890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369455+0000","last_change":"2023-07-07T18:16:10.363787+0000","last_active":"2023-07-07T18:16:10.369455+0000","last_peered":"2023-07-07T18:16:10.369455+0000","last_clean":"2023-07-07T18:16:10.369455+0000","last_became_active":"2023-07-07T18:16:10.363325+0000","last_became_peered":"2023-07-07T18:16:10.363325+0000","last_unstale":"2023-07-07T18:16:10.369455+0000","last_undegraded":"2023-07-07T18:16:10.369455+0000","last_fullsized":"2023-07-07T18:16:10.369455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:03:47.696298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350659+0000","last_change":"2023-07-07T18:16:09.935309+0000","last_active":"2023-07-07T18:16:11.350659+0000","last_peered":"2023-07-07T18:16:11.350659+0000","last_clean":"2023-07-07T18:16:11.350659+0000","last_became_active":"2023-07-07T18:16:09.935131+0000","last_became_peered":"2023-07-07T18:16:09.935131+0000","last_unstale":"2023-07-07T18:16:11.350659+0000","last_undegraded":"2023-07-07T18:16:11.350659+0000","last_fullsized":"2023-07-07T18:16:11.350659+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:48.567569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.374369+0000","last_change":"2023-07-07T18:16:10.372867+0000","last_active":"2023-07-07T18:16:10.374369+0000","last_peered":"2023-07-07T18:16:10.374369+0000","last_clean":"2023-07-07T18:16:10.374369+0000","last_became_active":"2023-07-07T18:16:10.372598+0000","last_became_peered":"2023-07-07T18:16:10.372598+0000","last_unstale":"2023-07-07T18:16:10.374369+0000","last_undegraded":"2023-07-07T18:16:10.374369+0000","last_fullsized":"2023-07-07T18:16:10.374369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:31:11.989216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.356408+0000","last_change":"2023-07-07T18:16:09.939168+0000","last_active":"2023-07-07T18:16:10.356408+0000","last_peered":"2023-07-07T18:16:10.356408+0000","last_clean":"2023-07-07T18:16:10.356408+0000","last_became_active":"2023-07-07T18:16:09.938900+0000","last_became_peered":"2023-07-07T18:16:09.938900+0000","last_unstale":"2023-07-07T18:16:10.356408+0000","last_undegraded":"2023-07-07T18:16:10.356408+0000","last_fullsized":"2023-07-07T18:16:10.356408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:18:23.992777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:09.913882+0000","last_change":"2023-07-07T18:16:09.913882+0000","last_active":"2023-07-07T18:16:09.913882+0000","last_peered":"2023-07-07T18:16:09.913882+0000","last_clean":"2023-07-07T18:16:09.913882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:09.913882+0000","last_undegraded":"2023-07-07T18:16:09.913882+0000","last_fullsized":"2023-07-07T18:16:09.913882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351408+0000","last_change":"2023-07-07T18:16:09.937391+0000","last_active":"2023-07-07T18:16:11.351408+0000","last_peered":"2023-07-07T18:16:11.351408+0000","last_clean":"2023-07-07T18:16:11.351408+0000","last_became_active":"2023-07-07T18:16:09.937081+0000","last_became_peered":"2023-07-07T18:16:09.937081+0000","last_unstale":"2023-07-07T18:16:11.351408+0000","last_undegraded":"2023-07-07T18:16:11.351408+0000","last_fullsized":"2023-07-07T18:16:11.351408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:53:25.587017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372687+0000","last_change":"2023-07-07T18:16:10.366266+0000","last_active":"2023-07-07T18:16:10.372687+0000","last_peered":"2023-07-07T18:16:10.372687+0000","last_clean":"2023-07-07T18:16:10.372687+0000","last_became_active":"2023-07-07T18:16:10.366035+0000","last_became_peered":"2023-07-07T18:16:10.366035+0000","last_unstale":"2023-07-07T18:16:10.372687+0000","last_undegraded":"2023-07-07T18:16:10.372687+0000","last_fullsized":"2023-07-07T18:16:10.372687+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:56:59.951908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:08.909089+0000","last_change":"2023-07-07T18:16:08.909089+0000","last_active":"2023-07-07T18:16:08.909089+0000","last_peered":"2023-07-07T18:16:08.909089+0000","last_clean":"2023-07-07T18:16:08.909089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:08.909089+0000","last_undegraded":"2023-07-07T18:16:08.909089+0000","last_fullsized":"2023-07-07T18:16:08.909089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:09.913882+0000","last_change":"2023-07-07T18:16:09.913882+0000","last_active":"2023-07-07T18:16:09.913882+0000","last_peered":"2023-07-07T18:16:09.913882+0000","last_clean":"2023-07-07T18:16:09.913882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:09.913882+0000","last_undegraded":"2023-07-07T18:16:09.913882+0000","last_fullsized":"2023-07-07T18:16:09.913882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349921+0000","last_change":"2023-07-07T18:16:09.942487+0000","last_active":"2023-07-07T18:16:11.349921+0000","last_peered":"2023-07-07T18:16:11.349921+0000","last_clean":"2023-07-07T18:16:11.349921+0000","last_became_active":"2023-07-07T18:16:09.942162+0000","last_became_peered":"2023-07-07T18:16:09.942162+0000","last_unstale":"2023-07-07T18:16:11.349921+0000","last_undegraded":"2023-07-07T18:16:11.349921+0000","last_fullsized":"2023-07-07T18:16:11.349921+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:53:41.344033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.377936+0000","last_change":"2023-07-07T18:16:10.374254+0000","last_active":"2023-07-07T18:16:10.377936+0000","last_peered":"2023-07-07T18:16:10.377936+0000","last_clean":"2023-07-07T18:16:10.377936+0000","last_became_active":"2023-07-07T18:16:10.373709+0000","last_became_peered":"2023-07-07T18:16:10.373709+0000","last_unstale":"2023-07-07T18:16:10.377936+0000","last_undegraded":"2023-07-07T18:16:10.377936+0000","last_fullsized":"2023-07-07T18:16:10.377936+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:07:39.352056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.373353+0000","last_change":"2023-07-07T18:16:09.943555+0000","last_active":"2023-07-07T18:16:10.373353+0000","last_peered":"2023-07-07T18:16:10.373353+0000","last_clean":"2023-07-07T18:16:10.373353+0000","last_became_active":"2023-07-07T18:16:09.942751+0000","last_became_peered":"2023-07-07T18:16:09.942751+0000","last_unstale":"2023-07-07T18:16:10.373353+0000","last_undegraded":"2023-07-07T18:16:10.373353+0000","last_fullsized":"2023-07-07T18:16:10.373353+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:28:31.749736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351123+0000","last_change":"2023-07-07T18:16:10.367246+0000","last_active":"2023-07-07T18:16:11.351123+0000","last_peered":"2023-07-07T18:16:11.351123+0000","last_clean":"2023-07-07T18:16:11.351123+0000","last_became_active":"2023-07-07T18:16:10.366971+0000","last_became_peered":"2023-07-07T18:16:10.366971+0000","last_unstale":"2023-07-07T18:16:11.351123+0000","last_undegraded":"2023-07-07T18:16:11.351123+0000","last_fullsized":"2023-07-07T18:16:11.351123+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:55:27.552409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:08.909089+0000","last_change":"2023-07-07T18:16:08.909089+0000","last_active":"2023-07-07T18:16:08.909089+0000","last_peered":"2023-07-07T18:16:08.909089+0000","last_clean":"2023-07-07T18:16:08.909089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:08.909089+0000","last_undegraded":"2023-07-07T18:16:08.909089+0000","last_fullsized":"2023-07-07T18:16:08.909089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.376178+0000","last_change":"2023-07-07T18:16:10.366974+0000","last_active":"2023-07-07T18:16:10.376178+0000","last_peered":"2023-07-07T18:16:10.376178+0000","last_clean":"2023-07-07T18:16:10.376178+0000","last_became_active":"2023-07-07T18:16:10.366724+0000","last_became_peered":"2023-07-07T18:16:10.366724+0000","last_unstale":"2023-07-07T18:16:10.376178+0000","last_undegraded":"2023-07-07T18:16:10.376178+0000","last_fullsized":"2023-07-07T18:16:10.376178+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:34:59.181811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.354365+0000","last_change":"2023-07-07T18:16:09.938886+0000","last_active":"2023-07-07T18:16:10.354365+0000","last_peered":"2023-07-07T18:16:10.354365+0000","last_clean":"2023-07-07T18:16:10.354365+0000","last_became_active":"2023-07-07T18:16:09.938518+0000","last_became_peered":"2023-07-07T18:16:09.938518+0000","last_unstale":"2023-07-07T18:16:10.354365+0000","last_undegraded":"2023-07-07T18:16:10.354365+0000","last_fullsized":"2023-07-07T18:16:10.354365+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:31.811102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:09.913882+0000","last_change":"2023-07-07T18:16:09.913882+0000","last_active":"2023-07-07T18:16:09.913882+0000","last_peered":"2023-07-07T18:16:09.913882+0000","last_clean":"2023-07-07T18:16:09.913882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:09.913882+0000","last_undegraded":"2023-07-07T18:16:09.913882+0000","last_fullsized":"2023-07-07T18:16:09.913882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350979+0000","last_change":"2023-07-07T18:16:09.937667+0000","last_active":"2023-07-07T18:16:11.350979+0000","last_peered":"2023-07-07T18:16:11.350979+0000","last_clean":"2023-07-07T18:16:11.350979+0000","last_became_active":"2023-07-07T18:16:09.937353+0000","last_became_peered":"2023-07-07T18:16:09.937353+0000","last_unstale":"2023-07-07T18:16:11.350979+0000","last_undegraded":"2023-07-07T18:16:11.350979+0000","last_fullsized":"2023-07-07T18:16:11.350979+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:14:16.531592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349819+0000","last_change":"2023-07-07T18:16:10.353020+0000","last_active":"2023-07-07T18:16:11.349819+0000","last_peered":"2023-07-07T18:16:11.349819+0000","last_clean":"2023-07-07T18:16:11.349819+0000","last_became_active":"2023-07-07T18:16:10.352759+0000","last_became_peered":"2023-07-07T18:16:10.352759+0000","last_unstale":"2023-07-07T18:16:11.349819+0000","last_undegraded":"2023-07-07T18:16:11.349819+0000","last_fullsized":"2023-07-07T18:16:11.349819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:12:40.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349494+0000","last_change":"2023-07-07T18:16:09.941664+0000","last_active":"2023-07-07T18:16:11.349494+0000","last_peered":"2023-07-07T18:16:11.349494+0000","last_clean":"2023-07-07T18:16:11.349494+0000","last_became_active":"2023-07-07T18:16:09.941288+0000","last_became_peered":"2023-07-07T18:16:09.941288+0000","last_unstale":"2023-07-07T18:16:11.349494+0000","last_undegraded":"2023-07-07T18:16:11.349494+0000","last_fullsized":"2023-07-07T18:16:11.349494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:46:17.429009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351445+0000","last_change":"2023-07-07T18:16:10.370330+0000","last_active":"2023-07-07T18:16:11.351445+0000","last_peered":"2023-07-07T18:16:11.351445+0000","last_clean":"2023-07-07T18:16:11.351445+0000","last_became_active":"2023-07-07T18:16:10.370083+0000","last_became_peered":"2023-07-07T18:16:10.370083+0000","last_unstale":"2023-07-07T18:16:11.351445+0000","last_undegraded":"2023-07-07T18:16:11.351445+0000","last_fullsized":"2023-07-07T18:16:11.351445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:22:45.886080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.376254+0000","last_change":"2023-07-07T18:16:09.941735+0000","last_active":"2023-07-07T18:16:10.376254+0000","last_peered":"2023-07-07T18:16:10.376254+0000","last_clean":"2023-07-07T18:16:10.376254+0000","last_became_active":"2023-07-07T18:16:09.941093+0000","last_became_peered":"2023-07-07T18:16:09.941093+0000","last_unstale":"2023-07-07T18:16:10.376254+0000","last_undegraded":"2023-07-07T18:16:10.376254+0000","last_fullsized":"2023-07-07T18:16:10.376254+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:07:14.331079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372946+0000","last_change":"2023-07-07T18:16:10.370260+0000","last_active":"2023-07-07T18:16:10.372946+0000","last_peered":"2023-07-07T18:16:10.372946+0000","last_clean":"2023-07-07T18:16:10.372946+0000","last_became_active":"2023-07-07T18:16:10.369967+0000","last_became_peered":"2023-07-07T18:16:10.369967+0000","last_unstale":"2023-07-07T18:16:10.372946+0000","last_undegraded":"2023-07-07T18:16:10.372946+0000","last_fullsized":"2023-07-07T18:16:10.372946+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:30:17.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.357936+0000","last_change":"2023-07-07T18:16:09.930956+0000","last_active":"2023-07-07T18:16:10.357936+0000","last_peered":"2023-07-07T18:16:10.357936+0000","last_clean":"2023-07-07T18:16:10.357936+0000","last_became_active":"2023-07-07T18:16:09.930645+0000","last_became_peered":"2023-07-07T18:16:09.930645+0000","last_unstale":"2023-07-07T18:16:10.357936+0000","last_undegraded":"2023-07-07T18:16:10.357936+0000","last_fullsized":"2023-07-07T18:16:10.357936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:22:44.881287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378305+0000","last_change":"2023-07-07T18:16:10.376659+0000","last_active":"2023-07-07T18:16:10.378305+0000","last_peered":"2023-07-07T18:16:10.378305+0000","last_clean":"2023-07-07T18:16:10.378305+0000","last_became_active":"2023-07-07T18:16:10.376398+0000","last_became_peered":"2023-07-07T18:16:10.376398+0000","last_unstale":"2023-07-07T18:16:10.378305+0000","last_undegraded":"2023-07-07T18:16:10.378305+0000","last_fullsized":"2023-07-07T18:16:10.378305+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:00:28.595427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.354450+0000","last_change":"2023-07-07T18:16:09.940452+0000","last_active":"2023-07-07T18:16:10.354450+0000","last_peered":"2023-07-07T18:16:10.354450+0000","last_clean":"2023-07-07T18:16:10.354450+0000","last_became_active":"2023-07-07T18:16:09.939922+0000","last_became_peered":"2023-07-07T18:16:09.939922+0000","last_unstale":"2023-07-07T18:16:10.354450+0000","last_undegraded":"2023-07-07T18:16:10.354450+0000","last_fullsized":"2023-07-07T18:16:10.354450+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:59:55.355311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372563+0000","last_change":"2023-07-07T18:16:10.366785+0000","last_active":"2023-07-07T18:16:10.372563+0000","last_peered":"2023-07-07T18:16:10.372563+0000","last_clean":"2023-07-07T18:16:10.372563+0000","last_became_active":"2023-07-07T18:16:10.366509+0000","last_became_peered":"2023-07-07T18:16:10.366509+0000","last_unstale":"2023-07-07T18:16:10.372563+0000","last_undegraded":"2023-07-07T18:16:10.372563+0000","last_fullsized":"2023-07-07T18:16:10.372563+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:00:12.804894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.368911+0000","last_change":"2023-07-07T18:16:09.943753+0000","last_active":"2023-07-07T18:16:10.368911+0000","last_peered":"2023-07-07T18:16:10.368911+0000","last_clean":"2023-07-07T18:16:10.368911+0000","last_became_active":"2023-07-07T18:16:09.943295+0000","last_became_peered":"2023-07-07T18:16:09.943295+0000","last_unstale":"2023-07-07T18:16:10.368911+0000","last_undegraded":"2023-07-07T18:16:10.368911+0000","last_fullsized":"2023-07-07T18:16:10.368911+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:53:55.791502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349334+0000","last_change":"2023-07-07T18:16:10.363834+0000","last_active":"2023-07-07T18:16:11.349334+0000","last_peered":"2023-07-07T18:16:11.349334+0000","last_clean":"2023-07-07T18:16:11.349334+0000","last_became_active":"2023-07-07T18:16:10.363571+0000","last_became_peered":"2023-07-07T18:16:10.363571+0000","last_unstale":"2023-07-07T18:16:11.349334+0000","last_undegraded":"2023-07-07T18:16:11.349334+0000","last_fullsized":"2023-07-07T18:16:11.349334+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:40:47.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.349031+0000","last_change":"2023-07-07T18:16:09.934947+0000","last_active":"2023-07-07T18:16:10.349031+0000","last_peered":"2023-07-07T18:16:10.349031+0000","last_clean":"2023-07-07T18:16:10.349031+0000","last_became_active":"2023-07-07T18:16:09.934664+0000","last_became_peered":"2023-07-07T18:16:09.934664+0000","last_unstale":"2023-07-07T18:16:10.349031+0000","last_undegraded":"2023-07-07T18:16:10.349031+0000","last_fullsized":"2023-07-07T18:16:10.349031+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:53:25.587017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349878+0000","last_change":"2023-07-07T18:16:10.361396+0000","last_active":"2023-07-07T18:16:11.349878+0000","last_peered":"2023-07-07T18:16:11.349878+0000","last_clean":"2023-07-07T18:16:11.349878+0000","last_became_active":"2023-07-07T18:16:10.361153+0000","last_became_peered":"2023-07-07T18:16:10.361153+0000","last_unstale":"2023-07-07T18:16:11.349878+0000","last_undegraded":"2023-07-07T18:16:11.349878+0000","last_fullsized":"2023-07-07T18:16:11.349878+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:03:26.509090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351039+0000","last_change":"2023-07-07T18:16:09.937270+0000","last_active":"2023-07-07T18:16:11.351039+0000","last_peered":"2023-07-07T18:16:11.351039+0000","last_clean":"2023-07-07T18:16:11.351039+0000","last_became_active":"2023-07-07T18:16:09.936932+0000","last_became_peered":"2023-07-07T18:16:09.936932+0000","last_unstale":"2023-07-07T18:16:11.351039+0000","last_undegraded":"2023-07-07T18:16:11.351039+0000","last_fullsized":"2023-07-07T18:16:11.351039+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:35:26.508547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350927+0000","last_change":"2023-07-07T18:16:10.376756+0000","last_active":"2023-07-07T18:16:11.350927+0000","last_peered":"2023-07-07T18:16:11.350927+0000","last_clean":"2023-07-07T18:16:11.350927+0000","last_became_active":"2023-07-07T18:16:10.376470+0000","last_became_peered":"2023-07-07T18:16:10.376470+0000","last_unstale":"2023-07-07T18:16:11.350927+0000","last_undegraded":"2023-07-07T18:16:11.350927+0000","last_fullsized":"2023-07-07T18:16:11.350927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:25:27.983914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:08.909089+0000","last_change":"2023-07-07T18:16:08.909089+0000","last_active":"2023-07-07T18:16:08.909089+0000","last_peered":"2023-07-07T18:16:08.909089+0000","last_clean":"2023-07-07T18:16:08.909089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:08.909089+0000","last_undegraded":"2023-07-07T18:16:08.909089+0000","last_fullsized":"2023-07-07T18:16:08.909089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.373522+0000","last_change":"2023-07-07T18:16:10.371015+0000","last_active":"2023-07-07T18:16:10.373522+0000","last_peered":"2023-07-07T18:16:10.373522+0000","last_clean":"2023-07-07T18:16:10.373522+0000","last_became_active":"2023-07-07T18:16:10.370665+0000","last_became_peered":"2023-07-07T18:16:10.370665+0000","last_unstale":"2023-07-07T18:16:10.373522+0000","last_undegraded":"2023-07-07T18:16:10.373522+0000","last_fullsized":"2023-07-07T18:16:10.373522+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:39:06.214722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350784+0000","last_change":"2023-07-07T18:16:09.941071+0000","last_active":"2023-07-07T18:16:11.350784+0000","last_peered":"2023-07-07T18:16:11.350784+0000","last_clean":"2023-07-07T18:16:11.350784+0000","last_became_active":"2023-07-07T18:16:09.940761+0000","last_became_peered":"2023-07-07T18:16:09.940761+0000","last_unstale":"2023-07-07T18:16:11.350784+0000","last_undegraded":"2023-07-07T18:16:11.350784+0000","last_fullsized":"2023-07-07T18:16:11.350784+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:39:33.417838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349389+0000","last_change":"2023-07-07T18:14:41.010006+0000","last_active":"2023-07-07T18:16:11.349389+0000","last_peered":"2023-07-07T18:16:11.349389+0000","last_clean":"2023-07-07T18:16:11.349389+0000","last_became_active":"2023-07-07T18:14:41.009625+0000","last_became_peered":"2023-07-07T18:14:41.009625+0000","last_unstale":"2023-07-07T18:16:11.349389+0000","last_undegraded":"2023-07-07T18:16:11.349389+0000","last_fullsized":"2023-07-07T18:16:11.349389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:33:57.239051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.377943+0000","last_change":"2023-07-07T18:16:10.373962+0000","last_active":"2023-07-07T18:16:10.377943+0000","last_peered":"2023-07-07T18:16:10.377943+0000","last_clean":"2023-07-07T18:16:10.377943+0000","last_became_active":"2023-07-07T18:16:10.373485+0000","last_became_peered":"2023-07-07T18:16:10.373485+0000","last_unstale":"2023-07-07T18:16:10.377943+0000","last_undegraded":"2023-07-07T18:16:10.377943+0000","last_fullsized":"2023-07-07T18:16:10.377943+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:51:05.464464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.358733+0000","last_change":"2023-07-07T18:16:09.943683+0000","last_active":"2023-07-07T18:16:10.358733+0000","last_peered":"2023-07-07T18:16:10.358733+0000","last_clean":"2023-07-07T18:16:10.358733+0000","last_became_active":"2023-07-07T18:16:09.943332+0000","last_became_peered":"2023-07-07T18:16:09.943332+0000","last_unstale":"2023-07-07T18:16:10.358733+0000","last_undegraded":"2023-07-07T18:16:10.358733+0000","last_fullsized":"2023-07-07T18:16:10.358733+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:51:02.877897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.349116+0000","last_change":"2023-07-07T18:14:40.652460+0000","last_active":"2023-07-07T18:16:10.349116+0000","last_peered":"2023-07-07T18:16:10.349116+0000","last_clean":"2023-07-07T18:16:10.349116+0000","last_became_active":"2023-07-07T18:14:40.652046+0000","last_became_peered":"2023-07-07T18:14:40.652046+0000","last_unstale":"2023-07-07T18:16:10.349116+0000","last_undegraded":"2023-07-07T18:16:10.349116+0000","last_fullsized":"2023-07-07T18:16:10.349116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:00:17.314876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350981+0000","last_change":"2023-07-07T18:16:10.372171+0000","last_active":"2023-07-07T18:16:11.350981+0000","last_peered":"2023-07-07T18:16:11.350981+0000","last_clean":"2023-07-07T18:16:11.350981+0000","last_became_active":"2023-07-07T18:16:10.371922+0000","last_became_peered":"2023-07-07T18:16:10.371922+0000","last_unstale":"2023-07-07T18:16:11.350981+0000","last_undegraded":"2023-07-07T18:16:11.350981+0000","last_fullsized":"2023-07-07T18:16:11.350981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:40:47.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:08.909089+0000","last_change":"2023-07-07T18:16:08.909089+0000","last_active":"2023-07-07T18:16:08.909089+0000","last_peered":"2023-07-07T18:16:08.909089+0000","last_clean":"2023-07-07T18:16:08.909089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:08.909089+0000","last_undegraded":"2023-07-07T18:16:08.909089+0000","last_fullsized":"2023-07-07T18:16:08.909089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349247+0000","last_change":"2023-07-07T18:14:41.009938+0000","last_active":"2023-07-07T18:16:11.349247+0000","last_peered":"2023-07-07T18:16:11.349247+0000","last_clean":"2023-07-07T18:16:11.349247+0000","last_became_active":"2023-07-07T18:14:41.009637+0000","last_became_peered":"2023-07-07T18:14:41.009637+0000","last_unstale":"2023-07-07T18:16:11.349247+0000","last_undegraded":"2023-07-07T18:16:11.349247+0000","last_fullsized":"2023-07-07T18:16:11.349247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:15:12.172389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351321+0000","last_change":"2023-07-07T18:16:10.366323+0000","last_active":"2023-07-07T18:16:11.351321+0000","last_peered":"2023-07-07T18:16:11.351321+0000","last_clean":"2023-07-07T18:16:11.351321+0000","last_became_active":"2023-07-07T18:16:10.366070+0000","last_became_peered":"2023-07-07T18:16:10.366070+0000","last_unstale":"2023-07-07T18:16:11.351321+0000","last_undegraded":"2023-07-07T18:16:11.351321+0000","last_fullsized":"2023-07-07T18:16:11.351321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:16:27.676068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.357616+0000","last_change":"2023-07-07T18:16:09.940003+0000","last_active":"2023-07-07T18:16:10.357616+0000","last_peered":"2023-07-07T18:16:10.357616+0000","last_clean":"2023-07-07T18:16:10.357616+0000","last_became_active":"2023-07-07T18:16:09.939626+0000","last_became_peered":"2023-07-07T18:16:09.939626+0000","last_unstale":"2023-07-07T18:16:10.357616+0000","last_undegraded":"2023-07-07T18:16:10.357616+0000","last_fullsized":"2023-07-07T18:16:10.357616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:16:26.671275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.349982+0000","last_change":"2023-07-07T18:14:40.652887+0000","last_active":"2023-07-07T18:16:10.349982+0000","last_peered":"2023-07-07T18:16:10.349982+0000","last_clean":"2023-07-07T18:16:10.349982+0000","last_became_active":"2023-07-07T18:14:40.652550+0000","last_became_peered":"2023-07-07T18:14:40.652550+0000","last_unstale":"2023-07-07T18:16:10.349982+0000","last_undegraded":"2023-07-07T18:16:10.349982+0000","last_fullsized":"2023-07-07T18:16:10.349982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:55:40.595935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":203,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-07T18:16:03.727761+0000","last_change":"2023-07-07T18:14:34.464008+0000","last_active":"2023-07-07T18:16:03.727761+0000","last_peered":"2023-07-07T18:16:03.727761+0000","last_clean":"2023-07-07T18:16:03.727761+0000","last_became_active":"2023-07-07T18:14:34.463018+0000","last_became_peered":"2023-07-07T18:14:34.463018+0000","last_unstale":"2023-07-07T18:16:03.727761+0000","last_undegraded":"2023-07-07T18:16:03.727761+0000","last_fullsized":"2023-07-07T18:16:03.727761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_clean_scrub_stamp":"2023-07-07T18:14:33.057285+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:40:10.445833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:09.913882+0000","last_change":"2023-07-07T18:16:09.913882+0000","last_active":"2023-07-07T18:16:09.913882+0000","last_peered":"2023-07-07T18:16:09.913882+0000","last_clean":"2023-07-07T18:16:09.913882+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:09.913882+0000","last_undegraded":"2023-07-07T18:16:09.913882+0000","last_fullsized":"2023-07-07T18:16:09.913882+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349844+0000","last_change":"2023-07-07T18:16:09.933038+0000","last_active":"2023-07-07T18:16:11.349844+0000","last_peered":"2023-07-07T18:16:11.349844+0000","last_clean":"2023-07-07T18:16:11.349844+0000","last_became_active":"2023-07-07T18:16:09.932745+0000","last_became_peered":"2023-07-07T18:16:09.932745+0000","last_unstale":"2023-07-07T18:16:11.349844+0000","last_undegraded":"2023-07-07T18:16:11.349844+0000","last_fullsized":"2023-07-07T18:16:11.349844+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:12:23.071069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-07T18:16:03.727749+0000","last_change":"2023-07-07T18:14:40.649525+0000","last_active":"2023-07-07T18:16:03.727749+0000","last_peered":"2023-07-07T18:16:03.727749+0000","last_clean":"2023-07-07T18:16:03.727749+0000","last_became_active":"2023-07-07T18:14:40.649168+0000","last_became_peered":"2023-07-07T18:14:40.649168+0000","last_unstale":"2023-07-07T18:16:03.727749+0000","last_undegraded":"2023-07-07T18:16:03.727749+0000","last_fullsized":"2023-07-07T18:16:03.727749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:24:01.443328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369229+0000","last_change":"2023-07-07T18:16:10.358139+0000","last_active":"2023-07-07T18:16:10.369229+0000","last_peered":"2023-07-07T18:16:10.369229+0000","last_clean":"2023-07-07T18:16:10.369229+0000","last_became_active":"2023-07-07T18:16:10.357831+0000","last_became_peered":"2023-07-07T18:16:10.357831+0000","last_unstale":"2023-07-07T18:16:10.369229+0000","last_undegraded":"2023-07-07T18:16:10.369229+0000","last_fullsized":"2023-07-07T18:16:10.369229+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:48:18.641817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349220+0000","last_change":"2023-07-07T18:16:09.935501+0000","last_active":"2023-07-07T18:16:11.349220+0000","last_peered":"2023-07-07T18:16:11.349220+0000","last_clean":"2023-07-07T18:16:11.349220+0000","last_became_active":"2023-07-07T18:16:09.935196+0000","last_became_peered":"2023-07-07T18:16:09.935196+0000","last_unstale":"2023-07-07T18:16:11.349220+0000","last_undegraded":"2023-07-07T18:16:11.349220+0000","last_fullsized":"2023-07-07T18:16:11.349220+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:14:16.531592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-07-07T18:16:03.727741+0000","last_change":"2023-07-07T18:14:41.009946+0000","last_active":"2023-07-07T18:16:03.727741+0000","last_peered":"2023-07-07T18:16:03.727741+0000","last_clean":"2023-07-07T18:16:03.727741+0000","last_became_active":"2023-07-07T18:14:41.009627+0000","last_became_peered":"2023-07-07T18:14:41.009627+0000","last_unstale":"2023-07-07T18:16:03.727741+0000","last_undegraded":"2023-07-07T18:16:03.727741+0000","last_fullsized":"2023-07-07T18:16:03.727741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:48:49.735521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372797+0000","last_change":"2023-07-07T18:16:10.366085+0000","last_active":"2023-07-07T18:16:10.372797+0000","last_peered":"2023-07-07T18:16:10.372797+0000","last_clean":"2023-07-07T18:16:10.372797+0000","last_became_active":"2023-07-07T18:16:10.365829+0000","last_became_peered":"2023-07-07T18:16:10.365829+0000","last_unstale":"2023-07-07T18:16:10.372797+0000","last_undegraded":"2023-07-07T18:16:10.372797+0000","last_fullsized":"2023-07-07T18:16:10.372797+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:40:34.055166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.353348+0000","last_change":"2023-07-07T18:16:09.938880+0000","last_active":"2023-07-07T18:16:10.353348+0000","last_peered":"2023-07-07T18:16:10.353348+0000","last_clean":"2023-07-07T18:16:10.353348+0000","last_became_active":"2023-07-07T18:16:09.938514+0000","last_became_peered":"2023-07-07T18:16:09.938514+0000","last_unstale":"2023-07-07T18:16:10.353348+0000","last_undegraded":"2023-07-07T18:16:10.353348+0000","last_fullsized":"2023-07-07T18:16:10.353348+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:00:57.060559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349743+0000","last_change":"2023-07-07T18:14:40.651911+0000","last_active":"2023-07-07T18:16:11.349743+0000","last_peered":"2023-07-07T18:16:11.349743+0000","last_clean":"2023-07-07T18:16:11.349743+0000","last_became_active":"2023-07-07T18:14:40.651592+0000","last_became_peered":"2023-07-07T18:14:40.651592+0000","last_unstale":"2023-07-07T18:16:11.349743+0000","last_undegraded":"2023-07-07T18:16:11.349743+0000","last_fullsized":"2023-07-07T18:16:11.349743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:08:21.099498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378866+0000","last_change":"2023-07-07T18:16:10.376629+0000","last_active":"2023-07-07T18:16:10.378866+0000","last_peered":"2023-07-07T18:16:10.378866+0000","last_clean":"2023-07-07T18:16:10.378866+0000","last_became_active":"2023-07-07T18:16:10.376360+0000","last_became_peered":"2023-07-07T18:16:10.376360+0000","last_unstale":"2023-07-07T18:16:10.378866+0000","last_undegraded":"2023-07-07T18:16:10.378866+0000","last_fullsized":"2023-07-07T18:16:10.378866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:01:13.197327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-07T18:16:08.909089+0000","last_change":"2023-07-07T18:16:08.909089+0000","last_active":"2023-07-07T18:16:08.909089+0000","last_peered":"2023-07-07T18:16:08.909089+0000","last_clean":"2023-07-07T18:16:08.909089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-07T18:16:08.909089+0000","last_undegraded":"2023-07-07T18:16:08.909089+0000","last_fullsized":"2023-07-07T18:16:08.909089+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.359097+0000","last_change":"2023-07-07T18:14:40.653854+0000","last_active":"2023-07-07T18:16:10.359097+0000","last_peered":"2023-07-07T18:16:10.359097+0000","last_clean":"2023-07-07T18:16:10.359097+0000","last_became_active":"2023-07-07T18:14:40.653556+0000","last_became_peered":"2023-07-07T18:14:40.653556+0000","last_unstale":"2023-07-07T18:16:10.359097+0000","last_undegraded":"2023-07-07T18:16:10.359097+0000","last_fullsized":"2023-07-07T18:16:10.359097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:32:42.114314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2272,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":1052672,"data_stored":788757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.0620000000000003,"5min":5.0620000000000003,"15min":5.0620000000000003},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.0940000000000003,"5min":5.0940000000000003,"15min":5.0940000000000003},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":5.1600000000000001,"5min":5.1600000000000001,"15min":5.1600000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.434}]},{"osd":3,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":5.4340000000000002,"5min":5.4340000000000002,"15min":5.4340000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.2670000000000003,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.38100000000000001}]},{"osd":5,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.44600000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":219939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.441},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.8470000000000004,"5min":7.8470000000000004,"15min":7.8470000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":7.9530000000000003,"5min":7.9530000000000003,"15min":7.9530000000000003},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.504}]},{"osd":3,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40000000000000002}]},{"osd":5,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47299999999999998}]},{"osd":7,"last update":"Fri Jul 7 18:15:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":226310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.32500000000000001}]},{"osd":4,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.629}]},{"osd":6,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.72999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1101824,"data_stored":815973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.312},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36599999999999999}]},{"osd":3,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":524288,"data_stored":227826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":10.867000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":8.202,"5min":8.202,"15min":8.202},"last":0.26200000000000001}]},{"osd":1,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":11.016,"5min":11.016,"15min":11.016},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":10.898,"5min":10.898,"15min":10.898},"last":0.29799999999999999}]},{"osd":3,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.1750000000000007,"5min":8.1750000000000007,"15min":8.1750000000000007},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.840999999999999,"5min":10.840999999999999,"15min":10.840999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":11.869999999999999,"5min":11.869999999999999,"15min":11.869999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.987,"5min":10.987,"15min":10.987},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":10.808999999999999,"5min":10.808999999999999,"15min":10.808999999999999},"last":0.746}]},{"osd":6,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":11.84,"5min":11.84,"15min":11.84},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":10.961,"5min":10.961,"15min":10.961},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.933999999999999,"5min":10.933999999999999,"15min":10.933999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":11.803000000000001,"5min":11.803000000000001,"15min":11.803000000000001},"last":0.64200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":219905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.26900000000000002}]},{"osd":1,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.314},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.375}]},{"osd":4,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.748},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.628}]},{"osd":6,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 7 18:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64400000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":220831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.5}]},{"osd":1,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.442},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.40500000000000003}]},{"osd":6,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52500000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":499712,"data_stored":219337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.754},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T18:16:14.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T18:16:14.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:16:14.520 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:16:14.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.642+0000 7f7c14b0a700 1 Processor -- start 2023-07-07T18:16:14.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.642+0000 7f7c14b0a700 1 -- start start 2023-07-07T18:16:14.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.643+0000 7f7c14b0a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100ae6c0 0x7f7c1015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.643+0000 7f7c14b0a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c100aec10 0x7f7c100714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.643+0000 7f7c14b0a700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100af090 con 0x7f7c100cddd0 2023-07-07T18:16:14.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.643+0000 7f7c14b0a700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100cdc80 con 0x7f7c100aec10 2023-07-07T18:16:14.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.643+0000 7f7c14b0a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1015d6a0 con 0x7f7c100ae6c0 2023-07-07T18:16:14.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.643+0000 7f7c0ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c100aec10 0x7f7c100714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c100aec10 0x7f7c100714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59508/0 (socket says 172.21.15.12:59508) 2023-07-07T18:16:14.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0ed9d700 1 -- 172.21.15.12:0/1759273740 learned_addr learned my addr 172.21.15.12:0/1759273740 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:14.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0dd9b700 1 --2- 172.21.15.12:0/1759273740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100ae6c0 0x7f7c1015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0ed9d700 1 -- 172.21.15.12:0/1759273740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100ae6c0 msgr2=0x7f7c1015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:14.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0ed9d700 1 --2- 172.21.15.12:0/1759273740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100ae6c0 0x7f7c1015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0ed9d700 1 -- 172.21.15.12:0/1759273740 >> v1:172.21.15.160:6789/0 conn(0x7f7c100cddd0 legacy=0x7f7c100ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0ed9d700 1 -- 172.21.15.12:0/1759273740 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10159700 con 0x7f7c100aec10 2023-07-07T18:16:14.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0dd9b700 1 --2- 172.21.15.12:0/1759273740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100ae6c0 0x7f7c1015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:14.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0ed9d700 1 --2- 172.21.15.12:0/1759273740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100aec10 0x7f7c100714a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009e50 tx=0x7f7c0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaba885aae12c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:14.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0d59a700 1 -- 172.21.15.12:0/1759273740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800e070 con 0x7f7c100aec10 2023-07-07T18:16:14.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0d59a700 1 -- 172.21.15.12:0/1759273740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800b9c0 con 0x7f7c100aec10 2023-07-07T18:16:14.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.644+0000 7f7c0d59a700 1 -- 172.21.15.12:0/1759273740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800bd70 con 0x7f7c100aec10 2023-07-07T18:16:14.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.645+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1759273740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100aec10 msgr2=0x7f7c100714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.645+0000 7f7c14b0a700 1 --2- 172.21.15.12:0/1759273740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100aec10 0x7f7c100714a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7c08009e50 tx=0x7f7c0800b330 comp rx=0 tx=0).stop 2023-07-07T18:16:14.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.645+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1759273740 shutdown_connections 2023-07-07T18:16:14.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.645+0000 7f7c14b0a700 1 --2- 172.21.15.12:0/1759273740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100aec10 0x7f7c100714a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.645+0000 7f7c14b0a700 1 --2- 172.21.15.12:0/1759273740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100ae6c0 0x7f7c1015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.645+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1759273740 >> 172.21.15.12:0/1759273740 conn(0x7f7c1006d4a0 msgr2=0x7f7c1006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:14.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.645+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1759273740 shutdown_connections 2023-07-07T18:16:14.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.645+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1759273740 wait complete. 2023-07-07T18:16:14.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.646+0000 7f7c14b0a700 1 Processor -- start 2023-07-07T18:16:14.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.646+0000 7f7c14b0a700 1 -- start start 2023-07-07T18:16:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c14b0a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100ae6c0 0x7f7c10146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c14b0a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100aec10 0x7f7c100b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c14b0a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c100cddd0 0x7f7c100b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c14b0a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100b55a0 con 0x7f7c100ae6c0 2023-07-07T18:16:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c14b0a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1015a710 con 0x7f7c100cddd0 2023-07-07T18:16:14.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c14b0a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100b4fe0 con 0x7f7c100aec10 2023-07-07T18:16:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c0e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100ae6c0 0x7f7c10146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c0e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100ae6c0 0x7f7c10146aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59510/0 (socket says 172.21.15.12:59510) 2023-07-07T18:16:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c0e59c700 1 -- 172.21.15.12:0/1734911852 learned_addr learned my addr 172.21.15.12:0/1734911852 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c0e59c700 1 -- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100aec10 msgr2=0x7f7c100b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c0e59c700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100aec10 0x7f7c100b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c0e59c700 1 -- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c100cddd0 msgr2=0x7f7c100b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c0e59c700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c100cddd0 0x7f7c100b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c0e59c700 1 -- 172.21.15.12:0/1734911852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08009b30 con 0x7f7c100ae6c0 2023-07-07T18:16:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.647+0000 7f7c0e59c700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100ae6c0 0x7f7c10146aa0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000c450 tx=0x7f7c0000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.648+0000 7f7c06ffd700 1 -- 172.21.15.12:0/1734911852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000052d0 con 0x7f7c100ae6c0 2023-07-07T18:16:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.648+0000 7f7c06ffd700 1 -- 172.21.15.12:0/1734911852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c00005430 con 0x7f7c100ae6c0 2023-07-07T18:16:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.648+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c100b52c0 con 0x7f7c100ae6c0 2023-07-07T18:16:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.648+0000 7f7c06ffd700 1 -- 172.21.15.12:0/1734911852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c000038c0 con 0x7f7c100ae6c0 2023-07-07T18:16:14.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.648+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c10146fe0 con 0x7f7c100ae6c0 2023-07-07T18:16:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.649+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1006f120 con 0x7f7c100ae6c0 2023-07-07T18:16:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.649+0000 7f7c06ffd700 1 -- 172.21.15.12:0/1734911852 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c00003a20 con 0x7f7c100ae6c0 2023-07-07T18:16:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.650+0000 7f7c06ffd700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7bf006ace0 0x7f7bf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.650+0000 7f7c06ffd700 1 -- 172.21.15.12:0/1734911852 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7c00088960 con 0x7f7c100ae6c0 2023-07-07T18:16:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.650+0000 7f7c0dd9b700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7bf006ace0 0x7f7bf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:14.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.650+0000 7f7c0dd9b700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7bf006ace0 0x7f7bf006d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c10153210 tx=0x7f7bf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:14.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.654+0000 7f7c06ffd700 1 -- 172.21.15.12:0/1734911852 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7c00053830 con 0x7f7c100ae6c0 2023-07-07T18:16:14.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.846+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 --> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c101599e0 con 0x7f7bf006ace0 2023-07-07T18:16:14.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.855+0000 7f7c06ffd700 1 -- 172.21.15.12:0/1734911852 <== mgr.4100 v2:172.21.15.160:6832/4080099133 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311617 (secure 0 0 0) 0x7f7bf8009d90 con 0x7f7bf006ace0 2023-07-07T18:16:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:14.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7bf006ace0 msgr2=0x7f7bf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7bf006ace0 0x7f7bf006d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c10153210 tx=0x7f7bf8008040 comp rx=0 tx=0).stop 2023-07-07T18:16:14.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100ae6c0 msgr2=0x7f7c10146aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:14.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100ae6c0 0x7f7c10146aa0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7c0000c450 tx=0x7f7c0000c810 comp rx=0 tx=0).stop 2023-07-07T18:16:14.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 shutdown_connections 2023-07-07T18:16:14.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f7bf006ace0 0x7f7bf006d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c100cddd0 0x7f7c100b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c100ae6c0 0x7f7c10146aa0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 --2- 172.21.15.12:0/1734911852 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c100aec10 0x7f7c100b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:14.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 >> 172.21.15.12:0/1734911852 conn(0x7f7c1006d4a0 msgr2=0x7f7c100afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:14.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 shutdown_connections 2023-07-07T18:16:14.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:14.858+0000 7f7c14b0a700 1 -- 172.21.15.12:0/1734911852 wait complete. 2023-07-07T18:16:14.863 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-07-07T18:16:14.871 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2023-07-07T18:16:14.613140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220744,"kb_used_data":5128,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753976,"statfs":{"total":773094113280,"available":772868071424,"internally_reserved":0,"allocated":5251072,"data_stored":2959846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.698551"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224817+0000","last_change":"2023-07-07T18:16:10.363159+0000","last_active":"2023-07-07T18:16:12.224817+0000","last_peered":"2023-07-07T18:16:12.224817+0000","last_clean":"2023-07-07T18:16:12.224817+0000","last_became_active":"2023-07-07T18:16:10.362897+0000","last_became_peered":"2023-07-07T18:16:10.362897+0000","last_unstale":"2023-07-07T18:16:12.224817+0000","last_undegraded":"2023-07-07T18:16:12.224817+0000","last_fullsized":"2023-07-07T18:16:12.224817+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:53:16.318356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369980+0000","last_change":"2023-07-07T18:16:10.364995+0000","last_active":"2023-07-07T18:16:10.369980+0000","last_peered":"2023-07-07T18:16:10.369980+0000","last_clean":"2023-07-07T18:16:10.369980+0000","last_became_active":"2023-07-07T18:16:10.364685+0000","last_became_peered":"2023-07-07T18:16:10.364685+0000","last_unstale":"2023-07-07T18:16:10.369980+0000","last_undegraded":"2023-07-07T18:16:10.369980+0000","last_fullsized":"2023-07-07T18:16:10.369980+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:00:04.921278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372012+0000","last_change":"2023-07-07T18:16:10.365989+0000","last_active":"2023-07-07T18:16:10.372012+0000","last_peered":"2023-07-07T18:16:10.372012+0000","last_clean":"2023-07-07T18:16:10.372012+0000","last_became_active":"2023-07-07T18:16:10.365697+0000","last_became_peered":"2023-07-07T18:16:10.365697+0000","last_unstale":"2023-07-07T18:16:10.372012+0000","last_undegraded":"2023-07-07T18:16:10.372012+0000","last_fullsized":"2023-07-07T18:16:10.372012+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:53:04.908540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350892+0000","last_change":"2023-07-07T18:16:10.367577+0000","last_active":"2023-07-07T18:16:11.350892+0000","last_peered":"2023-07-07T18:16:11.350892+0000","last_clean":"2023-07-07T18:16:11.350892+0000","last_became_active":"2023-07-07T18:16:10.367304+0000","last_became_peered":"2023-07-07T18:16:10.367304+0000","last_unstale":"2023-07-07T18:16:11.350892+0000","last_undegraded":"2023-07-07T18:16:11.350892+0000","last_fullsized":"2023-07-07T18:16:11.350892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:18:42.397216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.370008+0000","last_change":"2023-07-07T18:16:10.364760+0000","last_active":"2023-07-07T18:16:10.370008+0000","last_peered":"2023-07-07T18:16:10.370008+0000","last_clean":"2023-07-07T18:16:10.370008+0000","last_became_active":"2023-07-07T18:16:10.364530+0000","last_became_peered":"2023-07-07T18:16:10.364530+0000","last_unstale":"2023-07-07T18:16:10.370008+0000","last_undegraded":"2023-07-07T18:16:10.370008+0000","last_fullsized":"2023-07-07T18:16:10.370008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:42:22.027542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372524+0000","last_change":"2023-07-07T18:16:10.366228+0000","last_active":"2023-07-07T18:16:10.372524+0000","last_peered":"2023-07-07T18:16:10.372524+0000","last_clean":"2023-07-07T18:16:10.372524+0000","last_became_active":"2023-07-07T18:16:10.365351+0000","last_became_peered":"2023-07-07T18:16:10.365351+0000","last_unstale":"2023-07-07T18:16:10.372524+0000","last_undegraded":"2023-07-07T18:16:10.372524+0000","last_fullsized":"2023-07-07T18:16:10.372524+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:57:07.020137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224382+0000","last_change":"2023-07-07T18:16:10.371911+0000","last_active":"2023-07-07T18:16:12.224382+0000","last_peered":"2023-07-07T18:16:12.224382+0000","last_clean":"2023-07-07T18:16:12.224382+0000","last_became_active":"2023-07-07T18:16:10.371532+0000","last_became_peered":"2023-07-07T18:16:10.371532+0000","last_unstale":"2023-07-07T18:16:12.224382+0000","last_undegraded":"2023-07-07T18:16:12.224382+0000","last_fullsized":"2023-07-07T18:16:12.224382+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:12:53.721770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350527+0000","last_change":"2023-07-07T18:16:10.374104+0000","last_active":"2023-07-07T18:16:11.350527+0000","last_peered":"2023-07-07T18:16:11.350527+0000","last_clean":"2023-07-07T18:16:11.350527+0000","last_became_active":"2023-07-07T18:16:10.373854+0000","last_became_peered":"2023-07-07T18:16:10.373854+0000","last_unstale":"2023-07-07T18:16:11.350527+0000","last_undegraded":"2023-07-07T18:16:11.350527+0000","last_fullsized":"2023-07-07T18:16:11.350527+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:31:35.523372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351309+0000","last_change":"2023-07-07T18:16:10.377690+0000","last_active":"2023-07-07T18:16:11.351309+0000","last_peered":"2023-07-07T18:16:11.351309+0000","last_clean":"2023-07-07T18:16:11.351309+0000","last_became_active":"2023-07-07T18:16:10.377463+0000","last_became_peered":"2023-07-07T18:16:10.377463+0000","last_unstale":"2023-07-07T18:16:11.351309+0000","last_undegraded":"2023-07-07T18:16:11.351309+0000","last_fullsized":"2023-07-07T18:16:11.351309+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:09:51.373787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351249+0000","last_change":"2023-07-07T18:16:10.368310+0000","last_active":"2023-07-07T18:16:11.351249+0000","last_peered":"2023-07-07T18:16:11.351249+0000","last_clean":"2023-07-07T18:16:11.351249+0000","last_became_active":"2023-07-07T18:16:10.368032+0000","last_became_peered":"2023-07-07T18:16:10.368032+0000","last_unstale":"2023-07-07T18:16:11.351249+0000","last_undegraded":"2023-07-07T18:16:11.351249+0000","last_fullsized":"2023-07-07T18:16:11.351249+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:12:37.937683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351160+0000","last_change":"2023-07-07T18:16:10.377693+0000","last_active":"2023-07-07T18:16:11.351160+0000","last_peered":"2023-07-07T18:16:11.351160+0000","last_clean":"2023-07-07T18:16:11.351160+0000","last_became_active":"2023-07-07T18:16:10.377410+0000","last_became_peered":"2023-07-07T18:16:10.377410+0000","last_unstale":"2023-07-07T18:16:11.351160+0000","last_undegraded":"2023-07-07T18:16:11.351160+0000","last_fullsized":"2023-07-07T18:16:11.351160+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:47:11.610368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369600+0000","last_change":"2023-07-07T18:16:10.361101+0000","last_active":"2023-07-07T18:16:10.369600+0000","last_peered":"2023-07-07T18:16:10.369600+0000","last_clean":"2023-07-07T18:16:10.369600+0000","last_became_active":"2023-07-07T18:16:10.360806+0000","last_became_peered":"2023-07-07T18:16:10.360806+0000","last_unstale":"2023-07-07T18:16:10.369600+0000","last_undegraded":"2023-07-07T18:16:10.369600+0000","last_fullsized":"2023-07-07T18:16:10.369600+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:09:51.373787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350010+0000","last_change":"2023-07-07T18:16:10.371822+0000","last_active":"2023-07-07T18:16:11.350010+0000","last_peered":"2023-07-07T18:16:11.350010+0000","last_clean":"2023-07-07T18:16:11.350010+0000","last_became_active":"2023-07-07T18:16:10.371562+0000","last_became_peered":"2023-07-07T18:16:10.371562+0000","last_unstale":"2023-07-07T18:16:11.350010+0000","last_undegraded":"2023-07-07T18:16:11.350010+0000","last_fullsized":"2023-07-07T18:16:11.350010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:51:29.180358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350730+0000","last_change":"2023-07-07T18:16:10.376744+0000","last_active":"2023-07-07T18:16:11.350730+0000","last_peered":"2023-07-07T18:16:11.350730+0000","last_clean":"2023-07-07T18:16:11.350730+0000","last_became_active":"2023-07-07T18:16:10.376460+0000","last_became_peered":"2023-07-07T18:16:10.376460+0000","last_unstale":"2023-07-07T18:16:11.350730+0000","last_undegraded":"2023-07-07T18:16:11.350730+0000","last_fullsized":"2023-07-07T18:16:11.350730+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:40:58.528010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.377206+0000","last_change":"2023-07-07T18:16:10.369485+0000","last_active":"2023-07-07T18:16:10.377206+0000","last_peered":"2023-07-07T18:16:10.377206+0000","last_clean":"2023-07-07T18:16:10.377206+0000","last_became_active":"2023-07-07T18:16:10.369217+0000","last_became_peered":"2023-07-07T18:16:10.369217+0000","last_unstale":"2023-07-07T18:16:10.377206+0000","last_undegraded":"2023-07-07T18:16:10.377206+0000","last_fullsized":"2023-07-07T18:16:10.377206+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:15:59.432858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.373022+0000","last_change":"2023-07-07T18:16:10.370880+0000","last_active":"2023-07-07T18:16:10.373022+0000","last_peered":"2023-07-07T18:16:10.373022+0000","last_clean":"2023-07-07T18:16:10.373022+0000","last_became_active":"2023-07-07T18:16:10.370612+0000","last_became_peered":"2023-07-07T18:16:10.370612+0000","last_unstale":"2023-07-07T18:16:10.373022+0000","last_undegraded":"2023-07-07T18:16:10.373022+0000","last_fullsized":"2023-07-07T18:16:10.373022+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:47:56.632979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.371981+0000","last_change":"2023-07-07T18:16:10.362834+0000","last_active":"2023-07-07T18:16:10.371981+0000","last_peered":"2023-07-07T18:16:10.371981+0000","last_clean":"2023-07-07T18:16:10.371981+0000","last_became_active":"2023-07-07T18:16:10.362399+0000","last_became_peered":"2023-07-07T18:16:10.362399+0000","last_unstale":"2023-07-07T18:16:10.371981+0000","last_undegraded":"2023-07-07T18:16:10.371981+0000","last_fullsized":"2023-07-07T18:16:10.371981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:42:09.310537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.374346+0000","last_change":"2023-07-07T18:16:10.372562+0000","last_active":"2023-07-07T18:16:10.374346+0000","last_peered":"2023-07-07T18:16:10.374346+0000","last_clean":"2023-07-07T18:16:10.374346+0000","last_became_active":"2023-07-07T18:16:10.372243+0000","last_became_peered":"2023-07-07T18:16:10.372243+0000","last_unstale":"2023-07-07T18:16:10.374346+0000","last_undegraded":"2023-07-07T18:16:10.374346+0000","last_fullsized":"2023-07-07T18:16:10.374346+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:56:50.072465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.377899+0000","last_change":"2023-07-07T18:16:10.374026+0000","last_active":"2023-07-07T18:16:10.377899+0000","last_peered":"2023-07-07T18:16:10.377899+0000","last_clean":"2023-07-07T18:16:10.377899+0000","last_became_active":"2023-07-07T18:16:10.373624+0000","last_became_peered":"2023-07-07T18:16:10.373624+0000","last_unstale":"2023-07-07T18:16:10.377899+0000","last_undegraded":"2023-07-07T18:16:10.377899+0000","last_fullsized":"2023-07-07T18:16:10.377899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:03:38.018816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349592+0000","last_change":"2023-07-07T18:16:10.360033+0000","last_active":"2023-07-07T18:16:11.349592+0000","last_peered":"2023-07-07T18:16:11.349592+0000","last_clean":"2023-07-07T18:16:11.349592+0000","last_became_active":"2023-07-07T18:16:10.359739+0000","last_became_peered":"2023-07-07T18:16:10.359739+0000","last_unstale":"2023-07-07T18:16:11.349592+0000","last_undegraded":"2023-07-07T18:16:11.349592+0000","last_fullsized":"2023-07-07T18:16:11.349592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:13:36.820671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.375397+0000","last_change":"2023-07-07T18:16:10.368582+0000","last_active":"2023-07-07T18:16:10.375397+0000","last_peered":"2023-07-07T18:16:10.375397+0000","last_clean":"2023-07-07T18:16:10.375397+0000","last_became_active":"2023-07-07T18:16:10.368238+0000","last_became_peered":"2023-07-07T18:16:10.368238+0000","last_unstale":"2023-07-07T18:16:10.375397+0000","last_undegraded":"2023-07-07T18:16:10.375397+0000","last_fullsized":"2023-07-07T18:16:10.375397+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:07:11.508213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350812+0000","last_change":"2023-07-07T18:16:10.368207+0000","last_active":"2023-07-07T18:16:11.350812+0000","last_peered":"2023-07-07T18:16:11.350812+0000","last_clean":"2023-07-07T18:16:11.350812+0000","last_became_active":"2023-07-07T18:16:10.367813+0000","last_became_peered":"2023-07-07T18:16:10.367813+0000","last_unstale":"2023-07-07T18:16:11.350812+0000","last_undegraded":"2023-07-07T18:16:11.350812+0000","last_fullsized":"2023-07-07T18:16:11.350812+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:55:33.182595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369476+0000","last_change":"2023-07-07T18:16:10.363901+0000","last_active":"2023-07-07T18:16:10.369476+0000","last_peered":"2023-07-07T18:16:10.369476+0000","last_clean":"2023-07-07T18:16:10.369476+0000","last_became_active":"2023-07-07T18:16:10.363609+0000","last_became_peered":"2023-07-07T18:16:10.363609+0000","last_unstale":"2023-07-07T18:16:10.369476+0000","last_undegraded":"2023-07-07T18:16:10.369476+0000","last_fullsized":"2023-07-07T18:16:10.369476+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:43:20.259966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369413+0000","last_change":"2023-07-07T18:16:10.364812+0000","last_active":"2023-07-07T18:16:10.369413+0000","last_peered":"2023-07-07T18:16:10.369413+0000","last_clean":"2023-07-07T18:16:10.369413+0000","last_became_active":"2023-07-07T18:16:10.364470+0000","last_became_peered":"2023-07-07T18:16:10.364470+0000","last_unstale":"2023-07-07T18:16:10.369413+0000","last_undegraded":"2023-07-07T18:16:10.369413+0000","last_fullsized":"2023-07-07T18:16:10.369413+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:58:08.460792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378338+0000","last_change":"2023-07-07T18:16:10.377686+0000","last_active":"2023-07-07T18:16:10.378338+0000","last_peered":"2023-07-07T18:16:10.378338+0000","last_clean":"2023-07-07T18:16:10.378338+0000","last_became_active":"2023-07-07T18:16:10.377402+0000","last_became_peered":"2023-07-07T18:16:10.377402+0000","last_unstale":"2023-07-07T18:16:10.378338+0000","last_undegraded":"2023-07-07T18:16:10.378338+0000","last_fullsized":"2023-07-07T18:16:10.378338+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:46:51.143068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349679+0000","last_change":"2023-07-07T18:16:10.373879+0000","last_active":"2023-07-07T18:16:11.349679+0000","last_peered":"2023-07-07T18:16:11.349679+0000","last_clean":"2023-07-07T18:16:11.349679+0000","last_became_active":"2023-07-07T18:16:10.373630+0000","last_became_peered":"2023-07-07T18:16:10.373630+0000","last_unstale":"2023-07-07T18:16:11.349679+0000","last_undegraded":"2023-07-07T18:16:11.349679+0000","last_fullsized":"2023-07-07T18:16:11.349679+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:40:29.245992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369167+0000","last_change":"2023-07-07T18:16:10.362198+0000","last_active":"2023-07-07T18:16:10.369167+0000","last_peered":"2023-07-07T18:16:10.369167+0000","last_clean":"2023-07-07T18:16:10.369167+0000","last_became_active":"2023-07-07T18:16:10.361925+0000","last_became_peered":"2023-07-07T18:16:10.361925+0000","last_unstale":"2023-07-07T18:16:10.369167+0000","last_undegraded":"2023-07-07T18:16:10.369167+0000","last_fullsized":"2023-07-07T18:16:10.369167+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:01:35.612692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372822+0000","last_change":"2023-07-07T18:16:10.366166+0000","last_active":"2023-07-07T18:16:10.372822+0000","last_peered":"2023-07-07T18:16:10.372822+0000","last_clean":"2023-07-07T18:16:10.372822+0000","last_became_active":"2023-07-07T18:16:10.365905+0000","last_became_peered":"2023-07-07T18:16:10.365905+0000","last_unstale":"2023-07-07T18:16:10.372822+0000","last_undegraded":"2023-07-07T18:16:10.372822+0000","last_fullsized":"2023-07-07T18:16:10.372822+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:25:09.034642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378318+0000","last_change":"2023-07-07T18:16:10.376686+0000","last_active":"2023-07-07T18:16:10.378318+0000","last_peered":"2023-07-07T18:16:10.378318+0000","last_clean":"2023-07-07T18:16:10.378318+0000","last_became_active":"2023-07-07T18:16:10.376451+0000","last_became_peered":"2023-07-07T18:16:10.376451+0000","last_unstale":"2023-07-07T18:16:10.378318+0000","last_undegraded":"2023-07-07T18:16:10.378318+0000","last_fullsized":"2023-07-07T18:16:10.378318+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:40:04.027285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.371908+0000","last_change":"2023-07-07T18:16:10.362335+0000","last_active":"2023-07-07T18:16:10.371908+0000","last_peered":"2023-07-07T18:16:10.371908+0000","last_clean":"2023-07-07T18:16:10.371908+0000","last_became_active":"2023-07-07T18:16:10.362064+0000","last_became_peered":"2023-07-07T18:16:10.362064+0000","last_unstale":"2023-07-07T18:16:10.371908+0000","last_undegraded":"2023-07-07T18:16:10.371908+0000","last_fullsized":"2023-07-07T18:16:10.371908+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:31:58.541448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378496+0000","last_change":"2023-07-07T18:16:10.373299+0000","last_active":"2023-07-07T18:16:10.378496+0000","last_peered":"2023-07-07T18:16:10.378496+0000","last_clean":"2023-07-07T18:16:10.378496+0000","last_became_active":"2023-07-07T18:16:10.372989+0000","last_became_peered":"2023-07-07T18:16:10.372989+0000","last_unstale":"2023-07-07T18:16:10.378496+0000","last_undegraded":"2023-07-07T18:16:10.378496+0000","last_fullsized":"2023-07-07T18:16:10.378496+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:33:31.046616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349563+0000","last_change":"2023-07-07T18:16:10.360838+0000","last_active":"2023-07-07T18:16:11.349563+0000","last_peered":"2023-07-07T18:16:11.349563+0000","last_clean":"2023-07-07T18:16:11.349563+0000","last_became_active":"2023-07-07T18:16:10.360578+0000","last_became_peered":"2023-07-07T18:16:10.360578+0000","last_unstale":"2023-07-07T18:16:11.349563+0000","last_undegraded":"2023-07-07T18:16:11.349563+0000","last_fullsized":"2023-07-07T18:16:11.349563+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:56:13.180400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349660+0000","last_change":"2023-07-07T18:16:10.364938+0000","last_active":"2023-07-07T18:16:11.349660+0000","last_peered":"2023-07-07T18:16:11.349660+0000","last_clean":"2023-07-07T18:16:11.349660+0000","last_became_active":"2023-07-07T18:16:10.364695+0000","last_became_peered":"2023-07-07T18:16:10.364695+0000","last_unstale":"2023-07-07T18:16:11.349660+0000","last_undegraded":"2023-07-07T18:16:11.349660+0000","last_fullsized":"2023-07-07T18:16:11.349660+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:47:11.610368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369886+0000","last_change":"2023-07-07T18:16:09.939817+0000","last_active":"2023-07-07T18:16:10.369886+0000","last_peered":"2023-07-07T18:16:10.369886+0000","last_clean":"2023-07-07T18:16:10.369886+0000","last_became_active":"2023-07-07T18:16:09.939461+0000","last_became_peered":"2023-07-07T18:16:09.939461+0000","last_unstale":"2023-07-07T18:16:10.369886+0000","last_undegraded":"2023-07-07T18:16:10.369886+0000","last_fullsized":"2023-07-07T18:16:10.369886+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:52:01.885546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372911+0000","last_change":"2023-07-07T18:16:10.370123+0000","last_active":"2023-07-07T18:16:10.372911+0000","last_peered":"2023-07-07T18:16:10.372911+0000","last_clean":"2023-07-07T18:16:10.372911+0000","last_became_active":"2023-07-07T18:16:10.369823+0000","last_became_peered":"2023-07-07T18:16:10.369823+0000","last_unstale":"2023-07-07T18:16:10.372911+0000","last_undegraded":"2023-07-07T18:16:10.372911+0000","last_fullsized":"2023-07-07T18:16:10.372911+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:29:58.643297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.367690+0000","last_change":"2023-07-07T18:16:09.940982+0000","last_active":"2023-07-07T18:16:10.367690+0000","last_peered":"2023-07-07T18:16:10.367690+0000","last_clean":"2023-07-07T18:16:10.367690+0000","last_became_active":"2023-07-07T18:16:09.940217+0000","last_became_peered":"2023-07-07T18:16:09.940217+0000","last_unstale":"2023-07-07T18:16:10.367690+0000","last_undegraded":"2023-07-07T18:16:10.367690+0000","last_fullsized":"2023-07-07T18:16:10.367690+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:23:12.822412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369623+0000","last_change":"2023-07-07T18:16:10.361679+0000","last_active":"2023-07-07T18:16:10.369623+0000","last_peered":"2023-07-07T18:16:10.369623+0000","last_clean":"2023-07-07T18:16:10.369623+0000","last_became_active":"2023-07-07T18:16:10.361375+0000","last_became_peered":"2023-07-07T18:16:10.361375+0000","last_unstale":"2023-07-07T18:16:10.369623+0000","last_undegraded":"2023-07-07T18:16:10.369623+0000","last_fullsized":"2023-07-07T18:16:10.369623+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:47:11.610368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349749+0000","last_change":"2023-07-07T18:16:09.933198+0000","last_active":"2023-07-07T18:16:11.349749+0000","last_peered":"2023-07-07T18:16:11.349749+0000","last_clean":"2023-07-07T18:16:11.349749+0000","last_became_active":"2023-07-07T18:16:09.932790+0000","last_became_peered":"2023-07-07T18:16:09.932790+0000","last_unstale":"2023-07-07T18:16:11.349749+0000","last_undegraded":"2023-07-07T18:16:11.349749+0000","last_fullsized":"2023-07-07T18:16:11.349749+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:12:36.932890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349459+0000","last_change":"2023-07-07T18:16:10.365938+0000","last_active":"2023-07-07T18:16:11.349459+0000","last_peered":"2023-07-07T18:16:11.349459+0000","last_clean":"2023-07-07T18:16:11.349459+0000","last_became_active":"2023-07-07T18:16:10.365681+0000","last_became_peered":"2023-07-07T18:16:10.365681+0000","last_unstale":"2023-07-07T18:16:11.349459+0000","last_undegraded":"2023-07-07T18:16:11.349459+0000","last_fullsized":"2023-07-07T18:16:11.349459+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:55:27.552409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224603+0000","last_change":"2023-07-07T18:16:09.937847+0000","last_active":"2023-07-07T18:16:12.224603+0000","last_peered":"2023-07-07T18:16:12.224603+0000","last_clean":"2023-07-07T18:16:12.224603+0000","last_became_active":"2023-07-07T18:16:09.937451+0000","last_became_peered":"2023-07-07T18:16:09.937451+0000","last_unstale":"2023-07-07T18:16:12.224603+0000","last_undegraded":"2023-07-07T18:16:12.224603+0000","last_fullsized":"2023-07-07T18:16:12.224603+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:58:47.983709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.371927+0000","last_change":"2023-07-07T18:16:10.366244+0000","last_active":"2023-07-07T18:16:10.371927+0000","last_peered":"2023-07-07T18:16:10.371927+0000","last_clean":"2023-07-07T18:16:10.371927+0000","last_became_active":"2023-07-07T18:16:10.365948+0000","last_became_peered":"2023-07-07T18:16:10.365948+0000","last_unstale":"2023-07-07T18:16:10.371927+0000","last_undegraded":"2023-07-07T18:16:10.371927+0000","last_fullsized":"2023-07-07T18:16:10.371927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:04:54.237396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369007+0000","last_change":"2023-07-07T18:16:09.943622+0000","last_active":"2023-07-07T18:16:10.369007+0000","last_peered":"2023-07-07T18:16:10.369007+0000","last_clean":"2023-07-07T18:16:10.369007+0000","last_became_active":"2023-07-07T18:16:09.943047+0000","last_became_peered":"2023-07-07T18:16:09.943047+0000","last_unstale":"2023-07-07T18:16:10.369007+0000","last_undegraded":"2023-07-07T18:16:10.369007+0000","last_fullsized":"2023-07-07T18:16:10.369007+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:39:37.282906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351164+0000","last_change":"2023-07-07T18:16:10.364537+0000","last_active":"2023-07-07T18:16:11.351164+0000","last_peered":"2023-07-07T18:16:11.351164+0000","last_clean":"2023-07-07T18:16:11.351164+0000","last_became_active":"2023-07-07T18:16:10.364256+0000","last_became_peered":"2023-07-07T18:16:10.364256+0000","last_unstale":"2023-07-07T18:16:11.351164+0000","last_undegraded":"2023-07-07T18:16:11.351164+0000","last_fullsized":"2023-07-07T18:16:11.351164+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:12:24.075862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.361606+0000","last_change":"2023-07-07T18:16:09.939350+0000","last_active":"2023-07-07T18:16:10.361606+0000","last_peered":"2023-07-07T18:16:10.361606+0000","last_clean":"2023-07-07T18:16:10.361606+0000","last_became_active":"2023-07-07T18:16:09.938936+0000","last_became_peered":"2023-07-07T18:16:09.938936+0000","last_unstale":"2023-07-07T18:16:10.361606+0000","last_undegraded":"2023-07-07T18:16:10.361606+0000","last_fullsized":"2023-07-07T18:16:10.361606+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:48:15.280152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350616+0000","last_change":"2023-07-07T18:16:10.368512+0000","last_active":"2023-07-07T18:16:11.350616+0000","last_peered":"2023-07-07T18:16:11.350616+0000","last_clean":"2023-07-07T18:16:11.350616+0000","last_became_active":"2023-07-07T18:16:10.368005+0000","last_became_peered":"2023-07-07T18:16:10.368005+0000","last_unstale":"2023-07-07T18:16:11.350616+0000","last_undegraded":"2023-07-07T18:16:11.350616+0000","last_fullsized":"2023-07-07T18:16:11.350616+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T00:25:43.257815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.348928+0000","last_change":"2023-07-07T18:16:09.932937+0000","last_active":"2023-07-07T18:16:10.348928+0000","last_peered":"2023-07-07T18:16:10.348928+0000","last_clean":"2023-07-07T18:16:10.348928+0000","last_became_active":"2023-07-07T18:16:09.932596+0000","last_became_peered":"2023-07-07T18:16:09.932596+0000","last_unstale":"2023-07-07T18:16:10.348928+0000","last_undegraded":"2023-07-07T18:16:10.348928+0000","last_fullsized":"2023-07-07T18:16:10.348928+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:12:36.932890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369455+0000","last_change":"2023-07-07T18:16:10.363787+0000","last_active":"2023-07-07T18:16:10.369455+0000","last_peered":"2023-07-07T18:16:10.369455+0000","last_clean":"2023-07-07T18:16:10.369455+0000","last_became_active":"2023-07-07T18:16:10.363325+0000","last_became_peered":"2023-07-07T18:16:10.363325+0000","last_unstale":"2023-07-07T18:16:10.369455+0000","last_undegraded":"2023-07-07T18:16:10.369455+0000","last_fullsized":"2023-07-07T18:16:10.369455+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:03:47.696298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350659+0000","last_change":"2023-07-07T18:16:09.935309+0000","last_active":"2023-07-07T18:16:11.350659+0000","last_peered":"2023-07-07T18:16:11.350659+0000","last_clean":"2023-07-07T18:16:11.350659+0000","last_became_active":"2023-07-07T18:16:09.935131+0000","last_became_peered":"2023-07-07T18:16:09.935131+0000","last_unstale":"2023-07-07T18:16:11.350659+0000","last_undegraded":"2023-07-07T18:16:11.350659+0000","last_fullsized":"2023-07-07T18:16:11.350659+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:31:48.567569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.374369+0000","last_change":"2023-07-07T18:16:10.372867+0000","last_active":"2023-07-07T18:16:10.374369+0000","last_peered":"2023-07-07T18:16:10.374369+0000","last_clean":"2023-07-07T18:16:10.374369+0000","last_became_active":"2023-07-07T18:16:10.372598+0000","last_became_peered":"2023-07-07T18:16:10.372598+0000","last_unstale":"2023-07-07T18:16:10.374369+0000","last_undegraded":"2023-07-07T18:16:10.374369+0000","last_fullsized":"2023-07-07T18:16:10.374369+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:31:11.989216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.356408+0000","last_change":"2023-07-07T18:16:09.939168+0000","last_active":"2023-07-07T18:16:10.356408+0000","last_peered":"2023-07-07T18:16:10.356408+0000","last_clean":"2023-07-07T18:16:10.356408+0000","last_became_active":"2023-07-07T18:16:09.938900+0000","last_became_peered":"2023-07-07T18:16:09.938900+0000","last_unstale":"2023-07-07T18:16:10.356408+0000","last_undegraded":"2023-07-07T18:16:10.356408+0000","last_fullsized":"2023-07-07T18:16:10.356408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:18:23.992777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224920+0000","last_change":"2023-07-07T18:16:10.370023+0000","last_active":"2023-07-07T18:16:12.224920+0000","last_peered":"2023-07-07T18:16:12.224920+0000","last_clean":"2023-07-07T18:16:12.224920+0000","last_became_active":"2023-07-07T18:16:10.369771+0000","last_became_peered":"2023-07-07T18:16:10.369771+0000","last_unstale":"2023-07-07T18:16:12.224920+0000","last_undegraded":"2023-07-07T18:16:12.224920+0000","last_fullsized":"2023-07-07T18:16:12.224920+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:34:31.483896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351408+0000","last_change":"2023-07-07T18:16:09.937391+0000","last_active":"2023-07-07T18:16:11.351408+0000","last_peered":"2023-07-07T18:16:11.351408+0000","last_clean":"2023-07-07T18:16:11.351408+0000","last_became_active":"2023-07-07T18:16:09.937081+0000","last_became_peered":"2023-07-07T18:16:09.937081+0000","last_unstale":"2023-07-07T18:16:11.351408+0000","last_undegraded":"2023-07-07T18:16:11.351408+0000","last_fullsized":"2023-07-07T18:16:11.351408+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:53:25.587017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372687+0000","last_change":"2023-07-07T18:16:10.366266+0000","last_active":"2023-07-07T18:16:10.372687+0000","last_peered":"2023-07-07T18:16:10.372687+0000","last_clean":"2023-07-07T18:16:10.372687+0000","last_became_active":"2023-07-07T18:16:10.366035+0000","last_became_peered":"2023-07-07T18:16:10.366035+0000","last_unstale":"2023-07-07T18:16:10.372687+0000","last_undegraded":"2023-07-07T18:16:10.372687+0000","last_fullsized":"2023-07-07T18:16:10.372687+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:56:59.951908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224818+0000","last_change":"2023-07-07T18:16:09.940752+0000","last_active":"2023-07-07T18:16:12.224818+0000","last_peered":"2023-07-07T18:16:12.224818+0000","last_clean":"2023-07-07T18:16:12.224818+0000","last_became_active":"2023-07-07T18:16:09.940164+0000","last_became_peered":"2023-07-07T18:16:09.940164+0000","last_unstale":"2023-07-07T18:16:12.224818+0000","last_undegraded":"2023-07-07T18:16:12.224818+0000","last_fullsized":"2023-07-07T18:16:12.224818+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:58:37.502666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224692+0000","last_change":"2023-07-07T18:16:10.376163+0000","last_active":"2023-07-07T18:16:12.224692+0000","last_peered":"2023-07-07T18:16:12.224692+0000","last_clean":"2023-07-07T18:16:12.224692+0000","last_became_active":"2023-07-07T18:16:10.375881+0000","last_became_peered":"2023-07-07T18:16:10.375881+0000","last_unstale":"2023-07-07T18:16:12.224692+0000","last_undegraded":"2023-07-07T18:16:12.224692+0000","last_fullsized":"2023-07-07T18:16:12.224692+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:35:18.477107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349921+0000","last_change":"2023-07-07T18:16:09.942487+0000","last_active":"2023-07-07T18:16:11.349921+0000","last_peered":"2023-07-07T18:16:11.349921+0000","last_clean":"2023-07-07T18:16:11.349921+0000","last_became_active":"2023-07-07T18:16:09.942162+0000","last_became_peered":"2023-07-07T18:16:09.942162+0000","last_unstale":"2023-07-07T18:16:11.349921+0000","last_undegraded":"2023-07-07T18:16:11.349921+0000","last_fullsized":"2023-07-07T18:16:11.349921+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:53:41.344033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.377936+0000","last_change":"2023-07-07T18:16:10.374254+0000","last_active":"2023-07-07T18:16:10.377936+0000","last_peered":"2023-07-07T18:16:10.377936+0000","last_clean":"2023-07-07T18:16:10.377936+0000","last_became_active":"2023-07-07T18:16:10.373709+0000","last_became_peered":"2023-07-07T18:16:10.373709+0000","last_unstale":"2023-07-07T18:16:10.377936+0000","last_undegraded":"2023-07-07T18:16:10.377936+0000","last_fullsized":"2023-07-07T18:16:10.377936+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:07:39.352056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.373353+0000","last_change":"2023-07-07T18:16:09.943555+0000","last_active":"2023-07-07T18:16:10.373353+0000","last_peered":"2023-07-07T18:16:10.373353+0000","last_clean":"2023-07-07T18:16:10.373353+0000","last_became_active":"2023-07-07T18:16:09.942751+0000","last_became_peered":"2023-07-07T18:16:09.942751+0000","last_unstale":"2023-07-07T18:16:10.373353+0000","last_undegraded":"2023-07-07T18:16:10.373353+0000","last_fullsized":"2023-07-07T18:16:10.373353+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:28:31.749736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351123+0000","last_change":"2023-07-07T18:16:10.367246+0000","last_active":"2023-07-07T18:16:11.351123+0000","last_peered":"2023-07-07T18:16:11.351123+0000","last_clean":"2023-07-07T18:16:11.351123+0000","last_became_active":"2023-07-07T18:16:10.366971+0000","last_became_peered":"2023-07-07T18:16:10.366971+0000","last_unstale":"2023-07-07T18:16:11.351123+0000","last_undegraded":"2023-07-07T18:16:11.351123+0000","last_fullsized":"2023-07-07T18:16:11.351123+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:55:27.552409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224416+0000","last_change":"2023-07-07T18:16:09.939063+0000","last_active":"2023-07-07T18:16:12.224416+0000","last_peered":"2023-07-07T18:16:12.224416+0000","last_clean":"2023-07-07T18:16:12.224416+0000","last_became_active":"2023-07-07T18:16:09.938769+0000","last_became_peered":"2023-07-07T18:16:09.938769+0000","last_unstale":"2023-07-07T18:16:12.224416+0000","last_undegraded":"2023-07-07T18:16:12.224416+0000","last_fullsized":"2023-07-07T18:16:12.224416+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:20:47.504164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.376178+0000","last_change":"2023-07-07T18:16:10.366974+0000","last_active":"2023-07-07T18:16:10.376178+0000","last_peered":"2023-07-07T18:16:10.376178+0000","last_clean":"2023-07-07T18:16:10.376178+0000","last_became_active":"2023-07-07T18:16:10.366724+0000","last_became_peered":"2023-07-07T18:16:10.366724+0000","last_unstale":"2023-07-07T18:16:10.376178+0000","last_undegraded":"2023-07-07T18:16:10.376178+0000","last_fullsized":"2023-07-07T18:16:10.376178+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:34:59.181811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.354365+0000","last_change":"2023-07-07T18:16:09.938886+0000","last_active":"2023-07-07T18:16:10.354365+0000","last_peered":"2023-07-07T18:16:10.354365+0000","last_clean":"2023-07-07T18:16:10.354365+0000","last_became_active":"2023-07-07T18:16:09.938518+0000","last_became_peered":"2023-07-07T18:16:09.938518+0000","last_unstale":"2023-07-07T18:16:10.354365+0000","last_undegraded":"2023-07-07T18:16:10.354365+0000","last_fullsized":"2023-07-07T18:16:10.354365+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:26:31.811102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224501+0000","last_change":"2023-07-07T18:16:10.365287+0000","last_active":"2023-07-07T18:16:12.224501+0000","last_peered":"2023-07-07T18:16:12.224501+0000","last_clean":"2023-07-07T18:16:12.224501+0000","last_became_active":"2023-07-07T18:16:10.365012+0000","last_became_peered":"2023-07-07T18:16:10.365012+0000","last_unstale":"2023-07-07T18:16:12.224501+0000","last_undegraded":"2023-07-07T18:16:12.224501+0000","last_fullsized":"2023-07-07T18:16:12.224501+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:56:40.168013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":21,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350979+0000","last_change":"2023-07-07T18:16:09.937667+0000","last_active":"2023-07-07T18:16:11.350979+0000","last_peered":"2023-07-07T18:16:11.350979+0000","last_clean":"2023-07-07T18:16:11.350979+0000","last_became_active":"2023-07-07T18:16:09.937353+0000","last_became_peered":"2023-07-07T18:16:09.937353+0000","last_unstale":"2023-07-07T18:16:11.350979+0000","last_undegraded":"2023-07-07T18:16:11.350979+0000","last_fullsized":"2023-07-07T18:16:11.350979+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:14:16.531592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349819+0000","last_change":"2023-07-07T18:16:10.353020+0000","last_active":"2023-07-07T18:16:11.349819+0000","last_peered":"2023-07-07T18:16:11.349819+0000","last_clean":"2023-07-07T18:16:11.349819+0000","last_became_active":"2023-07-07T18:16:10.352759+0000","last_became_peered":"2023-07-07T18:16:10.352759+0000","last_unstale":"2023-07-07T18:16:11.349819+0000","last_undegraded":"2023-07-07T18:16:11.349819+0000","last_fullsized":"2023-07-07T18:16:11.349819+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:12:40.616147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349494+0000","last_change":"2023-07-07T18:16:09.941664+0000","last_active":"2023-07-07T18:16:11.349494+0000","last_peered":"2023-07-07T18:16:11.349494+0000","last_clean":"2023-07-07T18:16:11.349494+0000","last_became_active":"2023-07-07T18:16:09.941288+0000","last_became_peered":"2023-07-07T18:16:09.941288+0000","last_unstale":"2023-07-07T18:16:11.349494+0000","last_undegraded":"2023-07-07T18:16:11.349494+0000","last_fullsized":"2023-07-07T18:16:11.349494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:46:17.429009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351445+0000","last_change":"2023-07-07T18:16:10.370330+0000","last_active":"2023-07-07T18:16:11.351445+0000","last_peered":"2023-07-07T18:16:11.351445+0000","last_clean":"2023-07-07T18:16:11.351445+0000","last_became_active":"2023-07-07T18:16:10.370083+0000","last_became_peered":"2023-07-07T18:16:10.370083+0000","last_unstale":"2023-07-07T18:16:11.351445+0000","last_undegraded":"2023-07-07T18:16:11.351445+0000","last_fullsized":"2023-07-07T18:16:11.351445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:22:45.886080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.376254+0000","last_change":"2023-07-07T18:16:09.941735+0000","last_active":"2023-07-07T18:16:10.376254+0000","last_peered":"2023-07-07T18:16:10.376254+0000","last_clean":"2023-07-07T18:16:10.376254+0000","last_became_active":"2023-07-07T18:16:09.941093+0000","last_became_peered":"2023-07-07T18:16:09.941093+0000","last_unstale":"2023-07-07T18:16:10.376254+0000","last_undegraded":"2023-07-07T18:16:10.376254+0000","last_fullsized":"2023-07-07T18:16:10.376254+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:07:14.331079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372946+0000","last_change":"2023-07-07T18:16:10.370260+0000","last_active":"2023-07-07T18:16:10.372946+0000","last_peered":"2023-07-07T18:16:10.372946+0000","last_clean":"2023-07-07T18:16:10.372946+0000","last_became_active":"2023-07-07T18:16:10.369967+0000","last_became_peered":"2023-07-07T18:16:10.369967+0000","last_unstale":"2023-07-07T18:16:10.372946+0000","last_undegraded":"2023-07-07T18:16:10.372946+0000","last_fullsized":"2023-07-07T18:16:10.372946+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:30:17.466450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.357936+0000","last_change":"2023-07-07T18:16:09.930956+0000","last_active":"2023-07-07T18:16:10.357936+0000","last_peered":"2023-07-07T18:16:10.357936+0000","last_clean":"2023-07-07T18:16:10.357936+0000","last_became_active":"2023-07-07T18:16:09.930645+0000","last_became_peered":"2023-07-07T18:16:09.930645+0000","last_unstale":"2023-07-07T18:16:10.357936+0000","last_undegraded":"2023-07-07T18:16:10.357936+0000","last_fullsized":"2023-07-07T18:16:10.357936+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:22:44.881287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378305+0000","last_change":"2023-07-07T18:16:10.376659+0000","last_active":"2023-07-07T18:16:10.378305+0000","last_peered":"2023-07-07T18:16:10.378305+0000","last_clean":"2023-07-07T18:16:10.378305+0000","last_became_active":"2023-07-07T18:16:10.376398+0000","last_became_peered":"2023-07-07T18:16:10.376398+0000","last_unstale":"2023-07-07T18:16:10.378305+0000","last_undegraded":"2023-07-07T18:16:10.378305+0000","last_fullsized":"2023-07-07T18:16:10.378305+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:00:28.595427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.354450+0000","last_change":"2023-07-07T18:16:09.940452+0000","last_active":"2023-07-07T18:16:10.354450+0000","last_peered":"2023-07-07T18:16:10.354450+0000","last_clean":"2023-07-07T18:16:10.354450+0000","last_became_active":"2023-07-07T18:16:09.939922+0000","last_became_peered":"2023-07-07T18:16:09.939922+0000","last_unstale":"2023-07-07T18:16:10.354450+0000","last_undegraded":"2023-07-07T18:16:10.354450+0000","last_fullsized":"2023-07-07T18:16:10.354450+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:59:55.355311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372563+0000","last_change":"2023-07-07T18:16:10.366785+0000","last_active":"2023-07-07T18:16:10.372563+0000","last_peered":"2023-07-07T18:16:10.372563+0000","last_clean":"2023-07-07T18:16:10.372563+0000","last_became_active":"2023-07-07T18:16:10.366509+0000","last_became_peered":"2023-07-07T18:16:10.366509+0000","last_unstale":"2023-07-07T18:16:10.372563+0000","last_undegraded":"2023-07-07T18:16:10.372563+0000","last_fullsized":"2023-07-07T18:16:10.372563+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:00:12.804894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.368911+0000","last_change":"2023-07-07T18:16:09.943753+0000","last_active":"2023-07-07T18:16:10.368911+0000","last_peered":"2023-07-07T18:16:10.368911+0000","last_clean":"2023-07-07T18:16:10.368911+0000","last_became_active":"2023-07-07T18:16:09.943295+0000","last_became_peered":"2023-07-07T18:16:09.943295+0000","last_unstale":"2023-07-07T18:16:10.368911+0000","last_undegraded":"2023-07-07T18:16:10.368911+0000","last_fullsized":"2023-07-07T18:16:10.368911+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:53:55.791502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349334+0000","last_change":"2023-07-07T18:16:10.363834+0000","last_active":"2023-07-07T18:16:11.349334+0000","last_peered":"2023-07-07T18:16:11.349334+0000","last_clean":"2023-07-07T18:16:11.349334+0000","last_became_active":"2023-07-07T18:16:10.363571+0000","last_became_peered":"2023-07-07T18:16:10.363571+0000","last_unstale":"2023-07-07T18:16:11.349334+0000","last_undegraded":"2023-07-07T18:16:11.349334+0000","last_fullsized":"2023-07-07T18:16:11.349334+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:40:47.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.349031+0000","last_change":"2023-07-07T18:16:09.934947+0000","last_active":"2023-07-07T18:16:10.349031+0000","last_peered":"2023-07-07T18:16:10.349031+0000","last_clean":"2023-07-07T18:16:10.349031+0000","last_became_active":"2023-07-07T18:16:09.934664+0000","last_became_peered":"2023-07-07T18:16:09.934664+0000","last_unstale":"2023-07-07T18:16:10.349031+0000","last_undegraded":"2023-07-07T18:16:10.349031+0000","last_fullsized":"2023-07-07T18:16:10.349031+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:53:25.587017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349878+0000","last_change":"2023-07-07T18:16:10.361396+0000","last_active":"2023-07-07T18:16:11.349878+0000","last_peered":"2023-07-07T18:16:11.349878+0000","last_clean":"2023-07-07T18:16:11.349878+0000","last_became_active":"2023-07-07T18:16:10.361153+0000","last_became_peered":"2023-07-07T18:16:10.361153+0000","last_unstale":"2023-07-07T18:16:11.349878+0000","last_undegraded":"2023-07-07T18:16:11.349878+0000","last_fullsized":"2023-07-07T18:16:11.349878+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:03:26.509090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351039+0000","last_change":"2023-07-07T18:16:09.937270+0000","last_active":"2023-07-07T18:16:11.351039+0000","last_peered":"2023-07-07T18:16:11.351039+0000","last_clean":"2023-07-07T18:16:11.351039+0000","last_became_active":"2023-07-07T18:16:09.936932+0000","last_became_peered":"2023-07-07T18:16:09.936932+0000","last_unstale":"2023-07-07T18:16:11.351039+0000","last_undegraded":"2023-07-07T18:16:11.351039+0000","last_fullsized":"2023-07-07T18:16:11.351039+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:35:26.508547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350927+0000","last_change":"2023-07-07T18:16:10.376756+0000","last_active":"2023-07-07T18:16:11.350927+0000","last_peered":"2023-07-07T18:16:11.350927+0000","last_clean":"2023-07-07T18:16:11.350927+0000","last_became_active":"2023-07-07T18:16:10.376470+0000","last_became_peered":"2023-07-07T18:16:10.376470+0000","last_unstale":"2023-07-07T18:16:11.350927+0000","last_undegraded":"2023-07-07T18:16:11.350927+0000","last_fullsized":"2023-07-07T18:16:11.350927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:25:27.983914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224206+0000","last_change":"2023-07-07T18:16:09.939012+0000","last_active":"2023-07-07T18:16:12.224206+0000","last_peered":"2023-07-07T18:16:12.224206+0000","last_clean":"2023-07-07T18:16:12.224206+0000","last_became_active":"2023-07-07T18:16:09.938738+0000","last_became_peered":"2023-07-07T18:16:09.938738+0000","last_unstale":"2023-07-07T18:16:12.224206+0000","last_undegraded":"2023-07-07T18:16:12.224206+0000","last_fullsized":"2023-07-07T18:16:12.224206+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:07:27.975441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.373522+0000","last_change":"2023-07-07T18:16:10.371015+0000","last_active":"2023-07-07T18:16:10.373522+0000","last_peered":"2023-07-07T18:16:10.373522+0000","last_clean":"2023-07-07T18:16:10.373522+0000","last_became_active":"2023-07-07T18:16:10.370665+0000","last_became_peered":"2023-07-07T18:16:10.370665+0000","last_unstale":"2023-07-07T18:16:10.373522+0000","last_undegraded":"2023-07-07T18:16:10.373522+0000","last_fullsized":"2023-07-07T18:16:10.373522+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:39:06.214722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350784+0000","last_change":"2023-07-07T18:16:09.941071+0000","last_active":"2023-07-07T18:16:11.350784+0000","last_peered":"2023-07-07T18:16:11.350784+0000","last_clean":"2023-07-07T18:16:11.350784+0000","last_became_active":"2023-07-07T18:16:09.940761+0000","last_became_peered":"2023-07-07T18:16:09.940761+0000","last_unstale":"2023-07-07T18:16:11.350784+0000","last_undegraded":"2023-07-07T18:16:11.350784+0000","last_fullsized":"2023-07-07T18:16:11.350784+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T05:39:33.417838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349389+0000","last_change":"2023-07-07T18:14:41.010006+0000","last_active":"2023-07-07T18:16:11.349389+0000","last_peered":"2023-07-07T18:16:11.349389+0000","last_clean":"2023-07-07T18:16:11.349389+0000","last_became_active":"2023-07-07T18:14:41.009625+0000","last_became_peered":"2023-07-07T18:14:41.009625+0000","last_unstale":"2023-07-07T18:16:11.349389+0000","last_undegraded":"2023-07-07T18:16:11.349389+0000","last_fullsized":"2023-07-07T18:16:11.349389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:33:57.239051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.377943+0000","last_change":"2023-07-07T18:16:10.373962+0000","last_active":"2023-07-07T18:16:10.377943+0000","last_peered":"2023-07-07T18:16:10.377943+0000","last_clean":"2023-07-07T18:16:10.377943+0000","last_became_active":"2023-07-07T18:16:10.373485+0000","last_became_peered":"2023-07-07T18:16:10.373485+0000","last_unstale":"2023-07-07T18:16:10.377943+0000","last_undegraded":"2023-07-07T18:16:10.377943+0000","last_fullsized":"2023-07-07T18:16:10.377943+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:51:05.464464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.358733+0000","last_change":"2023-07-07T18:16:09.943683+0000","last_active":"2023-07-07T18:16:10.358733+0000","last_peered":"2023-07-07T18:16:10.358733+0000","last_clean":"2023-07-07T18:16:10.358733+0000","last_became_active":"2023-07-07T18:16:09.943332+0000","last_became_peered":"2023-07-07T18:16:09.943332+0000","last_unstale":"2023-07-07T18:16:10.358733+0000","last_undegraded":"2023-07-07T18:16:10.358733+0000","last_fullsized":"2023-07-07T18:16:10.358733+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:51:02.877897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.349116+0000","last_change":"2023-07-07T18:14:40.652460+0000","last_active":"2023-07-07T18:16:10.349116+0000","last_peered":"2023-07-07T18:16:10.349116+0000","last_clean":"2023-07-07T18:16:10.349116+0000","last_became_active":"2023-07-07T18:14:40.652046+0000","last_became_peered":"2023-07-07T18:14:40.652046+0000","last_unstale":"2023-07-07T18:16:10.349116+0000","last_undegraded":"2023-07-07T18:16:10.349116+0000","last_fullsized":"2023-07-07T18:16:10.349116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:00:17.314876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.350981+0000","last_change":"2023-07-07T18:16:10.372171+0000","last_active":"2023-07-07T18:16:11.350981+0000","last_peered":"2023-07-07T18:16:11.350981+0000","last_clean":"2023-07-07T18:16:11.350981+0000","last_became_active":"2023-07-07T18:16:10.371922+0000","last_became_peered":"2023-07-07T18:16:10.371922+0000","last_unstale":"2023-07-07T18:16:11.350981+0000","last_undegraded":"2023-07-07T18:16:11.350981+0000","last_fullsized":"2023-07-07T18:16:11.350981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:40:47.286002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224840+0000","last_change":"2023-07-07T18:16:09.940890+0000","last_active":"2023-07-07T18:16:12.224840+0000","last_peered":"2023-07-07T18:16:12.224840+0000","last_clean":"2023-07-07T18:16:12.224840+0000","last_became_active":"2023-07-07T18:16:09.940496+0000","last_became_peered":"2023-07-07T18:16:09.940496+0000","last_unstale":"2023-07-07T18:16:12.224840+0000","last_undegraded":"2023-07-07T18:16:12.224840+0000","last_fullsized":"2023-07-07T18:16:12.224840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T06:10:11.441122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349247+0000","last_change":"2023-07-07T18:14:41.009938+0000","last_active":"2023-07-07T18:16:11.349247+0000","last_peered":"2023-07-07T18:16:11.349247+0000","last_clean":"2023-07-07T18:16:11.349247+0000","last_became_active":"2023-07-07T18:14:41.009637+0000","last_became_peered":"2023-07-07T18:14:41.009637+0000","last_unstale":"2023-07-07T18:16:11.349247+0000","last_undegraded":"2023-07-07T18:16:11.349247+0000","last_fullsized":"2023-07-07T18:16:11.349247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:15:12.172389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.351321+0000","last_change":"2023-07-07T18:16:10.366323+0000","last_active":"2023-07-07T18:16:11.351321+0000","last_peered":"2023-07-07T18:16:11.351321+0000","last_clean":"2023-07-07T18:16:11.351321+0000","last_became_active":"2023-07-07T18:16:10.366070+0000","last_became_peered":"2023-07-07T18:16:10.366070+0000","last_unstale":"2023-07-07T18:16:11.351321+0000","last_undegraded":"2023-07-07T18:16:11.351321+0000","last_fullsized":"2023-07-07T18:16:11.351321+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:16:27.676068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.357616+0000","last_change":"2023-07-07T18:16:09.940003+0000","last_active":"2023-07-07T18:16:10.357616+0000","last_peered":"2023-07-07T18:16:10.357616+0000","last_clean":"2023-07-07T18:16:10.357616+0000","last_became_active":"2023-07-07T18:16:09.939626+0000","last_became_peered":"2023-07-07T18:16:09.939626+0000","last_unstale":"2023-07-07T18:16:10.357616+0000","last_undegraded":"2023-07-07T18:16:10.357616+0000","last_fullsized":"2023-07-07T18:16:10.357616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:16:26.671275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.349982+0000","last_change":"2023-07-07T18:14:40.652887+0000","last_active":"2023-07-07T18:16:10.349982+0000","last_peered":"2023-07-07T18:16:10.349982+0000","last_clean":"2023-07-07T18:16:10.349982+0000","last_became_active":"2023-07-07T18:14:40.652550+0000","last_became_peered":"2023-07-07T18:14:40.652550+0000","last_unstale":"2023-07-07T18:16:10.349982+0000","last_undegraded":"2023-07-07T18:16:10.349982+0000","last_fullsized":"2023-07-07T18:16:10.349982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:55:40.595935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":211,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224409+0000","last_change":"2023-07-07T18:14:34.464008+0000","last_active":"2023-07-07T18:16:12.224409+0000","last_peered":"2023-07-07T18:16:12.224409+0000","last_clean":"2023-07-07T18:16:12.224409+0000","last_became_active":"2023-07-07T18:14:34.463018+0000","last_became_peered":"2023-07-07T18:14:34.463018+0000","last_unstale":"2023-07-07T18:16:12.224409+0000","last_undegraded":"2023-07-07T18:16:12.224409+0000","last_fullsized":"2023-07-07T18:16:12.224409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:33.057285+0000","last_clean_scrub_stamp":"2023-07-07T18:14:33.057285+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:16:15.025650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224649+0000","last_change":"2023-07-07T18:16:10.365373+0000","last_active":"2023-07-07T18:16:12.224649+0000","last_peered":"2023-07-07T18:16:12.224649+0000","last_clean":"2023-07-07T18:16:12.224649+0000","last_became_active":"2023-07-07T18:16:10.365090+0000","last_became_peered":"2023-07-07T18:16:10.365090+0000","last_unstale":"2023-07-07T18:16:12.224649+0000","last_undegraded":"2023-07-07T18:16:12.224649+0000","last_fullsized":"2023-07-07T18:16:12.224649+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:15:29.435943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349844+0000","last_change":"2023-07-07T18:16:09.933038+0000","last_active":"2023-07-07T18:16:11.349844+0000","last_peered":"2023-07-07T18:16:11.349844+0000","last_clean":"2023-07-07T18:16:11.349844+0000","last_became_active":"2023-07-07T18:16:09.932745+0000","last_became_peered":"2023-07-07T18:16:09.932745+0000","last_unstale":"2023-07-07T18:16:11.349844+0000","last_undegraded":"2023-07-07T18:16:11.349844+0000","last_fullsized":"2023-07-07T18:16:11.349844+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T04:12:23.071069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224453+0000","last_change":"2023-07-07T18:14:40.649525+0000","last_active":"2023-07-07T18:16:12.224453+0000","last_peered":"2023-07-07T18:16:12.224453+0000","last_clean":"2023-07-07T18:16:12.224453+0000","last_became_active":"2023-07-07T18:14:40.649168+0000","last_became_peered":"2023-07-07T18:14:40.649168+0000","last_unstale":"2023-07-07T18:16:12.224453+0000","last_undegraded":"2023-07-07T18:16:12.224453+0000","last_fullsized":"2023-07-07T18:16:12.224453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T19:10:19.829000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.369229+0000","last_change":"2023-07-07T18:16:10.358139+0000","last_active":"2023-07-07T18:16:10.369229+0000","last_peered":"2023-07-07T18:16:10.369229+0000","last_clean":"2023-07-07T18:16:10.369229+0000","last_became_active":"2023-07-07T18:16:10.357831+0000","last_became_peered":"2023-07-07T18:16:10.357831+0000","last_unstale":"2023-07-07T18:16:10.369229+0000","last_undegraded":"2023-07-07T18:16:10.369229+0000","last_fullsized":"2023-07-07T18:16:10.369229+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T22:48:18.641817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349220+0000","last_change":"2023-07-07T18:16:09.935501+0000","last_active":"2023-07-07T18:16:11.349220+0000","last_peered":"2023-07-07T18:16:11.349220+0000","last_clean":"2023-07-07T18:16:11.349220+0000","last_became_active":"2023-07-07T18:16:09.935196+0000","last_became_peered":"2023-07-07T18:16:09.935196+0000","last_unstale":"2023-07-07T18:16:11.349220+0000","last_undegraded":"2023-07-07T18:16:11.349220+0000","last_fullsized":"2023-07-07T18:16:11.349220+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:14:16.531592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.224926+0000","last_change":"2023-07-07T18:14:41.009946+0000","last_active":"2023-07-07T18:16:12.224926+0000","last_peered":"2023-07-07T18:16:12.224926+0000","last_clean":"2023-07-07T18:16:12.224926+0000","last_became_active":"2023-07-07T18:14:41.009627+0000","last_became_peered":"2023-07-07T18:14:41.009627+0000","last_unstale":"2023-07-07T18:16:12.224926+0000","last_undegraded":"2023-07-07T18:16:12.224926+0000","last_fullsized":"2023-07-07T18:16:12.224926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T01:04:08.884714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.372797+0000","last_change":"2023-07-07T18:16:10.366085+0000","last_active":"2023-07-07T18:16:10.372797+0000","last_peered":"2023-07-07T18:16:10.372797+0000","last_clean":"2023-07-07T18:16:10.372797+0000","last_became_active":"2023-07-07T18:16:10.365829+0000","last_became_peered":"2023-07-07T18:16:10.365829+0000","last_unstale":"2023-07-07T18:16:10.372797+0000","last_undegraded":"2023-07-07T18:16:10.372797+0000","last_fullsized":"2023-07-07T18:16:10.372797+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T18:40:34.055166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.353348+0000","last_change":"2023-07-07T18:16:09.938880+0000","last_active":"2023-07-07T18:16:10.353348+0000","last_peered":"2023-07-07T18:16:10.353348+0000","last_clean":"2023-07-07T18:16:10.353348+0000","last_became_active":"2023-07-07T18:16:09.938514+0000","last_became_peered":"2023-07-07T18:16:09.938514+0000","last_unstale":"2023-07-07T18:16:10.353348+0000","last_undegraded":"2023-07-07T18:16:10.353348+0000","last_fullsized":"2023-07-07T18:16:10.353348+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T03:00:57.060559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:11.349743+0000","last_change":"2023-07-07T18:14:40.651911+0000","last_active":"2023-07-07T18:16:11.349743+0000","last_peered":"2023-07-07T18:16:11.349743+0000","last_clean":"2023-07-07T18:16:11.349743+0000","last_became_active":"2023-07-07T18:14:40.651592+0000","last_became_peered":"2023-07-07T18:14:40.651592+0000","last_unstale":"2023-07-07T18:16:11.349743+0000","last_undegraded":"2023-07-07T18:16:11.349743+0000","last_fullsized":"2023-07-07T18:16:11.349743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T20:08:21.099498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.378866+0000","last_change":"2023-07-07T18:16:10.376629+0000","last_active":"2023-07-07T18:16:10.378866+0000","last_peered":"2023-07-07T18:16:10.378866+0000","last_clean":"2023-07-07T18:16:10.378866+0000","last_became_active":"2023-07-07T18:16:10.376360+0000","last_became_peered":"2023-07-07T18:16:10.376360+0000","last_unstale":"2023-07-07T18:16:10.378866+0000","last_undegraded":"2023-07-07T18:16:10.378866+0000","last_fullsized":"2023-07-07T18:16:10.378866+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:09.913882+0000","last_clean_scrub_stamp":"2023-07-07T18:16:09.913882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-09T02:01:13.197327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-07-07T18:16:12.225172+0000","last_change":"2023-07-07T18:16:09.938121+0000","last_active":"2023-07-07T18:16:12.225172+0000","last_peered":"2023-07-07T18:16:12.225172+0000","last_clean":"2023-07-07T18:16:12.225172+0000","last_became_active":"2023-07-07T18:16:09.937834+0000","last_became_peered":"2023-07-07T18:16:09.937834+0000","last_unstale":"2023-07-07T18:16:12.225172+0000","last_undegraded":"2023-07-07T18:16:12.225172+0000","last_fullsized":"2023-07-07T18:16:12.225172+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:16:08.909089+0000","last_clean_scrub_stamp":"2023-07-07T18:16:08.909089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T23:30:34.397174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-07T18:16:10.359097+0000","last_change":"2023-07-07T18:14:40.653854+0000","last_active":"2023-07-07T18:16:10.359097+0000","last_peered":"2023-07-07T18:16:10.359097+0000","last_clean":"2023-07-07T18:16:10.359097+0000","last_became_active":"2023-07-07T18:14:40.653556+0000","last_became_peered":"2023-07-07T18:14:40.653556+0000","last_unstale":"2023-07-07T18:16:10.359097+0000","last_undegraded":"2023-07-07T18:16:10.359097+0000","last_fullsized":"2023-07-07T18:16:10.359097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T18:14:39.639593+0000","last_clean_scrub_stamp":"2023-07-07T18:14:39.639593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T21:32:42.114314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1093632,"data_stored":809725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.0620000000000003,"5min":5.0620000000000003,"15min":5.0620000000000003},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.3339999999999996,"5min":5.3339999999999996,"15min":5.3339999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":5.0940000000000003,"5min":5.0940000000000003,"15min":5.0940000000000003},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":5.1600000000000001,"5min":5.1600000000000001,"15min":5.1600000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.38}]},{"osd":3,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":5.4340000000000002,"5min":5.4340000000000002,"15min":5.4340000000000002},"last":0.501},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":5.2670000000000003,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.435}]},{"osd":4,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45600000000000002}]},{"osd":6,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60599999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542168,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":219939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.441},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":7.8470000000000004,"5min":7.8470000000000004,"15min":7.8470000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":7.9530000000000003,"5min":7.9530000000000003,"15min":7.9530000000000003},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.504}]},{"osd":3,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.8159999999999998,"5min":3.8159999999999998,"15min":3.8159999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40000000000000002}]},{"osd":5,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47299999999999998}]},{"osd":7,"last update":"Fri Jul 7 18:15:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":226310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.32500000000000001}]},{"osd":4,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.629}]},{"osd":6,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.72999999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542167,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1101824,"data_stored":815973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.312},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.36599999999999999}]},{"osd":3,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.35299999999999998}]},{"osd":4,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.497},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.48599999999999999}]},{"osd":6,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Jul 7 18:15:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542167,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":524288,"data_stored":227826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":10.867000000000001,"5min":10.867000000000001,"15min":10.867000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":8.202,"5min":8.202,"15min":8.202},"last":0.26200000000000001}]},{"osd":1,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":11.016,"5min":11.016,"15min":11.016},"last":0.36799999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":10.898,"5min":10.898,"15min":10.898},"last":0.29799999999999999}]},{"osd":3,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":8.1750000000000007,"5min":8.1750000000000007,"15min":8.1750000000000007},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":7.0300000000000002,"5min":7.0300000000000002,"15min":7.0300000000000002},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":10.840999999999999,"5min":10.840999999999999,"15min":10.840999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":11.869999999999999,"5min":11.869999999999999,"15min":11.869999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":10.987,"5min":10.987,"15min":10.987},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":10.808999999999999,"5min":10.808999999999999,"15min":10.808999999999999},"last":0.746}]},{"osd":6,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":11.84,"5min":11.84,"15min":11.84},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":10.961,"5min":10.961,"15min":10.961},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.933999999999999,"5min":10.933999999999999,"15min":10.933999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":11.803000000000001,"5min":11.803000000000001,"15min":11.803000000000001},"last":0.64200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542167,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":219905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.26900000000000002}]},{"osd":1,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.314},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.25600000000000001}]},{"osd":2,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.375}]},{"osd":4,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.748},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.628}]},{"osd":6,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 7 18:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64400000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":220831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.5}]},{"osd":1,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.46800000000000003}]},{"osd":5,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.442},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.40500000000000003}]},{"osd":6,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.47899999999999998}]},{"osd":7,"last update":"Fri Jul 7 18:15:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52500000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":499712,"data_stored":219337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.754},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 7 18:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Jul 7 18:15:35 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T18:16:14.879 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-07T18:16:14.879 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-07T18:16:15.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.043+0000 7facc0737700 1 Processor -- start 2023-07-07T18:16:15.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.044+0000 7facc0737700 1 -- start start 2023-07-07T18:16:15.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.044+0000 7facc0737700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7facb80aecc0 0x7facb806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facc0737700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7facb806e970 0x7facb80ac600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facc0737700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb80ce620 con 0x7facb815fc60 2023-07-07T18:16:15.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facc0737700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb8160580 con 0x7facb80aecc0 2023-07-07T18:16:15.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facc0737700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb8160860 con 0x7facb806e970 2023-07-07T18:16:15.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbdcd2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7facb80aecc0 0x7facb806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbe4d3700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7facb815fc60 0x7facb806e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56716/0 (socket says 172.21.15.12:56716) 2023-07-07T18:16:15.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbdcd2700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7facb80aecc0 0x7facb806a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59520/0 (socket says 172.21.15.12:59520) 2023-07-07T18:16:15.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbe4d3700 1 -- 172.21.15.12:0/3038026040 learned_addr learned my addr 172.21.15.12:0/3038026040 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:15.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbecd4700 1 --2- 172.21.15.12:0/3038026040 >> v2:172.21.15.160:3300/0 conn(0x7facb806e970 0x7facb80ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbdcd2700 1 -- 172.21.15.12:0/3038026040 >> v2:172.21.15.160:3300/0 conn(0x7facb806e970 msgr2=0x7facb80ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:15.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbdcd2700 1 --2- 172.21.15.12:0/3038026040 >> v2:172.21.15.160:3300/0 conn(0x7facb806e970 0x7facb80ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbdcd2700 1 -- 172.21.15.12:0/3038026040 >> v1:172.21.15.12:6789/0 conn(0x7facb815fc60 legacy=0x7facb806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbdcd2700 1 -- 172.21.15.12:0/3038026040 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8160b40 con 0x7facb80aecc0 2023-07-07T18:16:15.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbd4d1700 1 -- 172.21.15.12:0/3038026040 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667958883 0 0) 0x7facb80ce620 con 0x7facb815fc60 2023-07-07T18:16:15.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbecd4700 1 --2- 172.21.15.12:0/3038026040 >> v2:172.21.15.160:3300/0 conn(0x7facb806e970 0x7facb80ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:15.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbdcd2700 1 --2- 172.21.15.12:0/3038026040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb80aecc0 0x7facb806a900 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7facb80c34f0 tx=0x7facac009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bb199a5a313938 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:15.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbd4d1700 1 -- 172.21.15.12:0/3038026040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011830 con 0x7facb80aecc0 2023-07-07T18:16:15.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbd4d1700 1 -- 172.21.15.12:0/3038026040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac011990 con 0x7facb80aecc0 2023-07-07T18:16:15.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.045+0000 7facbd4d1700 1 -- 172.21.15.12:0/3038026040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011d20 con 0x7facb80aecc0 2023-07-07T18:16:15.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.046+0000 7facc0737700 1 -- 172.21.15.12:0/3038026040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb80aecc0 msgr2=0x7facb806a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.046+0000 7facc0737700 1 --2- 172.21.15.12:0/3038026040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb80aecc0 0x7facb806a900 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7facb80c34f0 tx=0x7facac009b20 comp rx=0 tx=0).stop 2023-07-07T18:16:15.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.046+0000 7facc0737700 1 -- 172.21.15.12:0/3038026040 shutdown_connections 2023-07-07T18:16:15.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.046+0000 7facc0737700 1 --2- 172.21.15.12:0/3038026040 >> v2:172.21.15.160:3300/0 conn(0x7facb806e970 0x7facb80ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.046+0000 7facc0737700 1 --2- 172.21.15.12:0/3038026040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb80aecc0 0x7facb806a900 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.046+0000 7facc0737700 1 -- 172.21.15.12:0/3038026040 >> 172.21.15.12:0/3038026040 conn(0x7facb806b920 msgr2=0x7facb80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:15.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.046+0000 7facc0737700 1 -- 172.21.15.12:0/3038026040 shutdown_connections 2023-07-07T18:16:15.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.046+0000 7facc0737700 1 -- 172.21.15.12:0/3038026040 wait complete. 2023-07-07T18:16:15.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.047+0000 7facc0737700 1 Processor -- start 2023-07-07T18:16:15.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.047+0000 7facc0737700 1 -- start start 2023-07-07T18:16:15.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facc0737700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb806e970 0x7facb815ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facc0737700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7facb80aecc0 0x7facb80b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facc0737700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facb815fc60 0x7facb80b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facc0737700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb80b3c30 con 0x7facb806e970 2023-07-07T18:16:15.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facc0737700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb80b2d80 con 0x7facb80aecc0 2023-07-07T18:16:15.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facc0737700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb80b2fb0 con 0x7facb815fc60 2023-07-07T18:16:15.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facbe4d3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb806e970 0x7facb815ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facbe4d3700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb806e970 0x7facb815ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59524/0 (socket says 172.21.15.12:59524) 2023-07-07T18:16:15.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facbe4d3700 1 -- 172.21.15.12:0/3128928932 learned_addr learned my addr 172.21.15.12:0/3128928932 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:15.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facbe4d3700 1 -- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facb815fc60 msgr2=0x7facb80b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facbe4d3700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facb815fc60 0x7facb80b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facbe4d3700 1 -- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7facb80aecc0 msgr2=0x7facb80b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facbe4d3700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7facb80aecc0 0x7facb80b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.048+0000 7facbe4d3700 1 -- 172.21.15.12:0/3128928932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0094a0 con 0x7facb806e970 2023-07-07T18:16:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.049+0000 7facbe4d3700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb806e970 0x7facb815ca20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7facb400c4a0 tx=0x7facb400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.049+0000 7facaaffd700 1 -- 172.21.15.12:0/3128928932 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40074e0 con 0x7facb806e970 2023-07-07T18:16:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.049+0000 7facaaffd700 1 -- 172.21.15.12:0/3128928932 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb4007640 con 0x7facb806e970 2023-07-07T18:16:15.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.049+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb80b3290 con 0x7facb806e970 2023-07-07T18:16:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.049+0000 7facaaffd700 1 -- 172.21.15.12:0/3128928932 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4005a70 con 0x7facb806e970 2023-07-07T18:16:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.049+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb80b3850 con 0x7facb806e970 2023-07-07T18:16:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.050+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb80b3d70 con 0x7facb806e970 2023-07-07T18:16:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.050+0000 7facaaffd700 1 -- 172.21.15.12:0/3128928932 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7facb4005bd0 con 0x7facb806e970 2023-07-07T18:16:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.051+0000 7facaaffd700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac9c06ace0 0x7fac9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.051+0000 7facaaffd700 1 -- 172.21.15.12:0/3128928932 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7facb4088a80 con 0x7facb806e970 2023-07-07T18:16:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.051+0000 7facbdcd2700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac9c06ace0 0x7fac9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.051+0000 7facbdcd2700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac9c06ace0 0x7fac9c06d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facb806bda0 tx=0x7facac010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:15.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.055+0000 7facaaffd700 1 -- 172.21.15.12:0/3128928932 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7facb80b3d70 con 0x7facb806e970 2023-07-07T18:16:15.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.335+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7facb80b3d70 con 0x7facb806e970 2023-07-07T18:16:15.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.338+0000 7facaaffd700 1 -- 172.21.15.12:0/3128928932 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7facb80b3d70 con 0x7facb806e970 2023-07-07T18:16:15.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac9c06ace0 msgr2=0x7fac9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac9c06ace0 0x7fac9c06d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facb806bda0 tx=0x7facac010000 comp rx=0 tx=0).stop 2023-07-07T18:16:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb806e970 msgr2=0x7facb815ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb806e970 0x7facb815ca20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7facb400c4a0 tx=0x7facb400c860 comp rx=0 tx=0).stop 2023-07-07T18:16:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 shutdown_connections 2023-07-07T18:16:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac9c06ace0 0x7fac9c06d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7facb815fc60 0x7facb80b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facb806e970 0x7facb815ca20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 --2- 172.21.15.12:0/3128928932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7facb80aecc0 0x7facb80b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.340+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 >> 172.21.15.12:0/3128928932 conn(0x7facb806b920 msgr2=0x7facb815d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:15.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.341+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 shutdown_connections 2023-07-07T18:16:15.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.341+0000 7facc0737700 1 -- 172.21.15.12:0/3128928932 wait complete. 2023-07-07T18:16:15.343 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-07-07T18:16:15.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T18:16:15.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.477+0000 7fae1defe700 1 Processor -- start 2023-07-07T18:16:15.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.477+0000 7fae1defe700 1 -- start start 2023-07-07T18:16:15.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae1defe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae1806ccc0 0x7fae1815fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae1defe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 0x7fae180d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae1defe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae180afdb0 con 0x7fae1815c2e0 2023-07-07T18:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae1defe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae180ceb90 con 0x7fae1806ccc0 2023-07-07T18:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae1defe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1815c6b0 con 0x7fae18160340 2023-07-07T18:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae16ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae1806ccc0 0x7fae1815fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae177fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae1815c2e0 0x7fae180ce480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56730/0 (socket says 172.21.15.12:56730) 2023-07-07T18:16:15.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae16ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae1806ccc0 0x7fae1815fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59534/0 (socket says 172.21.15.12:59534) 2023-07-07T18:16:15.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae177fe700 1 -- 172.21.15.12:0/1438547221 learned_addr learned my addr 172.21.15.12:0/1438547221 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:15.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.478+0000 7fae17fff700 1 --2- 172.21.15.12:0/1438547221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 0x7fae180d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae16ffd700 1 -- 172.21.15.12:0/1438547221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 msgr2=0x7fae180d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:15.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae16ffd700 1 --2- 172.21.15.12:0/1438547221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 0x7fae180d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae16ffd700 1 -- 172.21.15.12:0/1438547221 >> v1:172.21.15.12:6789/0 conn(0x7fae1815c2e0 legacy=0x7fae180ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae16ffd700 1 -- 172.21.15.12:0/1438547221 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180b0000 con 0x7fae1806ccc0 2023-07-07T18:16:15.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae17fff700 1 --2- 172.21.15.12:0/1438547221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 0x7fae180d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:16:15.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae16ffd700 1 --2- 172.21.15.12:0/1438547221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 0x7fae1815fe00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fae00009840 tx=0x7fae00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfed2875164548a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:15.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae167fc700 1 -- 172.21.15.12:0/1438547221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00011830 con 0x7fae1806ccc0 2023-07-07T18:16:15.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae167fc700 1 -- 172.21.15.12:0/1438547221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00011990 con 0x7fae1806ccc0 2023-07-07T18:16:15.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae167fc700 1 -- 172.21.15.12:0/1438547221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00011d20 con 0x7fae1806ccc0 2023-07-07T18:16:15.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae1defe700 1 -- 172.21.15.12:0/1438547221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 msgr2=0x7fae1815fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.479+0000 7fae1defe700 1 --2- 172.21.15.12:0/1438547221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 0x7fae1815fe00 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fae00009840 tx=0x7fae00009b50 comp rx=0 tx=0).stop 2023-07-07T18:16:15.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.480+0000 7fae1defe700 1 -- 172.21.15.12:0/1438547221 shutdown_connections 2023-07-07T18:16:15.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.480+0000 7fae1defe700 1 --2- 172.21.15.12:0/1438547221 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 0x7fae180d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.480+0000 7fae1defe700 1 --2- 172.21.15.12:0/1438547221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 0x7fae1815fe00 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.480+0000 7fae1defe700 1 -- 172.21.15.12:0/1438547221 >> 172.21.15.12:0/1438547221 conn(0x7fae1806e530 msgr2=0x7fae1806e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:15.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.480+0000 7fae1defe700 1 -- 172.21.15.12:0/1438547221 shutdown_connections 2023-07-07T18:16:15.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.480+0000 7fae1defe700 1 -- 172.21.15.12:0/1438547221 wait complete. 2023-07-07T18:16:15.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.481+0000 7fae1defe700 1 Processor -- start 2023-07-07T18:16:15.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.481+0000 7fae1defe700 1 -- start start 2023-07-07T18:16:15.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae1defe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 0x7fae18151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae1defe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1815c2e0 0x7fae180b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae1defe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 0x7fae180c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae1defe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180c6f20 con 0x7fae1806ccc0 2023-07-07T18:16:15.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae1defe700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae181f33f0 con 0x7fae1815c2e0 2023-07-07T18:16:15.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae1defe700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae181f3110 con 0x7fae18160340 2023-07-07T18:16:15.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 0x7fae18151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae177fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 0x7fae18151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59538/0 (socket says 172.21.15.12:59538) 2023-07-07T18:16:15.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae177fe700 1 -- 172.21.15.12:0/1944039704 learned_addr learned my addr 172.21.15.12:0/1944039704 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:15.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae16ffd700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1815c2e0 0x7fae180b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae17fff700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 0x7fae180c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae177fe700 1 -- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 msgr2=0x7fae180c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae177fe700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 0x7fae180c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae177fe700 1 -- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1815c2e0 msgr2=0x7fae180b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae177fe700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1815c2e0 0x7fae180b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae177fe700 1 -- 172.21.15.12:0/1944039704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae000094a0 con 0x7fae1806ccc0 2023-07-07T18:16:15.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae177fe700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 0x7fae18151c30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fae0800c520 tx=0x7fae0800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:15.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.482+0000 7fae0ffff700 1 -- 172.21.15.12:0/1944039704 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08005d70 con 0x7fae1806ccc0 2023-07-07T18:16:15.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.483+0000 7fae0ffff700 1 -- 172.21.15.12:0/1944039704 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae080070d0 con 0x7fae1806ccc0 2023-07-07T18:16:15.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.483+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae180b2450 con 0x7fae1806ccc0 2023-07-07T18:16:15.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.483+0000 7fae0ffff700 1 -- 172.21.15.12:0/1944039704 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08007440 con 0x7fae1806ccc0 2023-07-07T18:16:15.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.483+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae181e6ab0 con 0x7fae1806ccc0 2023-07-07T18:16:15.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.483+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae180b2970 con 0x7fae1806ccc0 2023-07-07T18:16:15.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.484+0000 7fae0ffff700 1 -- 172.21.15.12:0/1944039704 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae080075a0 con 0x7fae1806ccc0 2023-07-07T18:16:15.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.484+0000 7fae0ffff700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fadf806ace0 0x7fadf806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:15.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.484+0000 7fae0ffff700 1 -- 172.21.15.12:0/1944039704 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fae080889a0 con 0x7fae1806ccc0 2023-07-07T18:16:15.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.485+0000 7fae16ffd700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fadf806ace0 0x7fadf806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:15.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.485+0000 7fae16ffd700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fadf806ace0 0x7fadf806d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fae000090b0 tx=0x7fae00008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:15.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.489+0000 7fae0ffff700 1 -- 172.21.15.12:0/1944039704 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fae180b2970 con 0x7fae1806ccc0 2023-07-07T18:16:15.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.730+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae180b2970 con 0x7fae1806ccc0 2023-07-07T18:16:15.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.730+0000 7fae0ffff700 1 -- 172.21.15.12:0/1944039704 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4677 (secure 0 0 0) 0x7fae180b2970 con 0x7fae1806ccc0 2023-07-07T18:16:15.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:15.732 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4940,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3149524046","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3149524046},{"type":"v1","addr":"172.21.15.160:6836","nonce":3149524046}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4943,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/4237530545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":4237530545},{"type":"v1","addr":"172.21.15.160:6837","nonce":4237530545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/2202914234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2202914234},{"type":"v1","addr":"172.21.15.12:6834","nonce":2202914234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-07T18:16:10.341699+0000","modified":"2023-07-07T18:16:13.349164+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5421},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5421":{"gid":5421,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.12:6835/2736425727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2736425727},{"type":"v1","addr":"172.21.15.12:6835","nonce":2736425727}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-07T18:16:15.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.732+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fadf806ace0 msgr2=0x7fadf806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.732+0000 7fae1defe700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fadf806ace0 0x7fadf806d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fae000090b0 tx=0x7fae00008030 comp rx=0 tx=0).stop 2023-07-07T18:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.732+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 msgr2=0x7fae18151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.732+0000 7fae1defe700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 0x7fae18151c30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fae0800c520 tx=0x7fae0800c8e0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.732+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 shutdown_connections 2023-07-07T18:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.732+0000 7fae1defe700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fadf806ace0 0x7fadf806d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.732+0000 7fae1defe700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae18160340 0x7fae180c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.732+0000 7fae1defe700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1806ccc0 0x7fae18151c30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.732+0000 7fae1defe700 1 --2- 172.21.15.12:0/1944039704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae1815c2e0 0x7fae180b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.733+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 >> 172.21.15.12:0/1944039704 conn(0x7fae1806e530 msgr2=0x7fae180d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.733+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 shutdown_connections 2023-07-07T18:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:15.733+0000 7fae1defe700 1 -- 172.21.15.12:0/1944039704 wait complete. 2023-07-07T18:16:15.735 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 16 2023-07-07T18:16:16.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-07T18:16:10.341699+0000', 'modified': '2023-07-07T18:16:13.349164+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5421}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5421': {'gid': 5421, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.12:6835/2736425727', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6833', 'nonce': 2736425727}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 2736425727}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-07T18:16:16.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-07T18:16:16.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-07T18:16:16.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.282+0000 7fd71c09b700 1 Processor -- start 2023-07-07T18:16:16.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.282+0000 7fd71c09b700 1 -- start start 2023-07-07T18:16:16.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.283+0000 7fd71c09b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd714159080 0x7fd7140cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.283+0000 7fd71c09b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd7140ae6d0 0x7fd7140cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.283+0000 7fd71c09b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7140c9df0 con 0x7fd7140d03e0 2023-07-07T18:16:16.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.283+0000 7fd71c09b700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7140cddf0 con 0x7fd714159080 2023-07-07T18:16:16.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.283+0000 7fd71c09b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7140ca3b0 con 0x7fd7140ae6d0 2023-07-07T18:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.283+0000 7fd719e37700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd714159080 0x7fd7140cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.283+0000 7fd719e37700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd714159080 0x7fd7140cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59546/0 (socket says 172.21.15.12:59546) 2023-07-07T18:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.283+0000 7fd719e37700 1 -- 172.21.15.12:0/3870894186 learned_addr learned my addr 172.21.15.12:0/3870894186 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.284+0000 7fd719636700 1 --2- 172.21.15.12:0/3870894186 >> v2:172.21.15.160:3300/0 conn(0x7fd7140ae6d0 0x7fd7140cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.284+0000 7fd719e37700 1 -- 172.21.15.12:0/3870894186 >> v2:172.21.15.160:3300/0 conn(0x7fd7140ae6d0 msgr2=0x7fd7140cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.284+0000 7fd719e37700 1 --2- 172.21.15.12:0/3870894186 >> v2:172.21.15.160:3300/0 conn(0x7fd7140ae6d0 0x7fd7140cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.284+0000 7fd719e37700 1 -- 172.21.15.12:0/3870894186 >> v1:172.21.15.160:6789/0 conn(0x7fd7140d03e0 legacy=0x7fd71415cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.284+0000 7fd719e37700 1 -- 172.21.15.12:0/3870894186 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7140cf560 con 0x7fd714159080 2023-07-07T18:16:16.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.284+0000 7fd719e37700 1 --2- 172.21.15.12:0/3870894186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd714159080 0x7fd7140cd370 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd7140717b0 tx=0x7fd70400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bb6a589999b8b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.284+0000 7fd718e35700 1 -- 172.21.15.12:0/3870894186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70400dc70 con 0x7fd714159080 2023-07-07T18:16:16.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.284+0000 7fd718e35700 1 -- 172.21.15.12:0/3870894186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70400ddd0 con 0x7fd714159080 2023-07-07T18:16:16.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.284+0000 7fd718e35700 1 -- 172.21.15.12:0/3870894186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704010690 con 0x7fd714159080 2023-07-07T18:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.285+0000 7fd71c09b700 1 -- 172.21.15.12:0/3870894186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd714159080 msgr2=0x7fd7140cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.285+0000 7fd71c09b700 1 --2- 172.21.15.12:0/3870894186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd714159080 0x7fd7140cd370 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd7140717b0 tx=0x7fd70400be70 comp rx=0 tx=0).stop 2023-07-07T18:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.285+0000 7fd71c09b700 1 -- 172.21.15.12:0/3870894186 shutdown_connections 2023-07-07T18:16:16.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.285+0000 7fd71c09b700 1 --2- 172.21.15.12:0/3870894186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd714159080 0x7fd7140cd370 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.285+0000 7fd71c09b700 1 --2- 172.21.15.12:0/3870894186 >> v2:172.21.15.160:3300/0 conn(0x7fd7140ae6d0 0x7fd7140cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.285+0000 7fd71c09b700 1 -- 172.21.15.12:0/3870894186 >> 172.21.15.12:0/3870894186 conn(0x7fd71406b920 msgr2=0x7fd7140cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.285+0000 7fd71c09b700 1 -- 172.21.15.12:0/3870894186 shutdown_connections 2023-07-07T18:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.285+0000 7fd71c09b700 1 -- 172.21.15.12:0/3870894186 wait complete. 2023-07-07T18:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.286+0000 7fd71c09b700 1 Processor -- start 2023-07-07T18:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.287+0000 7fd71c09b700 1 -- start start 2023-07-07T18:16:16.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.287+0000 7fd71c09b700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7140ae6d0 0x7fd714151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.287+0000 7fd71c09b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7140d03e0 0x7fd7140b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.287+0000 7fd71c09b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd714159080 0x7fd7140b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.287+0000 7fd71c09b700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd714151d50 con 0x7fd7140d03e0 2023-07-07T18:16:16.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.287+0000 7fd71c09b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140af610 con 0x7fd714159080 2023-07-07T18:16:16.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.287+0000 7fd71c09b700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140af880 con 0x7fd7140ae6d0 2023-07-07T18:16:16.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719636700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7140d03e0 0x7fd7140b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719636700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7140d03e0 0x7fd7140b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59554/0 (socket says 172.21.15.12:59554) 2023-07-07T18:16:16.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719636700 1 -- 172.21.15.12:0/609353496 learned_addr learned my addr 172.21.15.12:0/609353496 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:16.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd71a638700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd714159080 0x7fd7140b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719e37700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7140ae6d0 0x7fd714151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719636700 1 -- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7140ae6d0 msgr2=0x7fd714151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719636700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7140ae6d0 0x7fd714151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719636700 1 -- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd714159080 msgr2=0x7fd7140b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719636700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd714159080 0x7fd7140b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719636700 1 -- 172.21.15.12:0/609353496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70400b7f0 con 0x7fd7140d03e0 2023-07-07T18:16:16.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd719636700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7140d03e0 0x7fd7140b48d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd71000e8a0 tx=0x7fd71000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd70a7fc700 1 -- 172.21.15.12:0/609353496 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710009590 con 0x7fd7140d03e0 2023-07-07T18:16:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd70a7fc700 1 -- 172.21.15.12:0/609353496 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd710013680 con 0x7fd7140d03e0 2023-07-07T18:16:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd71c09b700 1 -- 172.21.15.12:0/609353496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7140afb60 con 0x7fd7140d03e0 2023-07-07T18:16:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd70a7fc700 1 -- 172.21.15.12:0/609353496 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7100139f0 con 0x7fd7140d03e0 2023-07-07T18:16:16.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.288+0000 7fd71c09b700 1 -- 172.21.15.12:0/609353496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7140b5470 con 0x7fd7140d03e0 2023-07-07T18:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.290+0000 7fd70a7fc700 1 -- 172.21.15.12:0/609353496 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd710013b50 con 0x7fd7140d03e0 2023-07-07T18:16:16.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.290+0000 7fd70a7fc700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6f806ace0 0x7fd6f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.290+0000 7fd70a7fc700 1 -- 172.21.15.12:0/609353496 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd710089350 con 0x7fd7140d03e0 2023-07-07T18:16:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.291+0000 7fd719e37700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6f806ace0 0x7fd6f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.291+0000 7fd719e37700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6f806ace0 0x7fd6f806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd70400beb0 tx=0x7fd704013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.292+0000 7fd728220b80 1 Processor -- start 2023-07-07T18:16:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.292+0000 7fd728220b80 1 -- start start 2023-07-07T18:16:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd728220b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcec640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd728220b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fce9740 0x555d5fd129c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd728220b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fd12f00 0x555d5fd161a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd728220b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5fbf0c60 con 0x555d5fcec270 2023-07-07T18:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd728220b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5fc439f0 con 0x555d5fce9740 2023-07-07T18:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd728220b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d5fc3ce80 con 0x555d5fd12f00 2023-07-07T18:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719e37700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719e37700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcec640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59560/0 (socket says 172.21.15.12:59560) 2023-07-07T18:16:16.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719e37700 1 -- 172.21.15.12:0/2066831463 learned_addr learned my addr 172.21.15.12:0/2066831463 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd71a638700 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fd12f00 0x555d5fd161a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719636700 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fce9740 0x555d5fd129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719e37700 1 -- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fd12f00 msgr2=0x555d5fd161a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719e37700 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fd12f00 0x555d5fd161a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719e37700 1 -- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fce9740 msgr2=0x555d5fd129c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719e37700 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fce9740 0x555d5fd129c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719e37700 1 -- 172.21.15.12:0/2066831463 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d5fabe5e0 con 0x555d5fcec270 2023-07-07T18:16:16.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd719636700 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fce9740 0x555d5fd129c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.293+0000 7fd71a638700 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fd12f00 0x555d5fd161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd719e37700 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcec640 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd70400d5d0 tx=0x7fd704014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca50f687e9bbc66 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd6f77fe700 1 -- 172.21.15.12:0/2066831463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70402c070 con 0x555d5fcec270 2023-07-07T18:16:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd6f77fe700 1 -- 172.21.15.12:0/2066831463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd704020040 con 0x555d5fcec270 2023-07-07T18:16:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd6f77fe700 1 -- 172.21.15.12:0/2066831463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040045e0 con 0x555d5fcec270 2023-07-07T18:16:16.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd728220b80 1 -- 172.21.15.12:0/2066831463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 msgr2=0x555d5fcec640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd728220b80 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcec640 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd70400d5d0 tx=0x7fd704014000 comp rx=0 tx=0).stop 2023-07-07T18:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd728220b80 1 -- 172.21.15.12:0/2066831463 shutdown_connections 2023-07-07T18:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd728220b80 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fd12f00 0x555d5fd161a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd728220b80 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcec640 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd728220b80 1 --2- 172.21.15.12:0/2066831463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fce9740 0x555d5fd129c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.294+0000 7fd728220b80 1 -- 172.21.15.12:0/2066831463 >> 172.21.15.12:0/2066831463 conn(0x555d5fce0fc0 msgr2=0x555d5fd311a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:16.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.295+0000 7fd728220b80 1 -- 172.21.15.12:0/2066831463 shutdown_connections 2023-07-07T18:16:16.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.295+0000 7fd728220b80 1 -- 172.21.15.12:0/2066831463 wait complete. 2023-07-07T18:16:16.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.295+0000 7fd728220b80 1 -- start start 2023-07-07T18:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.295+0000 7fd728220b80 1 Processor -- start 2023-07-07T18:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd728220b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd0ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd728220b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 0x555d5fd10680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd728220b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd0de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd728220b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5fbdca70 con 0x555d5fd12f00 2023-07-07T18:16:16.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd728220b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5fbdc770 con 0x555d5fcec270 2023-07-07T18:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd728220b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d5fac08d0 con 0x555d5fce9740 2023-07-07T18:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd728220b80 10 client.0 _ll_register_callbacks cb 0x555d5fbe2210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-07T18:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd71a638700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd0de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd71a638700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd0de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59570/0 (socket says 172.21.15.12:59570) 2023-07-07T18:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd71a638700 1 -- 172.21.15.12:0/2553072587 learned_addr learned my addr 172.21.15.12:0/2553072587 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd719636700 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 0x555d5fd10680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.296+0000 7fd719e37700 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd0ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd71a638700 1 -- 172.21.15.12:0/2553072587 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 msgr2=0x555d5fd0ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd71a638700 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd0ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd71a638700 1 -- 172.21.15.12:0/2553072587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 msgr2=0x555d5fd10680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd71a638700 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 0x555d5fd10680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd71a638700 1 -- 172.21.15.12:0/2553072587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7140cf560 con 0x555d5fd12f00 2023-07-07T18:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd71a638700 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd0de90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd70c005330 tx=0x7fd70c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccc5ce9469f6bb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd6f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-07-07T18:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/2553072587 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c015680 con 0x555d5fd12f00 2023-07-07T18:16:16.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/2553072587 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd70c0157e0 con 0x555d5fd12f00 2023-07-07T18:16:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd728220b80 1 -- 172.21.15.12:0/2553072587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d5fcde780 con 0x555d5fd12f00 2023-07-07T18:16:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/2553072587 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd70c0159a0 con 0x555d5fd12f00 2023-07-07T18:16:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd728220b80 10 client.5610 fetch_fsmap learned FSMap version 16 2023-07-07T18:16:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd728220b80 1 -- 172.21.15.12:0/2553072587 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x555d5fa6ad90 con 0x555d5fd12f00 2023-07-07T18:16:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/2553072587 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d5fcde780 con 0x555d5fd12f00 2023-07-07T18:16:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/2553072587 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd70c015b00 con 0x555d5fd12f00 2023-07-07T18:16:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd728220b80 10 client.5610 fetch_fsmap finished waiting for FSMap version 16 2023-07-07T18:16:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd728220b80 10 client.5610 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-07T18:16:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd728220b80 20 client.5610 populate_metadata read hostname 'smithi012' 2023-07-07T18:16:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd728220b80 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] conn(0x555d5fcfcd90 0x555d5fcfd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd728220b80 4 client.5610 mds_command: new command op to 5421 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-07T18:16:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.297+0000 7fd728220b80 1 -- 172.21.15.12:0/2553072587 --> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d5fc35e60 con 0x555d5fcfcd90 2023-07-07T18:16:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.298+0000 7fd719e37700 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] conn(0x555d5fcfcd90 0x555d5fcfd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.298+0000 7fd6f4ff9700 10 client.5610 ms_handle_connect on v2:172.21.15.12:6833/2736425727 2023-07-07T18:16:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.298+0000 7fd719e37700 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] conn(0x555d5fcfcd90 0x555d5fcfd160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b86f1286a6993a66 server_cookie=1c5a2ee758126427 in_seq=0 out_seq=0 2023-07-07T18:16:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.298+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/2553072587 <== mds.0 v2:172.21.15.12:6833/2736425727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555d5fc35e60 con 0x555d5fcfcd90 2023-07-07T18:16:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.298+0000 7fd6f4ff9700 10 client.5610 handle_command_reply: tid=0 2023-07-07T18:16:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.298+0000 7fd728220b80 1 client.5610 shutdown 2023-07-07T18:16:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 -- 172.21.15.12:0/2553072587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 msgr2=0x555d5fd0de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd0de90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd70c005330 tx=0x7fd70c003f90 comp rx=0 tx=0).stop 2023-07-07T18:16:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 -- 172.21.15.12:0/2553072587 shutdown_connections 2023-07-07T18:16:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd0de90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] conn(0x555d5fcfcd90 0x555d5fcfd160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd0ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 --2- 172.21.15.12:0/2553072587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 0x555d5fd10680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd6f4ff9700 0 client.5610 ms_handle_reset on v2:172.21.15.12:6833/2736425727 2023-07-07T18:16:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 -- 172.21.15.12:0/2553072587 >> 172.21.15.12:0/2553072587 conn(0x555d5fce0fc0 msgr2=0x555d5fceb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 -- 172.21.15.12:0/2553072587 shutdown_connections 2023-07-07T18:16:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 1 -- 172.21.15.12:0/2553072587 wait complete. 2023-07-07T18:16:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.299+0000 7fd728220b80 20 client.5610 trim_cache size 0 max 16384 2023-07-07T18:16:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd728220b80 1 Processor -- start 2023-07-07T18:16:16.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd728220b80 1 -- start start 2023-07-07T18:16:16.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd728220b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd47a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd728220b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 0x555d5fce87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd728220b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd00180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd728220b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5fd31620 con 0x555d5fd12f00 2023-07-07T18:16:16.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd728220b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5fd30eb0 con 0x555d5fcec270 2023-07-07T18:16:16.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd728220b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d5fceade0 con 0x555d5fce9740 2023-07-07T18:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd71a638700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd00180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd71a638700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd00180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59578/0 (socket says 172.21.15.12:59578) 2023-07-07T18:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.317+0000 7fd71a638700 1 -- 172.21.15.12:0/1634358931 learned_addr learned my addr 172.21.15.12:0/1634358931 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd719e37700 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd47a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd719636700 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 0x555d5fce87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd71a638700 1 -- 172.21.15.12:0/1634358931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 msgr2=0x555d5fd47a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd71a638700 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd47a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd71a638700 1 -- 172.21.15.12:0/1634358931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 msgr2=0x555d5fce87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd71a638700 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 0x555d5fce87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd71a638700 1 -- 172.21.15.12:0/1634358931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d5fa53c10 con 0x555d5fd12f00 2023-07-07T18:16:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd719636700 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 0x555d5fce87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T18:16:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd71a638700 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd00180 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd70c001220 tx=0x7fd70c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2559d81c458f75b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd6f7fff700 1 -- 172.21.15.12:0/1634358931 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c01d830 con 0x555d5fd12f00 2023-07-07T18:16:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd6f7fff700 1 -- 172.21.15.12:0/1634358931 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c01d4c0 con 0x555d5fd12f00 2023-07-07T18:16:16.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.318+0000 7fd6f7fff700 1 -- 172.21.15.12:0/1634358931 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c01d9b0 con 0x555d5fd12f00 2023-07-07T18:16:16.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 -- 172.21.15.12:0/1634358931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 msgr2=0x555d5fd00180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd00180 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd70c001220 tx=0x7fd70c00c000 comp rx=0 tx=0).stop 2023-07-07T18:16:16.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 -- 172.21.15.12:0/1634358931 shutdown_connections 2023-07-07T18:16:16.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fd12f00 0x555d5fd00180 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd47a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 --2- 172.21.15.12:0/1634358931 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fcec270 0x555d5fce87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 -- 172.21.15.12:0/1634358931 >> 172.21.15.12:0/1634358931 conn(0x555d5fce0fc0 msgr2=0x555d5fce2490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 -- 172.21.15.12:0/1634358931 shutdown_connections 2023-07-07T18:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 -- 172.21.15.12:0/1634358931 wait complete. 2023-07-07T18:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 -- start start 2023-07-07T18:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.319+0000 7fd728220b80 1 Processor -- start 2023-07-07T18:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd728220b80 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd9c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd728220b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd728220b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fd12f00 0x555d5fce87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd728220b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5fd343b0 con 0x555d5fcec270 2023-07-07T18:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd728220b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d5fd4f120 con 0x555d5fd12f00 2023-07-07T18:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd728220b80 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d5fd00590 con 0x555d5fce9740 2023-07-07T18:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd728220b80 10 client.0 _ll_register_callbacks cb 0x555d5fbe2210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-07T18:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719636700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719636700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcffa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59582/0 (socket says 172.21.15.12:59582) 2023-07-07T18:16:16.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719636700 1 -- 172.21.15.12:0/3314086151 learned_addr learned my addr 172.21.15.12:0/3314086151 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719e37700 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd9c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd71a638700 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fd12f00 0x555d5fce87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719636700 1 -- 172.21.15.12:0/3314086151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 msgr2=0x555d5fd9c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719636700 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd9c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719636700 1 -- 172.21.15.12:0/3314086151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fd12f00 msgr2=0x555d5fce87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719636700 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fd12f00 0x555d5fce87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719636700 1 -- 172.21.15.12:0/3314086151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d5fa6ad90 con 0x555d5fcec270 2023-07-07T18:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd719636700 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcffa10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd710057d10 tx=0x7fd710056430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864c08e53a8a167e server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.321+0000 7fd6f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-07-07T18:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/3314086151 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7100600e0 con 0x555d5fcec270 2023-07-07T18:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/3314086151 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd710053e00 con 0x555d5fcec270 2023-07-07T18:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd728220b80 1 -- 172.21.15.12:0/3314086151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd704020040 con 0x555d5fcec270 2023-07-07T18:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/3314086151 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd710087260 con 0x555d5fcec270 2023-07-07T18:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd728220b80 10 client.5616 fetch_fsmap learned FSMap version 16 2023-07-07T18:16:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd728220b80 1 -- 172.21.15.12:0/3314086151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x555d5fa91200 con 0x555d5fcec270 2023-07-07T18:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/3314086151 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd704020040 con 0x555d5fcec270 2023-07-07T18:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/3314086151 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd710053fc0 con 0x555d5fcec270 2023-07-07T18:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd728220b80 10 client.5616 fetch_fsmap finished waiting for FSMap version 16 2023-07-07T18:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd728220b80 10 client.5616 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-07T18:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd728220b80 20 client.5616 populate_metadata read hostname 'smithi012' 2023-07-07T18:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd728220b80 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] conn(0x555d5fd0d0e0 0x555d5fd0d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd728220b80 4 client.5616 mds_command: new command op to 5421 tid=0[{"prefix": "status"}] 2023-07-07T18:16:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd728220b80 1 -- 172.21.15.12:0/3314086151 --> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555d5fbf8000 con 0x555d5fd0d0e0 2023-07-07T18:16:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.322+0000 7fd719e37700 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] conn(0x555d5fd0d0e0 0x555d5fd0d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd6f4ff9700 10 client.5616 ms_handle_connect on v2:172.21.15.12:6833/2736425727 2023-07-07T18:16:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd719e37700 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] conn(0x555d5fd0d0e0 0x555d5fd0d4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f835071161f5d04b server_cookie=7d39f50adb273ee0 in_seq=0 out_seq=0 2023-07-07T18:16:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd6f4ff9700 1 -- 172.21.15.12:0/3314086151 <== mds.0 v2:172.21.15.12:6833/2736425727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x555d5fbf8000 con 0x555d5fd0d0e0 2023-07-07T18:16:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd6f4ff9700 10 client.5616 handle_command_reply: tid=0 2023-07-07T18:16:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 client.5616 shutdown 2023-07-07T18:16:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 -- 172.21.15.12:0/3314086151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 msgr2=0x555d5fcffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcffa10 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd710057d10 tx=0x7fd710056430 comp rx=0 tx=0).stop 2023-07-07T18:16:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 -- 172.21.15.12:0/3314086151 shutdown_connections 2023-07-07T18:16:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555d5fd12f00 0x555d5fce87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.12:6833/2736425727,v1:172.21.15.12:6835/2736425727] conn(0x555d5fd0d0e0 0x555d5fd0d4b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555d5fce9740 0x555d5fd9c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd6f4ff9700 0 client.5616 ms_handle_reset on v2:172.21.15.12:6833/2736425727 2023-07-07T18:16:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 --2- 172.21.15.12:0/3314086151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x555d5fcec270 0x555d5fcffa10 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 -- 172.21.15.12:0/3314086151 >> 172.21.15.12:0/3314086151 conn(0x555d5fce0fc0 msgr2=0x555d5fce71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 -- 172.21.15.12:0/3314086151 shutdown_connections 2023-07-07T18:16:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 1 -- 172.21.15.12:0/3314086151 wait complete. 2023-07-07T18:16:16.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.323+0000 7fd728220b80 20 client.5616 trim_cache size 0 max 16384 2023-07-07T18:16:16.333 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-07-07T18:16:16.333 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "6f09c1a9-a759-4e94-bed7-68b16c28b7f9", 2023-07-07T18:16:16.333 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-07-07T18:16:16.334 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 5421, 2023-07-07T18:16:16.334 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-07-07T18:16:16.334 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-07-07T18:16:16.334 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-07-07T18:16:16.334 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 5.9801011539999998, 2023-07-07T18:16:16.334 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 16, 2023-07-07T18:16:16.334 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 44, 2023-07-07T18:16:16.334 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 44, 2023-07-07T18:16:16.335 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 14.26062724 2023-07-07T18:16:16.335 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-07-07T18:16:16.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 -- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6f806ace0 msgr2=0x7fd6f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6f806ace0 0x7fd6f806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd70400beb0 tx=0x7fd704013000 comp rx=0 tx=0).stop 2023-07-07T18:16:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 -- 172.21.15.12:0/609353496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7140d03e0 msgr2=0x7fd7140b48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7140d03e0 0x7fd7140b48d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd71000e8a0 tx=0x7fd71000ebb0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 -- 172.21.15.12:0/609353496 shutdown_connections 2023-07-07T18:16:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fd6f806ace0 0x7fd6f806d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd714159080 0x7fd7140b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7140ae6d0 0x7fd714151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 --2- 172.21.15.12:0/609353496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7140d03e0 0x7fd7140b48d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 -- 172.21.15.12:0/609353496 >> 172.21.15.12:0/609353496 conn(0x7fd71406b920 msgr2=0x7fd7140cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:16.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 -- 172.21.15.12:0/609353496 shutdown_connections 2023-07-07T18:16:16.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.324+0000 7fd71c09b700 1 -- 172.21.15.12:0/609353496 wait complete. 2023-07-07T18:16:16.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-07T18:16:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.461+0000 7fc8841aa700 1 Processor -- start 2023-07-07T18:16:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.462+0000 7fc8841aa700 1 -- start start 2023-07-07T18:16:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.462+0000 7fc8841aa700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc87c15a820 0x7fc87c0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.462+0000 7fc8841aa700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc87c0d0b00 0x7fc87c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.462+0000 7fc8841aa700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87c0cfa60 con 0x7fc87c0d0f80 2023-07-07T18:16:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.462+0000 7fc8841aa700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c154a80 con 0x7fc87c15a820 2023-07-07T18:16:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.462+0000 7fc8841aa700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87c0cfd40 con 0x7fc87c0d0b00 2023-07-07T18:16:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc881f46700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc87c15a820 0x7fc87c0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc881f46700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc87c15a820 0x7fc87c0caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59588/0 (socket says 172.21.15.12:59588) 2023-07-07T18:16:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc881f46700 1 -- 172.21.15.12:0/1183362896 learned_addr learned my addr 172.21.15.12:0/1183362896 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc881745700 1 --2- 172.21.15.12:0/1183362896 >> v2:172.21.15.160:3300/0 conn(0x7fc87c0d0b00 0x7fc87c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc881f46700 1 -- 172.21.15.12:0/1183362896 >> v2:172.21.15.160:3300/0 conn(0x7fc87c0d0b00 msgr2=0x7fc87c15abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc881f46700 1 --2- 172.21.15.12:0/1183362896 >> v2:172.21.15.160:3300/0 conn(0x7fc87c0d0b00 0x7fc87c15abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc881f46700 1 -- 172.21.15.12:0/1183362896 >> v1:172.21.15.160:6789/0 conn(0x7fc87c0d0f80 legacy=0x7fc87c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc881f46700 1 -- 172.21.15.12:0/1183362896 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c0d0020 con 0x7fc87c15a820 2023-07-07T18:16:16.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc881f46700 1 --2- 172.21.15.12:0/1183362896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c15a820 0x7fc87c0caf00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc87c070310 tx=0x7fc86c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd38b670b7c4658b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc880f44700 1 -- 172.21.15.12:0/1183362896 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c011830 con 0x7fc87c15a820 2023-07-07T18:16:16.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc880f44700 1 -- 172.21.15.12:0/1183362896 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c011990 con 0x7fc87c15a820 2023-07-07T18:16:16.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.463+0000 7fc880f44700 1 -- 172.21.15.12:0/1183362896 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c011d20 con 0x7fc87c15a820 2023-07-07T18:16:16.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.464+0000 7fc8841aa700 1 -- 172.21.15.12:0/1183362896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c15a820 msgr2=0x7fc87c0caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.464+0000 7fc8841aa700 1 --2- 172.21.15.12:0/1183362896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c15a820 0x7fc87c0caf00 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc87c070310 tx=0x7fc86c009bd0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.464+0000 7fc8841aa700 1 -- 172.21.15.12:0/1183362896 shutdown_connections 2023-07-07T18:16:16.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.464+0000 7fc8841aa700 1 --2- 172.21.15.12:0/1183362896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c15a820 0x7fc87c0caf00 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.464+0000 7fc8841aa700 1 --2- 172.21.15.12:0/1183362896 >> v2:172.21.15.160:3300/0 conn(0x7fc87c0d0b00 0x7fc87c15abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.464+0000 7fc8841aa700 1 -- 172.21.15.12:0/1183362896 >> 172.21.15.12:0/1183362896 conn(0x7fc87c06e530 msgr2=0x7fc87c06e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:16.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.464+0000 7fc8841aa700 1 -- 172.21.15.12:0/1183362896 shutdown_connections 2023-07-07T18:16:16.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.464+0000 7fc8841aa700 1 -- 172.21.15.12:0/1183362896 wait complete. 2023-07-07T18:16:16.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.465+0000 7fc8841aa700 1 Processor -- start 2023-07-07T18:16:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.466+0000 7fc8841aa700 1 -- start start 2023-07-07T18:16:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.466+0000 7fc8841aa700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c0d0b00 0x7fc87c149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.466+0000 7fc8841aa700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c0d0f80 0x7fc87c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.466+0000 7fc8841aa700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc87c0c97c0 0x7fc87c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.466+0000 7fc8841aa700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c14a060 con 0x7fc87c0d0f80 2023-07-07T18:16:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.466+0000 7fc8841aa700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0ca1b0 con 0x7fc87c0d0b00 2023-07-07T18:16:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.466+0000 7fc8841aa700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c0ca490 con 0x7fc87c0c97c0 2023-07-07T18:16:16.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881745700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c0d0f80 0x7fc87c154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881745700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c0d0f80 0x7fc87c154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59596/0 (socket says 172.21.15.12:59596) 2023-07-07T18:16:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881745700 1 -- 172.21.15.12:0/1085079889 learned_addr learned my addr 172.21.15.12:0/1085079889 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881f46700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c0d0b00 0x7fc87c149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc882747700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc87c0c97c0 0x7fc87c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881745700 1 -- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc87c0c97c0 msgr2=0x7fc87c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881745700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc87c0c97c0 0x7fc87c0cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881745700 1 -- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c0d0b00 msgr2=0x7fc87c149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881745700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c0d0b00 0x7fc87c149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881745700 1 -- 172.21.15.12:0/1085079889 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c009550 con 0x7fc87c0d0f80 2023-07-07T18:16:16.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc881745700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c0d0f80 0x7fc87c154ca0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc87800e9b0 tx=0x7fc87800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc8727fc700 1 -- 172.21.15.12:0/1085079889 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878009710 con 0x7fc87c0d0f80 2023-07-07T18:16:16.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc8727fc700 1 -- 172.21.15.12:0/1085079889 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87800ee50 con 0x7fc87c0d0f80 2023-07-07T18:16:16.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87c0ca770 con 0x7fc87c0d0f80 2023-07-07T18:16:16.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc8727fc700 1 -- 172.21.15.12:0/1085079889 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800ca50 con 0x7fc87c0d0f80 2023-07-07T18:16:16.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.467+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87c0c4700 con 0x7fc87c0d0f80 2023-07-07T18:16:16.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.468+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87c0ceb10 con 0x7fc87c0d0f80 2023-07-07T18:16:16.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.469+0000 7fc8727fc700 1 -- 172.21.15.12:0/1085079889 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc87800cbb0 con 0x7fc87c0d0f80 2023-07-07T18:16:16.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.469+0000 7fc8727fc700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc86006ace0 0x7fc86006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:16.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.469+0000 7fc8727fc700 1 -- 172.21.15.12:0/1085079889 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc8780898b0 con 0x7fc87c0d0f80 2023-07-07T18:16:16.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.469+0000 7fc881f46700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc86006ace0 0x7fc86006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:16.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.470+0000 7fc881f46700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc86006ace0 0x7fc86006d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc87c06e3a0 tx=0x7fc86c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:16.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.474+0000 7fc8727fc700 1 -- 172.21.15.12:0/1085079889 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc878058340 con 0x7fc87c0d0f80 2023-07-07T18:16:16.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.719+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc87c073910 con 0x7fc87c0d0f80 2023-07-07T18:16:16.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.719+0000 7fc8727fc700 1 -- 172.21.15.12:0/1085079889 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc87800ce60 con 0x7fc87c0d0f80 2023-07-07T18:16:16.721 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-07T18:16:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc86006ace0 msgr2=0x7fc86006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc86006ace0 0x7fc86006d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc87c06e3a0 tx=0x7fc86c008030 comp rx=0 tx=0).stop 2023-07-07T18:16:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c0d0f80 msgr2=0x7fc87c154ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c0d0f80 0x7fc87c154ca0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc87800e9b0 tx=0x7fc87800ecc0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 shutdown_connections 2023-07-07T18:16:16.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc86006ace0 0x7fc86006d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc87c0c97c0 0x7fc87c0cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc87c0d0b00 0x7fc87c149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 --2- 172.21.15.12:0/1085079889 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc87c0d0f80 0x7fc87c154ca0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 >> 172.21.15.12:0/1085079889 conn(0x7fc87c06e530 msgr2=0x7fc87c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 shutdown_connections 2023-07-07T18:16:16.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:16.722+0000 7fc8841aa700 1 -- 172.21.15.12:0/1085079889 wait complete. 2023-07-07T18:16:16.734 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-07T18:16:16.735 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-07T18:16:16.735 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-07-07T18:16:16.735 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-07T18:16:16.736 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-07T18:16:16.736 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-07T18:16:16.736 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-07T18:16:16.736 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-07T18:16:16.737 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-07T18:16:16.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:16.737 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-07-07T18:16:16.755 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-07T18:16:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-07T18:16:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-07-07T18:16:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:16:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-07-07T18:16:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:16:16.756 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:16:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:16:16.756 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:16:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:16:16.757 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-07T18:16:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-07-07T18:16:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-07T18:16:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42058sec preferred_lft 42058sec 2023-07-07T18:16:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link 2023-07-07T18:16:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:16:16.757 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-07T18:16:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-07-07T18:16:16.758 INFO:teuthology.orchestra.run.smithi012.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-07T18:16:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0a:28:b7:b3:6c:48 brd ff:ff:ff:ff:ff:ff 2023-07-07T18:16:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-07T18:16:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:16:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3c3f:1eff:fef4:546e/64 scope link 2023-07-07T18:16:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:16:16.758 INFO:teuthology.orchestra.run.smithi012.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-07T18:16:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 9a:c7:a8:8b:1f:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-07T18:16:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::98c7:a8ff:fe8b:1f40/64 scope link 2023-07-07T18:16:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:16:16.759 INFO:teuthology.orchestra.run.smithi012.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-07T18:16:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0a:28:b7:b3:6c:48 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-07T18:16:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::828:b7ff:feb3:6c48/64 scope link 2023-07-07T18:16:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-07-07T18:16:16.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:16.760 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-07T18:16:16.822 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-07-07T18:16:16.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:16.823 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-07-07T18:16:16.882 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-07-07T18:16:16.883 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-07T18:16:16.883 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-07T18:16:16.883 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-07T18:16:16.883 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-07T18:16:16.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:16.884 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-07-07T18:16:16.884 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-07-07T18:16:16.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-07T18:16:16.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-07T18:16:16.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-07T18:16:16.885 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-07-07T18:16:16.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:16.990 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-07-07T18:16:17.007 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-07T18:16:17.007 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-07T18:16:17.008 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-07T18:16:17.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:17.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-07-07T18:16:17.075 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:16:17.076 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-07T18:16:17.132 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-07T18:16:17.133 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-07T18:16:17.133 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-07T18:16:17.189 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-07T18:16:17.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:17.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-07T18:16:17.275 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-07T18:16:17.276 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-07T18:16:17.276 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2023-07-07T18:16:17.284 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-07T18:16:17.285 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-07T18:16:17.285 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2023-07-07T18:16:17.285 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:16:17.285 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:16:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-07T18:16:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-07T18:16:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:invalid new device string format 2023-07-07T18:16:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.160:3300,172.21.15.160:3301" 2023-07-07T18:16:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-07T18:16:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790" 2023-07-07T18:16:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.12:6789,172.21.15.160:6789,172.21.15.160:6790:/ 2023-07-07T18:16:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=6f09c1a9-a759-4e94-bed7-68b16c28b7f9" will pass to kernel 2023-07-07T18:16:17.362 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-07T18:16:17.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:17.363 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-07T18:16:17.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:17.391 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-07T18:16:17.473 INFO:teuthology.orchestra.run.smithi012.stdout:client5344 2023-07-07T18:16:17.474 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:16:17.474 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T18:16:17.531 DEBUG:teuthology.orchestra.run.smithi012:> mktemp -d --suffix=xfstests-dev 2023-07-07T18:16:17.589 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.XqO9xwZcsPxfstests-dev 2023-07-07T18:16:17.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:17.590 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.XqO9xwZcsPxfstests-dev) 2023-07-07T18:16:17.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:17.659 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.XqO9xwZcsPxfstests-dev) 2023-07-07T18:16:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:Cloning into '/tmp/tmp.XqO9xwZcsPxfstests-dev'... 2023-07-07T18:16:18.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:18.388 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-07T18:16:18.451 DEBUG:teuthology.orchestra.run.smithi012:> mktemp -d --suffix=test 2023-07-07T18:16:18.507 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.LDqKVxgZKjtest 2023-07-07T18:16:18.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:16:18.508 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-07T18:16:18.566 DEBUG:teuthology.orchestra.run.smithi012:> mktemp -d --suffix=scratch 2023-07-07T18:16:18.623 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:16:18.624 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-07-07T18:16:18.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-07-07T18:16:19.051 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-07-07T18:16:20.067 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:04:41 ago on Fri 07 Jul 2023 06:11:39 PM UTC. 2023-07-07T18:16:21.489 INFO:teuthology.orchestra.run.smithi012.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-07-07T18:16:21.490 INFO:teuthology.orchestra.run.smithi012.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-07-07T18:16:21.492 INFO:teuthology.orchestra.run.smithi012.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-07-07T18:16:21.493 INFO:teuthology.orchestra.run.smithi012.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-07-07T18:16:21.494 INFO:teuthology.orchestra.run.smithi012.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-07-07T18:16:21.497 INFO:teuthology.orchestra.run.smithi012.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-07-07T18:16:21.499 INFO:teuthology.orchestra.run.smithi012.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-07-07T18:16:21.500 INFO:teuthology.orchestra.run.smithi012.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-07-07T18:16:21.503 INFO:teuthology.orchestra.run.smithi012.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-07-07T18:16:21.504 INFO:teuthology.orchestra.run.smithi012.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-07-07T18:16:21.505 INFO:teuthology.orchestra.run.smithi012.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-07-07T18:16:21.507 INFO:teuthology.orchestra.run.smithi012.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-07-07T18:16:21.508 INFO:teuthology.orchestra.run.smithi012.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-07-07T18:16:21.509 INFO:teuthology.orchestra.run.smithi012.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-07-07T18:16:21.510 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-07T18:16:21.512 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-07T18:16:21.513 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-07T18:16:21.514 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-07T18:16:21.516 INFO:teuthology.orchestra.run.smithi012.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-07-07T18:16:21.517 INFO:teuthology.orchestra.run.smithi012.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-07-07T18:16:21.518 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-07-07T18:16:21.521 INFO:teuthology.orchestra.run.smithi012.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-07-07T18:16:21.526 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-07T18:16:21.649 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-07-07T18:16:21.651 INFO:teuthology.orchestra.run.smithi012.stdout:==================================================================================================================== 2023-07-07T18:16:21.651 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-07-07T18:16:21.651 INFO:teuthology.orchestra.run.smithi012.stdout:==================================================================================================================== 2023-07-07T18:16:21.652 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2023-07-07T18:16:21.652 INFO:teuthology.orchestra.run.smithi012.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-07-07T18:16:21.652 INFO:teuthology.orchestra.run.smithi012.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-07T18:16:21.652 INFO:teuthology.orchestra.run.smithi012.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-07-07T18:16:21.652 INFO:teuthology.orchestra.run.smithi012.stdout: python2 x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-07T18:16:21.652 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2023-07-07T18:16:21.652 INFO:teuthology.orchestra.run.smithi012.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-07-07T18:16:21.652 INFO:teuthology.orchestra.run.smithi012.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-07-07T18:16:21.653 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2023-07-07T18:16:21.653 INFO:teuthology.orchestra.run.smithi012.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-07-07T18:16:21.653 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-07-07T18:16:21.653 INFO:teuthology.orchestra.run.smithi012.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-07-07T18:16:21.653 INFO:teuthology.orchestra.run.smithi012.stdout: python2-libs x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-07-07T18:16:21.653 INFO:teuthology.orchestra.run.smithi012.stdout: python2-pip-wheel noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 892 k 2023-07-07T18:16:21.653 INFO:teuthology.orchestra.run.smithi012.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-07-07T18:16:21.654 INFO:teuthology.orchestra.run.smithi012.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module+el8.5.0+12203+77770ab7 rhel-8-for-x86_64-appstream-rpms 45 k 2023-07-07T18:16:21.654 INFO:teuthology.orchestra.run.smithi012.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-07-07T18:16:21.654 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2023-07-07T18:16:21.654 INFO:teuthology.orchestra.run.smithi012.stdout: python2-pip noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 1.6 M 2023-07-07T18:16:21.654 INFO:teuthology.orchestra.run.smithi012.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-07-07T18:16:21.654 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling module streams: 2023-07-07T18:16:21.654 INFO:teuthology.orchestra.run.smithi012.stdout: python27 2.7 2023-07-07T18:16:21.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:21.655 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-07-07T18:16:21.655 INFO:teuthology.orchestra.run.smithi012.stdout:==================================================================================================================== 2023-07-07T18:16:21.655 INFO:teuthology.orchestra.run.smithi012.stdout:Install 14 Packages 2023-07-07T18:16:21.655 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 2 Packages 2023-07-07T18:16:21.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:21.656 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 12 M 2023-07-07T18:16:21.656 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-07-07T18:16:21.970 INFO:teuthology.orchestra.run.smithi012.stdout:(1/16): python2-setuptools-wheel-39.0.1-13.modu 1.1 MB/s | 287 kB 00:00 2023-07-07T18:16:22.062 INFO:teuthology.orchestra.run.smithi012.stdout:(2/16): python2-setuptools-39.0.1-13.module+el8 1.9 MB/s | 642 kB 00:00 2023-07-07T18:16:22.104 INFO:teuthology.orchestra.run.smithi012.stdout:(3/16): python2-wheel-wheel-0.31.1-3.module+el8 335 kB/s | 45 kB 00:00 2023-07-07T18:16:22.346 INFO:teuthology.orchestra.run.smithi012.stdout:(4/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 380 kB/s | 92 kB 00:00 2023-07-07T18:16:22.379 INFO:teuthology.orchestra.run.smithi012.stdout:(5/16): fio-3.19-3.el8.x86_64.rpm 1.7 MB/s | 538 kB 00:00 2023-07-07T18:16:22.405 INFO:teuthology.orchestra.run.smithi012.stdout:(6/16): indent-2.2.13-2.el8.x86_64.rpm 274 kB/s | 187 kB 00:00 2023-07-07T18:16:22.547 INFO:teuthology.orchestra.run.smithi012.stdout:(7/16): python2-2.7.18-10.module+el8.6.0+14191+ 549 kB/s | 110 kB 00:00 2023-07-07T18:16:22.697 INFO:teuthology.orchestra.run.smithi012.stdout:(8/16): python2-libs-2.7.18-10.module+el8.6.0+1 19 MB/s | 6.0 MB 00:00 2023-07-07T18:16:22.821 INFO:teuthology.orchestra.run.smithi012.stdout:(9/16): python2-pip-9.0.3-19.module+el8.6.0+130 3.9 MB/s | 1.6 MB 00:00 2023-07-07T18:16:22.898 INFO:teuthology.orchestra.run.smithi012.stdout:(10/16): python2-pip-wheel-9.0.3-19.module+el8. 2.5 MB/s | 892 kB 00:00 2023-07-07T18:16:22.931 INFO:teuthology.orchestra.run.smithi012.stdout:(11/16): dump-0.4-0.36.b46.el8.x86_64.rpm 702 kB/s | 164 kB 00:00 2023-07-07T18:16:23.090 INFO:teuthology.orchestra.run.smithi012.stdout:(12/16): daxctl-libs-71.1-3.el8.x86_64.rpm 217 kB/s | 42 kB 00:00 2023-07-07T18:16:23.115 INFO:teuthology.orchestra.run.smithi012.stdout:(13/16): rmt-1.5.3-13.el8.x86_64.rpm 175 kB/s | 51 kB 00:00 2023-07-07T18:16:23.140 INFO:teuthology.orchestra.run.smithi012.stdout:(14/16): ndctl-libs-71.1-3.el8.x86_64.rpm 376 kB/s | 79 kB 00:00 2023-07-07T18:16:23.182 INFO:teuthology.orchestra.run.smithi012.stdout:(15/16): sqlite-3.26.0-16.el8_6.x86_64.rpm 7.1 MB/s | 668 kB 00:00 2023-07-07T18:16:23.300 INFO:teuthology.orchestra.run.smithi012.stdout:(16/16): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2023-07-07T18:16:23.301 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-07-07T18:16:23.302 INFO:teuthology.orchestra.run.smithi012.stdout:Total 7.2 MB/s | 12 MB 00:01 2023-07-07T18:16:23.522 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-07-07T18:16:23.565 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-07-07T18:16:23.565 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-07-07T18:16:23.763 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-07-07T18:16:23.768 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-07-07T18:16:24.496 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-07-07T18:16:24.851 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 1/18 2023-07-07T18:16:24.995 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 2/18 2023-07-07T18:16:25.070 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 2/18 2023-07-07T18:16:25.303 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 3/18 2023-07-07T18:16:25.381 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 3/18 2023-07-07T18:16:25.561 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-07-07T18:16:25.637 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-07-07T18:16:25.860 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/18 2023-07-07T18:16:25.999 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 6/18 2023-07-07T18:16:26.284 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 7/18 2023-07-07T18:16:26.946 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 8/18 2023-07-07T18:16:27.226 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-07-07T18:16:27.384 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-07-07T18:16:28.586 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-07-07T18:16:28.888 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 11/18 2023-07-07T18:16:29.210 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-07-07T18:16:29.477 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fio-3.19-3.el8.x86_64 13/18 2023-07-07T18:16:29.715 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 14/18 2023-07-07T18:16:29.880 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 15/18 2023-07-07T18:16:30.086 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : indent-2.2.13-2.el8.x86_64 16/18 2023-07-07T18:16:30.244 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 17/18 2023-07-07T18:16:30.417 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-07-07T18:16:30.726 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-07-07T18:16:30.726 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/18 2023-07-07T18:16:30.726 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 2/18 2023-07-07T18:16:30.727 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 3/18 2023-07-07T18:16:30.727 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 4/18 2023-07-07T18:16:30.727 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fio-3.19-3.el8.x86_64 5/18 2023-07-07T18:16:30.727 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 6/18 2023-07-07T18:16:30.727 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 7/18 2023-07-07T18:16:30.727 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 8/18 2023-07-07T18:16:30.727 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-07-07T18:16:30.728 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 10/18 2023-07-07T18:16:30.728 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/18 2023-07-07T18:16:30.728 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 12/18 2023-07-07T18:16:30.728 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 13/18 2023-07-07T18:16:30.728 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 14/18 2023-07-07T18:16:30.728 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 15/18 2023-07-07T18:16:30.728 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 16/18 2023-07-07T18:16:30.729 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 17/18 2023-07-07T18:16:32.002 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-07-07T18:16:32.003 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:04:53 ago on Fri 07 Jul 2023 06:11:39 PM UTC. 2023-07-07T18:16:35.131 INFO:teuthology.orchestra.run.smithi012.stdout:Installed products updated. 2023-07-07T18:16:35.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:35.343 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2023-07-07T18:16:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-07-07T18:16:35.344 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2023-07-07T18:16:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: daxctl-libs-71.1-3.el8.x86_64 2023-07-07T18:16:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-07-07T18:16:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: fio-3.19-3.el8.x86_64 2023-07-07T18:16:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: indent-2.2.13-2.el8.x86_64 2023-07-07T18:16:35.344 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-07-07T18:16:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: ndctl-libs-71.1-3.el8.x86_64 2023-07-07T18:16:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-07-07T18:16:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-07-07T18:16:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-07-07T18:16:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-07-07T18:16:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-07-07T18:16:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-07-07T18:16:35.345 INFO:teuthology.orchestra.run.smithi012.stdout: python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+12203+77770ab7.noarch 2023-07-07T18:16:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-07-07T18:16:35.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:35.346 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-07-07T18:16:35.539 DEBUG:teuthology.orchestra.run.smithi012:> sudo useradd -m fsgqa 2023-07-07T18:16:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:useradd: user 'fsgqa' already exists 2023-07-07T18:16:35.570 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-07T18:16:35.571 DEBUG:teuthology.orchestra.run.smithi012:> sudo groupadd fsgqa 2023-07-07T18:16:35.639 INFO:teuthology.orchestra.run.smithi012.stderr:groupadd: group 'fsgqa' already exists 2023-07-07T18:16:35.639 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-07T18:16:35.640 DEBUG:teuthology.orchestra.run.smithi012:> sudo useradd fsgqa2 2023-07-07T18:16:36.659 DEBUG:teuthology.orchestra.run.smithi012:> sudo useradd 123456-fsgqa 2023-07-07T18:16:37.694 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-07T18:16:37.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.839+0000 7fa2f6dd8700 1 Processor -- start 2023-07-07T18:16:37.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.839+0000 7fa2f6dd8700 1 -- start start 2023-07-07T18:16:37.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.839+0000 7fa2f6dd8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f00cf1e0 0x7fa2f006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:37.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.839+0000 7fa2f6dd8700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f00cf600 con 0x7fa2f0158ef0 2023-07-07T18:16:37.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2f6dd8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f00c9510 con 0x7fa2f00709f0 2023-07-07T18:16:37.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2f6dd8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00cd6a0 con 0x7fa2f00cf1e0 2023-07-07T18:16:37.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2f4b74700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa2f0158ef0 0x7fa2f00702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56824/0 (socket says 172.21.15.12:56824) 2023-07-07T18:16:37.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2f4b74700 1 -- 172.21.15.12:0/2668389367 learned_addr learned my addr 172.21.15.12:0/2668389367 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:37.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2f5375700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f00cf1e0 0x7fa2f006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:37.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116004691 0 0) 0x7fa2f00cf600 con 0x7fa2f0158ef0 2023-07-07T18:16:37.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e00035b0 con 0x7fa2f0158ef0 2023-07-07T18:16:37.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342335035 0 0) 0x7fa2f00c9510 con 0x7fa2f00709f0 2023-07-07T18:16:37.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f00cf600 con 0x7fa2f00709f0 2023-07-07T18:16:37.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3100124640 0 0) 0x7fa2e00035b0 con 0x7fa2f0158ef0 2023-07-07T18:16:37.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f00cf1e0 msgr2=0x7fa2f006c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:37.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f00cf1e0 0x7fa2f006c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:37.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 >> v1:172.21.15.160:6789/0 conn(0x7fa2f00709f0 legacy=0x7fa2f00ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:37.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00cd980 con 0x7fa2f0158ef0 2023-07-07T18:16:37.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7fa2e4001670 con 0x7fa2f0158ef0 2023-07-07T18:16:37.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 >> v1:172.21.15.12:6789/0 conn(0x7fa2f0158ef0 legacy=0x7fa2f00702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:37.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2e0003bc0 0x7fa2e0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f00cf1e0 0x7fa2e0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e0004d90 0x7fa2e0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00cd6a0 con 0x7fa2e0004d90 2023-07-07T18:16:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e000bac0 con 0x7fa2e0003bc0 2023-07-07T18:16:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.840+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e000bc80 con 0x7fa2f00cf1e0 2023-07-07T18:16:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2f5375700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e0004d90 0x7fa2e0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2f4b74700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2e0003bc0 0x7fa2e0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:37.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2effff700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f00cf1e0 0x7fa2e0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:37.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2f5375700 1 -- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f00cf1e0 msgr2=0x7fa2e0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:37.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2f5375700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f00cf1e0 0x7fa2e0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:37.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2f5375700 1 -- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2e0003bc0 msgr2=0x7fa2e0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:37.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2f5375700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2e0003bc0 0x7fa2e0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:37.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2f5375700 1 -- 172.21.15.12:0/2668389367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00035b0 con 0x7fa2e0004d90 2023-07-07T18:16:37.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2f5375700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e0004d90 0x7fa2e0005200 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009f90 tx=0x7fa2e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d762c09dce678b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:37.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800ec30 con 0x7fa2e0004d90 2023-07-07T18:16:37.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e800f040 con 0x7fa2e0004d90 2023-07-07T18:16:37.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.841+0000 7fa2ef7fe700 1 -- 172.21.15.12:0/2668389367 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8014480 con 0x7fa2e0004d90 2023-07-07T18:16:37.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.842+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/2668389367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e0004d90 msgr2=0x7fa2e0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:37.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.842+0000 7fa2f6dd8700 1 --2- 172.21.15.12:0/2668389367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2e0004d90 0x7fa2e0005200 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009f90 tx=0x7fa2e0005880 comp rx=0 tx=0).stop 2023-07-07T18:16:37.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.842+0000 7fa2f5375700 1 -- 172.21.15.12:0/2668389367 reap_dead start 2023-07-07T18:16:37.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.842+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/2668389367 shutdown_connections 2023-07-07T18:16:37.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.842+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/2668389367 >> 172.21.15.12:0/2668389367 conn(0x7fa2f00b0ef0 msgr2=0x7fa2f00ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:37.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.842+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/2668389367 shutdown_connections 2023-07-07T18:16:37.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.842+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/2668389367 wait complete. 2023-07-07T18:16:37.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.843+0000 7fa2f6dd8700 1 Processor -- start 2023-07-07T18:16:37.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.843+0000 7fa2f6dd8700 1 -- start start 2023-07-07T18:16:37.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f6dd8700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2f0152720 0x7fa2f0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:37.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f6dd8700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f006a430 0x7fa2f01f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:37.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f6dd8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2f01f60e0 0x7fa2f00c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:37.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f6dd8700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00ac8e0 con 0x7fa2f0152720 2023-07-07T18:16:37.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f6dd8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f0152af0 con 0x7fa2f01f60e0 2023-07-07T18:16:37.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f6dd8700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f006a8a0 con 0x7fa2f006a430 2023-07-07T18:16:37.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f4b74700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2f0152720 0x7fa2f0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:37.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f4b74700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2f0152720 0x7fa2f0069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59638/0 (socket says 172.21.15.12:59638) 2023-07-07T18:16:37.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f4b74700 1 -- 172.21.15.12:0/176474241 learned_addr learned my addr 172.21.15.12:0/176474241 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:37.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2effff700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f006a430 0x7fa2f01f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f5375700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2f01f60e0 0x7fa2f00c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f4b74700 1 -- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f006a430 msgr2=0x7fa2f01f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f4b74700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f006a430 0x7fa2f01f5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f4b74700 1 -- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2f01f60e0 msgr2=0x7fa2f00c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.844+0000 7fa2f4b74700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2f01f60e0 0x7fa2f00c21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.845+0000 7fa2f4b74700 1 -- 172.21.15.12:0/176474241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f015bc40 con 0x7fa2f0152720 2023-07-07T18:16:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.845+0000 7fa2f4b74700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2f0152720 0x7fa2f0069ef0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40072c0 tx=0x7fa2e4007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.845+0000 7fa2ed7fa700 1 -- 172.21.15.12:0/176474241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40077a0 con 0x7fa2f0152720 2023-07-07T18:16:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.845+0000 7fa2ed7fa700 1 -- 172.21.15.12:0/176474241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e400f870 con 0x7fa2f0152720 2023-07-07T18:16:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.845+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f00ab8d0 con 0x7fa2f0152720 2023-07-07T18:16:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.845+0000 7fa2ed7fa700 1 -- 172.21.15.12:0/176474241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400fc20 con 0x7fa2f0152720 2023-07-07T18:16:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.845+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f00ac450 con 0x7fa2f0152720 2023-07-07T18:16:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.846+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f0073910 con 0x7fa2f0152720 2023-07-07T18:16:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.846+0000 7fa2ed7fa700 1 -- 172.21.15.12:0/176474241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa2e400fd80 con 0x7fa2f0152720 2023-07-07T18:16:37.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.847+0000 7fa2ed7fa700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa2d406ace0 0x7fa2d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:37.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.847+0000 7fa2ed7fa700 1 -- 172.21.15.12:0/176474241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa2e4089060 con 0x7fa2f0152720 2023-07-07T18:16:37.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.847+0000 7fa2effff700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa2d406ace0 0x7fa2d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:37.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.848+0000 7fa2effff700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa2d406ace0 0x7fa2d406d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00c8940 tx=0x7fa2dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:37.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:37.851+0000 7fa2ed7fa700 1 -- 172.21.15.12:0/176474241 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa2e40bb310 con 0x7fa2f0152720 2023-07-07T18:16:38.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.134+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa2f00c1f60 con 0x7fa2f0152720 2023-07-07T18:16:38.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.134+0000 7fa2ed7fa700 1 -- 172.21.15.12:0/176474241 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fa2e401a510 con 0x7fa2f0152720 2023-07-07T18:16:38.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:16:38.135 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":1,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","modified":"2023-07-07T18:13:46.129233Z","created":"2023-07-07T18:13:46.129233Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:3300","nonce":0},{"type":"v1","addr":"172.21.15.12:6789","nonce":0}]},"addr":"172.21.15.12:6789/0","public_addr":"172.21.15.12:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3301","nonce":0},{"type":"v1","addr":"172.21.15.160:6790","nonce":0}]},"addr":"172.21.15.160:6790/0","public_addr":"172.21.15.160:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-07T18:16:38.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.136+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa2d406ace0 msgr2=0x7fa2d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:38.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.136+0000 7fa2f6dd8700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa2d406ace0 0x7fa2d406d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00c8940 tx=0x7fa2dc009040 comp rx=0 tx=0).stop 2023-07-07T18:16:38.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.136+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2f0152720 msgr2=0x7fa2f0069ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:38.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.136+0000 7fa2f6dd8700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2f0152720 0x7fa2f0069ef0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40072c0 tx=0x7fa2e4007680 comp rx=0 tx=0).stop 2023-07-07T18:16:38.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.137+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 shutdown_connections 2023-07-07T18:16:38.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.137+0000 7fa2f6dd8700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fa2d406ace0 0x7fa2d406d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.137+0000 7fa2f6dd8700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2f01f60e0 0x7fa2f00c21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.137+0000 7fa2f6dd8700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2f0152720 0x7fa2f0069ef0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.137+0000 7fa2f6dd8700 1 --2- 172.21.15.12:0/176474241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2f006a430 0x7fa2f01f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.137+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 >> 172.21.15.12:0/176474241 conn(0x7fa2f00b0ef0 msgr2=0x7fa2f00ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:38.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.137+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 shutdown_connections 2023-07-07T18:16:38.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.137+0000 7fa2f6dd8700 1 -- 172.21.15.12:0/176474241 wait complete. 2023-07-07T18:16:38.139 INFO:teuthology.orchestra.run.smithi012.stderr:dumped monmap epoch 1 2023-07-07T18:16:38.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-07T18:16:38.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.299+0000 7f8405e3a700 1 Processor -- start 2023-07-07T18:16:38.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.300+0000 7f8405e3a700 1 -- start start 2023-07-07T18:16:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.300+0000 7f8405e3a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f840015c570 0x7f84000cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.300+0000 7f8405e3a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8400160a50 0x7f84000d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:38.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.300+0000 7f8405e3a700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84001610a0 con 0x7f84000cd660 2023-07-07T18:16:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.300+0000 7f8405e3a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840015d670 con 0x7f840015c570 2023-07-07T18:16:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.300+0000 7f8405e3a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8400160eb0 con 0x7f8400160a50 2023-07-07T18:16:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83feffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f84000cd660 0x7f8400160340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56846/0 (socket says 172.21.15.12:56846) 2023-07-07T18:16:38.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83feffd700 1 -- 172.21.15.12:0/2002708421 learned_addr learned my addr 172.21.15.12:0/2002708421 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T18:16:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83ff7fe700 1 --2- 172.21.15.12:0/2002708421 >> v2:172.21.15.160:3300/0 conn(0x7f840015c570 0x7f84000cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83fffff700 1 --2- 172.21.15.12:0/2002708421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8400160a50 0x7f84000d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83fe7fc700 1 -- 172.21.15.12:0/2002708421 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686763086 0 0) 0x7f84001610a0 con 0x7f84000cd660 2023-07-07T18:16:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83fe7fc700 1 -- 172.21.15.12:0/2002708421 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e80035b0 con 0x7f84000cd660 2023-07-07T18:16:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83ff7fe700 1 -- 172.21.15.12:0/2002708421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8400160a50 msgr2=0x7f84000d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T18:16:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83ff7fe700 1 --2- 172.21.15.12:0/2002708421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8400160a50 0x7f84000d0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83fe7fc700 1 -- 172.21.15.12:0/2002708421 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1322488148 0 0) 0x7f83e80035b0 con 0x7f84000cd660 2023-07-07T18:16:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83ff7fe700 1 -- 172.21.15.12:0/2002708421 >> v1:172.21.15.12:6789/0 conn(0x7f84000cd660 legacy=0x7f8400160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83ff7fe700 1 -- 172.21.15.12:0/2002708421 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840015da90 con 0x7f840015c570 2023-07-07T18:16:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83fffff700 1 --2- 172.21.15.12:0/2002708421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8400160a50 0x7f84000d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T18:16:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.301+0000 7f83ff7fe700 1 --2- 172.21.15.12:0/2002708421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 0x7f84000cd120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009870 tx=0x7f83f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b010a379689629b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f83fe7fc700 1 -- 172.21.15.12:0/2002708421 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4001670 con 0x7f840015c570 2023-07-07T18:16:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f83fe7fc700 1 -- 172.21.15.12:0/2002708421 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0004030 con 0x7f840015c570 2023-07-07T18:16:38.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f83fe7fc700 1 -- 172.21.15.12:0/2002708421 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00043c0 con 0x7f840015c570 2023-07-07T18:16:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f8405e3a700 1 -- 172.21.15.12:0/2002708421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 msgr2=0x7f84000cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f8405e3a700 1 --2- 172.21.15.12:0/2002708421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 0x7f84000cd120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83f0009870 tx=0x7f83f0009b80 comp rx=0 tx=0).stop 2023-07-07T18:16:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f8405e3a700 1 -- 172.21.15.12:0/2002708421 shutdown_connections 2023-07-07T18:16:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f8405e3a700 1 --2- 172.21.15.12:0/2002708421 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8400160a50 0x7f84000d0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f8405e3a700 1 --2- 172.21.15.12:0/2002708421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 0x7f84000cd120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f8405e3a700 1 -- 172.21.15.12:0/2002708421 >> 172.21.15.12:0/2002708421 conn(0x7f8400071620 msgr2=0x7f84000719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f8405e3a700 1 -- 172.21.15.12:0/2002708421 shutdown_connections 2023-07-07T18:16:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.302+0000 7f8405e3a700 1 -- 172.21.15.12:0/2002708421 wait complete. 2023-07-07T18:16:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.304+0000 7f8405e3a700 1 Processor -- start 2023-07-07T18:16:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.304+0000 7f8405e3a700 1 -- start start 2023-07-07T18:16:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.304+0000 7f8405e3a700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84000cd660 0x7f8400150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.304+0000 7f8405e3a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 0x7f8400158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.304+0000 7f8405e3a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8400160a50 0x7f8400158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:38.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.304+0000 7f8405e3a700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000b64f0 con 0x7f8400160a50 2023-07-07T18:16:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.304+0000 7f8405e3a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000b6910 con 0x7f840015c570 2023-07-07T18:16:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.304+0000 7f8405e3a700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c82a0 con 0x7f84000cd660 2023-07-07T18:16:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8400160a50 0x7f8400158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8400160a50 0x7f8400158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59656/0 (socket says 172.21.15.12:59656) 2023-07-07T18:16:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83fffff700 1 -- 172.21.15.12:0/812460534 learned_addr learned my addr 172.21.15.12:0/812460534 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T18:16:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83ff7fe700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84000cd660 0x7f8400150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:38.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83feffd700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 0x7f8400158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83fffff700 1 -- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84000cd660 msgr2=0x7f8400150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83fffff700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84000cd660 0x7f8400150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83fffff700 1 -- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 msgr2=0x7f8400158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83fffff700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 0x7f8400158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83fffff700 1 -- 172.21.15.12:0/812460534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8009a70 con 0x7f8400160a50 2023-07-07T18:16:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83ff7fe700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84000cd660 0x7f8400150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83feffd700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 0x7f8400158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T18:16:38.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83fffff700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8400160a50 0x7f8400158aa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009e60 tx=0x7f83f800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83e7fff700 1 -- 172.21.15.12:0/812460534 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8009cd0 con 0x7f8400160a50 2023-07-07T18:16:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83e7fff700 1 -- 172.21.15.12:0/812460534 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f800f040 con 0x7f8400160a50 2023-07-07T18:16:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f83e7fff700 1 -- 172.21.15.12:0/812460534 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f800ce20 con 0x7f8400160a50 2023-07-07T18:16:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f00094a0 con 0x7f8400160a50 2023-07-07T18:16:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.305+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84000b5e30 con 0x7f8400160a50 2023-07-07T18:16:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.306+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8400073910 con 0x7f8400160a50 2023-07-07T18:16:38.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.307+0000 7f83e7fff700 1 -- 172.21.15.12:0/812460534 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83f8014480 con 0x7f8400160a50 2023-07-07T18:16:38.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.307+0000 7f83e7fff700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f83ec06ad10 0x7f83ec06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T18:16:38.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.307+0000 7f83e7fff700 1 -- 172.21.15.12:0/812460534 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f83f8089c00 con 0x7f8400160a50 2023-07-07T18:16:38.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.307+0000 7f83ff7fe700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f83ec06ad10 0x7f83ec06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T18:16:38.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.308+0000 7f83ff7fe700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f83ec06ad10 0x7f83ec06d1c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097c0 tx=0x7f83f001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T18:16:38.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.311+0000 7f83e7fff700 1 -- 172.21.15.12:0/812460534 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f83f8090080 con 0x7f8400160a50 2023-07-07T18:16:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.591+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f84000b5360 con 0x7f8400160a50 2023-07-07T18:16:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.591+0000 7f83e7fff700 1 -- 172.21.15.12:0/812460534 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f83f8054bc0 con 0x7f8400160a50 2023-07-07T18:16:38.593 INFO:teuthology.orchestra.run.smithi012.stdout:[client.admin] 2023-07-07T18:16:38.593 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== 2023-07-07T18:16:38.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.593+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f83ec06ad10 msgr2=0x7f83ec06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.593+0000 7f8405e3a700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f83ec06ad10 0x7f83ec06d1c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097c0 tx=0x7f83f001c040 comp rx=0 tx=0).stop 2023-07-07T18:16:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.593+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8400160a50 msgr2=0x7f8400158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T18:16:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.593+0000 7f8405e3a700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8400160a50 0x7f8400158aa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009e60 tx=0x7f83f800c3a0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.593+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 shutdown_connections 2023-07-07T18:16:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.593+0000 7f8405e3a700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f83ec06ad10 0x7f83ec06d1c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.593+0000 7f8405e3a700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8400160a50 0x7f8400158aa0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.593+0000 7f8405e3a700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f84000cd660 0x7f8400150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.593+0000 7f8405e3a700 1 --2- 172.21.15.12:0/812460534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f840015c570 0x7f8400158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T18:16:38.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.594+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 >> 172.21.15.12:0/812460534 conn(0x7f8400071620 msgr2=0x7f84000d2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T18:16:38.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.594+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 shutdown_connections 2023-07-07T18:16:38.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T18:16:38.594+0000 7f8405e3a700 1 -- 172.21.15.12:0/812460534 wait complete. 2023-07-07T18:16:38.607 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:16:38.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/tmp/tmp.XqO9xwZcsPxfstests-dev/local.config 2023-07-07T18:16:38.647 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.12:6789:/test export TEST_DIR=/tmp/tmp.LDqKVxgZKjtest export SCRATCH_DEV=172.21.15.12:6789:/scratch export SCRATCH_MNT=/tmp/tmp.nhgnHEvCfwscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg==" 2023-07-07T18:16:38.648 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T18:16:38.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/tmp/tmp.XqO9xwZcsPxfstests-dev/ceph.exclude 2023-07-07T18:16:38.714 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo make) 2023-07-07T18:16:38.804 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize -cfi 2023-07-07T18:16:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-07T18:16:39.120 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: copying file './config.guess' 2023-07-07T18:16:39.123 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: copying file './config.sub' 2023-07-07T18:16:39.127 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: copying file './install-sh' 2023-07-07T18:16:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: copying file './ltmain.sh' 2023-07-07T18:16:39.151 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-07T18:16:39.152 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-07T18:16:39.156 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-07T18:16:39.160 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-07T18:16:39.165 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-07T18:16:39.169 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-07T18:16:39.175 INFO:teuthology.orchestra.run.smithi012.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-07T18:16:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:cp include/install-sh . 2023-07-07T18:16:39.177 INFO:teuthology.orchestra.run.smithi012.stdout:aclocal -I m4 2023-07-07T18:16:40.358 INFO:teuthology.orchestra.run.smithi012.stdout:autoheader 2023-07-07T18:16:40.668 INFO:teuthology.orchestra.run.smithi012.stdout:autoconf 2023-07-07T18:16:40.835 INFO:teuthology.orchestra.run.smithi012.stdout:./configure \ 2023-07-07T18:16:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: --libexecdir=/usr/lib \ 2023-07-07T18:16:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: --exec_prefix=/var/lib 2023-07-07T18:16:41.304 INFO:teuthology.orchestra.run.smithi012.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-07T18:16:41.304 INFO:teuthology.orchestra.run.smithi012.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-07T18:16:41.305 INFO:teuthology.orchestra.run.smithi012.stdout:checking how to print strings... printf 2023-07-07T18:16:41.306 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gcc... gcc 2023-07-07T18:16:41.429 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether the C compiler works... yes 2023-07-07T18:16:41.429 INFO:teuthology.orchestra.run.smithi012.stdout:checking for C compiler default output file name... a.out 2023-07-07T18:16:41.458 INFO:teuthology.orchestra.run.smithi012.stdout:checking for suffix of executables... 2023-07-07T18:16:41.501 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether we are cross compiling... no 2023-07-07T18:16:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:checking for suffix of object files... o 2023-07-07T18:16:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether we are using the GNU C compiler... yes 2023-07-07T18:16:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether gcc accepts -g... yes 2023-07-07T18:16:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-07T18:16:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-07T18:16:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-07T18:16:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:checking for egrep... /bin/grep -E 2023-07-07T18:16:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:checking for fgrep... /bin/grep -F 2023-07-07T18:16:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:checking for ld used by gcc... /bin/ld 2023-07-07T18:16:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-07T18:16:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-07T18:16:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-07T18:16:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether ln -s works... yes 2023-07-07T18:16:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:checking the maximum length of command line arguments... 1572864 2023-07-07T18:16:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-07T18:16:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-07T18:16:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:checking for /bin/ld option to reload object files... -r 2023-07-07T18:16:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:checking for objdump... objdump 2023-07-07T18:16:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:checking how to recognize dependent libraries... pass_all 2023-07-07T18:16:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:checking for dlltool... no 2023-07-07T18:16:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-07T18:16:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:checking for ar... ar 2023-07-07T18:16:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:checking for archiver @FILE support... @ 2023-07-07T18:16:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:checking for strip... strip 2023-07-07T18:16:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:checking for ranlib... ranlib 2023-07-07T18:16:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gawk... gawk 2023-07-07T18:16:41.715 INFO:teuthology.orchestra.run.smithi012.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-07T18:16:41.716 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sysroot... no 2023-07-07T18:16:41.719 INFO:teuthology.orchestra.run.smithi012.stdout:checking for a working dd... /bin/dd 2023-07-07T18:16:41.721 INFO:teuthology.orchestra.run.smithi012.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-07T18:16:41.735 INFO:teuthology.orchestra.run.smithi012.stdout:checking for mt... no 2023-07-07T18:16:41.737 INFO:teuthology.orchestra.run.smithi012.stdout:checking if : is a manifest tool... no 2023-07-07T18:16:41.762 INFO:teuthology.orchestra.run.smithi012.stdout:checking how to run the C preprocessor... gcc -E 2023-07-07T18:16:41.878 INFO:teuthology.orchestra.run.smithi012.stdout:checking for ANSI C header files... yes 2023-07-07T18:16:41.898 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/types.h... yes 2023-07-07T18:16:41.922 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/stat.h... yes 2023-07-07T18:16:41.947 INFO:teuthology.orchestra.run.smithi012.stdout:checking for stdlib.h... yes 2023-07-07T18:16:41.971 INFO:teuthology.orchestra.run.smithi012.stdout:checking for string.h... yes 2023-07-07T18:16:41.997 INFO:teuthology.orchestra.run.smithi012.stdout:checking for memory.h... yes 2023-07-07T18:16:42.021 INFO:teuthology.orchestra.run.smithi012.stdout:checking for strings.h... yes 2023-07-07T18:16:42.048 INFO:teuthology.orchestra.run.smithi012.stdout:checking for inttypes.h... yes 2023-07-07T18:16:42.074 INFO:teuthology.orchestra.run.smithi012.stdout:checking for stdint.h... yes 2023-07-07T18:16:42.103 INFO:teuthology.orchestra.run.smithi012.stdout:checking for unistd.h... yes 2023-07-07T18:16:42.129 INFO:teuthology.orchestra.run.smithi012.stdout:checking for dlfcn.h... yes 2023-07-07T18:16:42.132 INFO:teuthology.orchestra.run.smithi012.stdout:checking for objdir... .libs 2023-07-07T18:16:42.199 INFO:teuthology.orchestra.run.smithi012.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-07T18:16:42.200 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-07T18:16:42.215 INFO:teuthology.orchestra.run.smithi012.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-07T18:16:42.235 INFO:teuthology.orchestra.run.smithi012.stdout:checking if gcc static flag -static works... no 2023-07-07T18:16:42.256 INFO:teuthology.orchestra.run.smithi012.stdout:checking if gcc supports -c -o file.o... yes 2023-07-07T18:16:42.256 INFO:teuthology.orchestra.run.smithi012.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-07T18:16:42.262 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-07T18:16:42.287 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether -lc should be explicitly linked in... no 2023-07-07T18:16:42.331 INFO:teuthology.orchestra.run.smithi012.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-07T18:16:42.331 INFO:teuthology.orchestra.run.smithi012.stdout:checking how to hardcode library paths into programs... immediate 2023-07-07T18:16:42.334 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether stripping libraries is possible... yes 2023-07-07T18:16:42.334 INFO:teuthology.orchestra.run.smithi012.stdout:checking if libtool supports shared libraries... yes 2023-07-07T18:16:42.334 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether to build shared libraries... yes 2023-07-07T18:16:42.334 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether to build static libraries... yes 2023-07-07T18:16:42.339 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gcc... (cached) gcc 2023-07-07T18:16:42.354 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-07T18:16:42.355 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-07T18:16:42.355 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-07T18:16:42.355 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gmake... /usr/bin/gmake 2023-07-07T18:16:42.355 INFO:teuthology.orchestra.run.smithi012.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-07-07T18:16:42.356 INFO:teuthology.orchestra.run.smithi012.stdout:checking for tar... /bin/tar 2023-07-07T18:16:42.356 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gzip... /bin/gzip 2023-07-07T18:16:42.363 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether gcc -MM is supported... yes 2023-07-07T18:16:42.364 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sort... /bin/sort 2023-07-07T18:16:42.364 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether ln -s works... yes 2023-07-07T18:16:42.364 INFO:teuthology.orchestra.run.smithi012.stdout:checking for rpm... /bin/rpm 2023-07-07T18:16:42.369 INFO:teuthology.orchestra.run.smithi012.stdout:checking for rpmbuild... no 2023-07-07T18:16:42.399 INFO:teuthology.orchestra.run.smithi012.stdout:checking assert.h usability... yes 2023-07-07T18:16:42.406 INFO:teuthology.orchestra.run.smithi012.stdout:checking assert.h presence... yes 2023-07-07T18:16:42.407 INFO:teuthology.orchestra.run.smithi012.stdout:checking for assert.h... yes 2023-07-07T18:16:42.434 INFO:teuthology.orchestra.run.smithi012.stdout:checking bstring.h usability... no 2023-07-07T18:16:42.443 INFO:teuthology.orchestra.run.smithi012.stdout:checking bstring.h presence... no 2023-07-07T18:16:42.443 INFO:teuthology.orchestra.run.smithi012.stdout:checking for bstring.h... no 2023-07-07T18:16:42.468 INFO:teuthology.orchestra.run.smithi012.stdout:checking libgen.h usability... yes 2023-07-07T18:16:42.475 INFO:teuthology.orchestra.run.smithi012.stdout:checking libgen.h presence... yes 2023-07-07T18:16:42.475 INFO:teuthology.orchestra.run.smithi012.stdout:checking for libgen.h... yes 2023-07-07T18:16:42.504 INFO:teuthology.orchestra.run.smithi012.stdout:checking dirent.h usability... yes 2023-07-07T18:16:42.512 INFO:teuthology.orchestra.run.smithi012.stdout:checking dirent.h presence... yes 2023-07-07T18:16:42.512 INFO:teuthology.orchestra.run.smithi012.stdout:checking for dirent.h... yes 2023-07-07T18:16:42.556 INFO:teuthology.orchestra.run.smithi012.stdout:checking errno.h usability... yes 2023-07-07T18:16:42.563 INFO:teuthology.orchestra.run.smithi012.stdout:checking errno.h presence... yes 2023-07-07T18:16:42.563 INFO:teuthology.orchestra.run.smithi012.stdout:checking for errno.h... yes 2023-07-07T18:16:42.591 INFO:teuthology.orchestra.run.smithi012.stdout:checking malloc.h usability... yes 2023-07-07T18:16:42.599 INFO:teuthology.orchestra.run.smithi012.stdout:checking malloc.h presence... yes 2023-07-07T18:16:42.599 INFO:teuthology.orchestra.run.smithi012.stdout:checking for malloc.h... yes 2023-07-07T18:16:42.626 INFO:teuthology.orchestra.run.smithi012.stdout:checking uuid.h usability... no 2023-07-07T18:16:42.635 INFO:teuthology.orchestra.run.smithi012.stdout:checking uuid.h presence... no 2023-07-07T18:16:42.635 INFO:teuthology.orchestra.run.smithi012.stdout:checking for uuid.h... no 2023-07-07T18:16:42.662 INFO:teuthology.orchestra.run.smithi012.stdout:checking uuid/uuid.h usability... yes 2023-07-07T18:16:42.671 INFO:teuthology.orchestra.run.smithi012.stdout:checking uuid/uuid.h presence... yes 2023-07-07T18:16:42.671 INFO:teuthology.orchestra.run.smithi012.stdout:checking for uuid/uuid.h... yes 2023-07-07T18:16:42.697 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/uuid.h usability... no 2023-07-07T18:16:42.706 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/uuid.h presence... no 2023-07-07T18:16:42.707 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/uuid.h... no 2023-07-07T18:16:42.733 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/file.h usability... yes 2023-07-07T18:16:42.740 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/file.h presence... yes 2023-07-07T18:16:42.741 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/file.h... yes 2023-07-07T18:16:42.770 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/fcntl.h usability... yes 2023-07-07T18:16:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/fcntl.h presence... yes 2023-07-07T18:16:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/fcntl.h... yes 2023-07-07T18:16:42.804 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/syssgi.h usability... no 2023-07-07T18:16:42.813 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/syssgi.h presence... no 2023-07-07T18:16:42.813 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/syssgi.h... no 2023-07-07T18:16:42.858 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/param.h usability... yes 2023-07-07T18:16:42.868 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/param.h presence... yes 2023-07-07T18:16:42.868 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/param.h... yes 2023-07-07T18:16:42.873 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/stat.h... (cached) yes 2023-07-07T18:16:42.901 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/statvfs.h usability... yes 2023-07-07T18:16:42.908 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/statvfs.h presence... yes 2023-07-07T18:16:42.909 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/statvfs.h... yes 2023-07-07T18:16:42.936 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/time.h usability... yes 2023-07-07T18:16:42.943 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/time.h presence... yes 2023-07-07T18:16:42.944 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/time.h... yes 2023-07-07T18:16:42.981 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/ioctl.h usability... yes 2023-07-07T18:16:42.989 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/ioctl.h presence... yes 2023-07-07T18:16:42.989 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/ioctl.h... yes 2023-07-07T18:16:43.018 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/wait.h usability... yes 2023-07-07T18:16:43.027 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/wait.h presence... yes 2023-07-07T18:16:43.028 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/wait.h... yes 2023-07-07T18:16:43.032 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/types.h... (cached) yes 2023-07-07T18:16:43.037 INFO:teuthology.orchestra.run.smithi012.stdout:checking for strings.h... (cached) yes 2023-07-07T18:16:43.068 INFO:teuthology.orchestra.run.smithi012.stdout:checking err.h usability... yes 2023-07-07T18:16:43.074 INFO:teuthology.orchestra.run.smithi012.stdout:checking err.h presence... yes 2023-07-07T18:16:43.075 INFO:teuthology.orchestra.run.smithi012.stdout:checking for err.h... yes 2023-07-07T18:16:43.102 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/falloc.h usability... yes 2023-07-07T18:16:43.108 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/falloc.h presence... yes 2023-07-07T18:16:43.108 INFO:teuthology.orchestra.run.smithi012.stdout:checking for linux/falloc.h... yes 2023-07-07T18:16:43.135 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-07T18:16:43.144 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-07T18:16:43.144 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-07T18:16:43.192 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-07T18:16:43.201 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-07T18:16:43.202 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-07T18:16:43.225 INFO:teuthology.orchestra.run.smithi012.stdout:checking xfs/platform_defs.h usability... no 2023-07-07T18:16:43.234 INFO:teuthology.orchestra.run.smithi012.stdout:checking xfs/platform_defs.h presence... no 2023-07-07T18:16:43.235 INFO:teuthology.orchestra.run.smithi012.stdout:checking for xfs/platform_defs.h... no 2023-07-07T18:16:43.258 INFO:teuthology.orchestra.run.smithi012.stdout:checking btrfs/ioctl.h usability... no 2023-07-07T18:16:43.267 INFO:teuthology.orchestra.run.smithi012.stdout:checking btrfs/ioctl.h presence... no 2023-07-07T18:16:43.268 INFO:teuthology.orchestra.run.smithi012.stdout:checking for btrfs/ioctl.h... no 2023-07-07T18:16:43.291 INFO:teuthology.orchestra.run.smithi012.stdout:checking cifs/ioctl.h usability... no 2023-07-07T18:16:43.300 INFO:teuthology.orchestra.run.smithi012.stdout:checking cifs/ioctl.h presence... no 2023-07-07T18:16:43.301 INFO:teuthology.orchestra.run.smithi012.stdout:checking for cifs/ioctl.h... no 2023-07-07T18:16:43.326 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/mman.h usability... yes 2023-07-07T18:16:43.333 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/mman.h presence... yes 2023-07-07T18:16:43.334 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/mman.h... yes 2023-07-07T18:16:43.349 INFO:teuthology.orchestra.run.smithi012.stdout:checking for xfs/xfs_log_format.h... no 2023-07-07T18:16:43.383 INFO:teuthology.orchestra.run.smithi012.stdout:checking for uuid_compare... no 2023-07-07T18:16:43.414 INFO:teuthology.orchestra.run.smithi012.stdout:checking for uuid_compare in -luuid... yes 2023-07-07T18:16:43.470 INFO:teuthology.orchestra.run.smithi012.stdout:checking for xfs/xfs.h... yes 2023-07-07T18:16:43.484 INFO:teuthology.orchestra.run.smithi012.stdout:checking for xfs/libxfs.h... no 2023-07-07T18:16:43.499 INFO:teuthology.orchestra.run.smithi012.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-07T18:16:43.527 INFO:teuthology.orchestra.run.smithi012.stdout:checking for xfs/xqm.h... yes 2023-07-07T18:16:43.573 INFO:teuthology.orchestra.run.smithi012.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-07T18:16:43.597 INFO:teuthology.orchestra.run.smithi012.stdout:checking xfs/handle.h usability... yes 2023-07-07T18:16:43.603 INFO:teuthology.orchestra.run.smithi012.stdout:checking xfs/handle.h presence... yes 2023-07-07T18:16:43.604 INFO:teuthology.orchestra.run.smithi012.stdout:checking for xfs/handle.h... yes 2023-07-07T18:16:43.639 INFO:teuthology.orchestra.run.smithi012.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-07T18:16:43.669 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/acl.h usability... yes 2023-07-07T18:16:43.678 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/acl.h presence... yes 2023-07-07T18:16:43.678 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/acl.h... yes 2023-07-07T18:16:43.714 INFO:teuthology.orchestra.run.smithi012.stdout:checking acl/libacl.h usability... yes 2023-07-07T18:16:43.723 INFO:teuthology.orchestra.run.smithi012.stdout:checking acl/libacl.h presence... yes 2023-07-07T18:16:43.723 INFO:teuthology.orchestra.run.smithi012.stdout:checking for acl/libacl.h... yes 2023-07-07T18:16:43.755 INFO:teuthology.orchestra.run.smithi012.stdout:checking for acl_init in -lacl... yes 2023-07-07T18:16:43.778 INFO:teuthology.orchestra.run.smithi012.stdout:checking gdbm-ndbm.h usability... no 2023-07-07T18:16:43.788 INFO:teuthology.orchestra.run.smithi012.stdout:checking gdbm-ndbm.h presence... no 2023-07-07T18:16:43.788 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gdbm-ndbm.h... no 2023-07-07T18:16:43.809 INFO:teuthology.orchestra.run.smithi012.stdout:checking gdbm/ndbm.h usability... no 2023-07-07T18:16:43.818 INFO:teuthology.orchestra.run.smithi012.stdout:checking gdbm/ndbm.h presence... no 2023-07-07T18:16:43.819 INFO:teuthology.orchestra.run.smithi012.stdout:checking for gdbm/ndbm.h... no 2023-07-07T18:16:43.840 INFO:teuthology.orchestra.run.smithi012.stdout:checking ndbm.h usability... no 2023-07-07T18:16:43.849 INFO:teuthology.orchestra.run.smithi012.stdout:checking ndbm.h presence... no 2023-07-07T18:16:43.850 INFO:teuthology.orchestra.run.smithi012.stdout:checking for ndbm.h... no 2023-07-07T18:16:43.875 INFO:teuthology.orchestra.run.smithi012.stdout:checking libaio.h usability... yes 2023-07-07T18:16:43.885 INFO:teuthology.orchestra.run.smithi012.stdout:checking libaio.h presence... yes 2023-07-07T18:16:43.886 INFO:teuthology.orchestra.run.smithi012.stdout:checking for libaio.h... yes 2023-07-07T18:16:43.908 INFO:teuthology.orchestra.run.smithi012.stdout:checking liburing.h usability... no 2023-07-07T18:16:43.918 INFO:teuthology.orchestra.run.smithi012.stdout:checking liburing.h presence... no 2023-07-07T18:16:43.918 INFO:teuthology.orchestra.run.smithi012.stdout:checking for liburing.h... no 2023-07-07T18:16:43.939 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/capability.h usability... no 2023-07-07T18:16:43.949 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/capability.h presence... no 2023-07-07T18:16:43.949 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/capability.h... no 2023-07-07T18:16:43.972 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/fiemap.h usability... yes 2023-07-07T18:16:43.979 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/fiemap.h presence... yes 2023-07-07T18:16:43.979 INFO:teuthology.orchestra.run.smithi012.stdout:checking for linux/fiemap.h... yes 2023-07-07T18:16:44.012 INFO:teuthology.orchestra.run.smithi012.stdout:checking for fallocate... yes 2023-07-07T18:16:44.045 INFO:teuthology.orchestra.run.smithi012.stdout:checking for open_by_handle_at... yes 2023-07-07T18:16:44.070 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/prctl.h usability... yes 2023-07-07T18:16:44.077 INFO:teuthology.orchestra.run.smithi012.stdout:checking sys/prctl.h presence... yes 2023-07-07T18:16:44.078 INFO:teuthology.orchestra.run.smithi012.stdout:checking for sys/prctl.h... yes 2023-07-07T18:16:44.102 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/fs.h usability... yes 2023-07-07T18:16:44.109 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/fs.h presence... yes 2023-07-07T18:16:44.109 INFO:teuthology.orchestra.run.smithi012.stdout:checking for linux/fs.h... yes 2023-07-07T18:16:44.131 INFO:teuthology.orchestra.run.smithi012.stdout:checking btrfsutil.h usability... no 2023-07-07T18:16:44.140 INFO:teuthology.orchestra.run.smithi012.stdout:checking btrfsutil.h presence... no 2023-07-07T18:16:44.140 INFO:teuthology.orchestra.run.smithi012.stdout:checking for btrfsutil.h... no 2023-07-07T18:16:44.187 INFO:teuthology.orchestra.run.smithi012.stdout:checking for copy_file_range... yes 2023-07-07T18:16:44.222 INFO:teuthology.orchestra.run.smithi012.stdout:checking for SEEK_DATA... yes 2023-07-07T18:16:44.268 INFO:teuthology.orchestra.run.smithi012.stdout:checking for BMV_OF_SHARED... yes 2023-07-07T18:16:44.304 INFO:teuthology.orchestra.run.smithi012.stdout:checking for nftw... yes 2023-07-07T18:16:44.351 INFO:teuthology.orchestra.run.smithi012.stdout:checking for RLIMIT_NOFILE... yes 2023-07-07T18:16:44.369 INFO:teuthology.orchestra.run.smithi012.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-07T18:16:44.401 INFO:teuthology.orchestra.run.smithi012.stdout:checking for renameat2... yes 2023-07-07T18:16:44.434 INFO:teuthology.orchestra.run.smithi012.stdout:checking for reallocarray... yes 2023-07-07T18:16:44.448 INFO:teuthology.orchestra.run.smithi012.stdout:checking for struct mount_attr... no 2023-07-07T18:16:44.492 INFO:teuthology.orchestra.run.smithi012.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-07T18:16:44.527 INFO:teuthology.orchestra.run.smithi012.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-07T18:16:44.561 INFO:teuthology.orchestra.run.smithi012.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-07T18:16:44.592 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:16:44.595 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:16:44.596 INFO:teuthology.orchestra.run.smithi012.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-07T18:16:44.662 INFO:teuthology.orchestra.run.smithi012.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-07T18:16:44.697 INFO:teuthology.orchestra.run.smithi012.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-07T18:16:44.731 INFO:teuthology.orchestra.run.smithi012.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-07T18:16:44.758 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/btrfs.h usability... yes 2023-07-07T18:16:44.765 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/btrfs.h presence... yes 2023-07-07T18:16:44.765 INFO:teuthology.orchestra.run.smithi012.stdout:checking for linux/btrfs.h... yes 2023-07-07T18:16:44.798 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-07T18:16:44.805 INFO:teuthology.orchestra.run.smithi012.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-07T18:16:44.806 INFO:teuthology.orchestra.run.smithi012.stdout:checking for linux/btrfs_tree.h... yes 2023-07-07T18:16:44.836 INFO:teuthology.orchestra.run.smithi012.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-07T18:16:44.853 INFO:teuthology.orchestra.run.smithi012.stdout:configure: creating ./config.status 2023-07-07T18:16:45.157 INFO:teuthology.orchestra.run.smithi012.stdout:config.status: creating include/builddefs 2023-07-07T18:16:45.168 INFO:teuthology.orchestra.run.smithi012.stdout:config.status: creating include/config.h 2023-07-07T18:16:45.176 INFO:teuthology.orchestra.run.smithi012.stdout:config.status: executing libtool commands 2023-07-07T18:16:45.213 INFO:teuthology.orchestra.run.smithi012.stdout:Building include 2023-07-07T18:16:45.217 INFO:teuthology.orchestra.run.smithi012.stdout:Building lib 2023-07-07T18:16:45.219 INFO:teuthology.orchestra.run.smithi012.stdout: [LTDEP] 2023-07-07T18:16:45.325 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] dataascii.lo 2023-07-07T18:16:45.440 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] databin.lo 2023-07-07T18:16:45.582 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] datapid.lo 2023-07-07T18:16:45.681 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] file_lock.lo 2023-07-07T18:16:45.823 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] forker.lo 2023-07-07T18:16:45.951 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] pattern.lo 2023-07-07T18:16:46.067 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] open_flags.lo 2023-07-07T18:16:46.203 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] random_range.lo 2023-07-07T18:16:46.418 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] string_to_tokens.lo 2023-07-07T18:16:46.519 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] str_to_bytes.lo 2023-07-07T18:16:46.644 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] tlibio.lo 2023-07-07T18:16:46.865 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] write_log.lo 2023-07-07T18:16:47.093 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] random.lo 2023-07-07T18:16:47.207 INFO:teuthology.orchestra.run.smithi012.stdout: [LD] 2023-07-07T18:16:47.279 INFO:teuthology.orchestra.run.smithi012.stdout:Building ltp 2023-07-07T18:16:47.281 INFO:teuthology.orchestra.run.smithi012.stdout: [DEP] 2023-07-07T18:16:47.392 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] doio 2023-07-07T18:16:48.009 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fsstress 2023-07-07T18:16:49.254 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fsx 2023-07-07T18:16:50.074 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] growfiles 2023-07-07T18:16:50.555 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] iogen 2023-07-07T18:16:50.887 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-stress 2023-07-07T18:16:51.280 INFO:teuthology.orchestra.run.smithi012.stdout:Building src 2023-07-07T18:16:51.285 INFO:teuthology.orchestra.run.smithi012.stdout: [DEP] 2023-07-07T18:16:52.641 INFO:teuthology.orchestra.run.smithi012.stdout: [DEP] 2023-07-07T18:16:52.667 INFO:teuthology.orchestra.run.smithi012.stdout: [DEP] 2023-07-07T18:16:52.674 INFO:teuthology.orchestra.run.smithi012.stdout: [DEP] 2023-07-07T18:16:52.863 INFO:teuthology.orchestra.run.smithi012.stdout: [DEP] 2023-07-07T18:16:52.884 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] dirstress 2023-07-07T18:16:53.105 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fill 2023-07-07T18:16:53.249 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fill2 2023-07-07T18:16:53.470 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] getpagesize 2023-07-07T18:16:53.623 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] holes 2023-07-07T18:16:53.805 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] lstat64 2023-07-07T18:16:53.976 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] nametest 2023-07-07T18:16:54.200 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] permname 2023-07-07T18:16:54.385 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] randholes 2023-07-07T18:16:54.617 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] runas 2023-07-07T18:16:54.782 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] truncfile 2023-07-07T18:16:54.950 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] usemem 2023-07-07T18:16:55.091 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] mmapcat 2023-07-07T18:16:55.231 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] append_reader 2023-07-07T18:16:55.373 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] append_writer 2023-07-07T18:16:55.515 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] dirperf 2023-07-07T18:16:55.720 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] metaperf 2023-07-07T18:16:55.958 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] devzero 2023-07-07T18:16:56.122 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] feature 2023-07-07T18:16:56.323 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] alloc 2023-07-07T18:16:56.519 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fault 2023-07-07T18:16:56.672 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fstest 2023-07-07T18:16:56.894 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_access_root 2023-07-07T18:16:57.039 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] godown 2023-07-07T18:16:57.199 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] resvtest 2023-07-07T18:16:57.372 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] writemod 2023-07-07T18:16:57.509 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] writev_on_pagefault 2023-07-07T18:16:57.658 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] makeextents 2023-07-07T18:16:57.826 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] itrash 2023-07-07T18:16:57.974 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] rename 2023-07-07T18:16:58.106 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] multi_open_unlink 2023-07-07T18:16:58.260 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] unwritten_sync 2023-07-07T18:16:58.431 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] genhashnames 2023-07-07T18:16:58.607 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_holes 2023-07-07T18:16:58.746 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mmap_writev 2023-07-07T18:16:58.886 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_truncate_cmtime 2023-07-07T18:16:59.045 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] dirhash_collide 2023-07-07T18:16:59.215 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_rename_overwrite 2023-07-07T18:16:59.348 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] holetest 2023-07-07T18:16:59.553 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_truncate_self 2023-07-07T18:16:59.703 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] af_unix 2023-07-07T18:16:59.847 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mmap_stale_pmd 2023-07-07T18:16:59.990 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mmap_cow_race 2023-07-07T18:17:00.145 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mmap_fallocate 2023-07-07T18:17:00.287 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fsync-err 2023-07-07T18:17:00.460 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mmap_write_ro 2023-07-07T18:17:00.603 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-07T18:17:00.754 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-07T18:17:00.899 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_ofd_locks 2023-07-07T18:17:01.087 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mmap_collision 2023-07-07T18:17:01.271 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] mmap-write-concurrent 2023-07-07T18:17:01.431 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_get_file_time 2023-07-07T18:17:01.570 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_create_short_dirs 2023-07-07T18:17:01.727 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_create_long_dirs 2023-07-07T18:17:01.881 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_enospc 2023-07-07T18:17:02.056 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mmap_writev_overlap 2023-07-07T18:17:02.214 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] checkpoint_journal 2023-07-07T18:17:02.360 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] mmap-rw-fault 2023-07-07T18:17:02.527 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] allocstale 2023-07-07T18:17:02.685 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mmap_cow_memory_failure 2023-07-07T18:17:02.845 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fake-dump-rootino 2023-07-07T18:17:02.986 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] dio-buf-fault 2023-07-07T18:17:03.132 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] xfsctl 2023-07-07T18:17:03.308 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] bstat 2023-07-07T18:17:03.498 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mtab 2023-07-07T18:17:03.670 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] getdevicesize 2023-07-07T18:17:03.805 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] preallo_rw_pattern_reader 2023-07-07T18:17:03.955 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] preallo_rw_pattern_writer 2023-07-07T18:17:04.103 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] ftrunc 2023-07-07T18:17:04.243 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] trunc 2023-07-07T18:17:04.395 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fs_perms 2023-07-07T18:17:04.551 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] testx 2023-07-07T18:17:04.783 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] looptest 2023-07-07T18:17:04.964 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] locktest 2023-07-07T18:17:05.251 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] unwritten_mmap 2023-07-07T18:17:05.404 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] bulkstat_unlink_test 2023-07-07T18:17:05.591 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] deduperace 2023-07-07T18:17:05.775 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] bulkstat_unlink_test_modified 2023-07-07T18:17:05.959 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_dir_offset 2023-07-07T18:17:06.101 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_futimens 2023-07-07T18:17:06.235 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_immutable 2023-07-07T18:17:06.806 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] stale_handle 2023-07-07T18:17:06.965 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] pwrite_mmap_blocked 2023-07-07T18:17:07.109 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_dir_offset2 2023-07-07T18:17:07.289 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] seek_sanity_test 2023-07-07T18:17:07.677 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] seek_copy_test 2023-07-07T18:17:07.844 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_readdir_1 2023-07-07T18:17:07.984 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_readdir_2 2023-07-07T18:17:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fsync-tester 2023-07-07T18:17:08.359 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] nsexec 2023-07-07T18:17:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] cloner 2023-07-07T18:17:08.693 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] renameat2 2023-07-07T18:17:08.851 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_getcwd 2023-07-07T18:17:09.000 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] e4compact 2023-07-07T18:17:09.189 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] test-nextquota 2023-07-07T18:17:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] punch-alternating 2023-07-07T18:17:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-07T18:17:09.667 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] listxattr 2023-07-07T18:17:09.864 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] dio-interleaved 2023-07-07T18:17:10.015 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_dir_type 2023-07-07T18:17:10.162 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] dio-invalidate-cache 2023-07-07T18:17:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] stat_test 2023-07-07T18:17:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_encrypted_d_revalidate 2023-07-07T18:17:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] attr_replace_test 2023-07-07T18:17:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] swapon 2023-07-07T18:17:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] mkswap 2023-07-07T18:17:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_attr_corruption 2023-07-07T18:17:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_open_tmpfiles 2023-07-07T18:17:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fscrypt-crypt-util 2023-07-07T18:17:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] bulkstat_null_ocount 2023-07-07T18:17:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] splice-test 2023-07-07T18:17:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] chprojid_fail 2023-07-07T18:17:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] detached_mounts_propagation 2023-07-07T18:17:12.796 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] ext4_resize 2023-07-07T18:17:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_readdir_3 2023-07-07T18:17:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] splice2pipe 2023-07-07T18:17:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] uuid_ioctl 2023-07-07T18:17:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fiemap-tester 2023-07-07T18:17:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_stripealign 2023-07-07T18:17:13.817 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] open_by_handle 2023-07-07T18:17:14.057 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] t_mmap_dio 2023-07-07T18:17:14.209 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] xfsfind 2023-07-07T18:17:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] fssum 2023-07-07T18:17:14.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:17:14.664 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:17:14.802 INFO:teuthology.orchestra.run.smithi012.stdout:Building log-writes 2023-07-07T18:17:14.807 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] replay-log 2023-07-07T18:17:15.098 INFO:teuthology.orchestra.run.smithi012.stdout:Building perf 2023-07-07T18:17:15.101 INFO:teuthology.orchestra.run.smithi012.stdout:Building aio-dio-regress 2023-07-07T18:17:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-07T18:17:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-fcntl-race 2023-07-07T18:17:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-subblock-eof-read 2023-07-07T18:17:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-append-write-read-race 2023-07-07T18:17:15.734 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-invalidate-readahead 2023-07-07T18:17:15.891 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-write-verify 2023-07-07T18:17:16.075 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-07T18:17:16.206 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-last-ref-held-by-io 2023-07-07T18:17:16.373 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-cycle-write 2023-07-07T18:17:16.550 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-extend-stat 2023-07-07T18:17:16.708 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-07T18:17:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-hole-filling-race 2023-07-07T18:17:16.983 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-invalidate-failure 2023-07-07T18:17:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aiodio_sparse2 2023-07-07T18:17:17.342 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aiocp 2023-07-07T18:17:17.555 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-cow-race 2023-07-07T18:17:17.703 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] aio-dio-eof-race 2023-07-07T18:17:17.880 INFO:teuthology.orchestra.run.smithi012.stdout:Building vfs 2023-07-07T18:17:17.885 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] vfstest 2023-07-07T18:17:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: [CC] mount-idmapped 2023-07-07T18:17:19.985 INFO:teuthology.orchestra.run.smithi012.stdout:Building m4 2023-07-07T18:17:19.989 INFO:teuthology.orchestra.run.smithi012.stdout:Building common 2023-07-07T18:17:19.992 INFO:teuthology.orchestra.run.smithi012.stdout:Building tests 2023-07-07T18:17:19.997 INFO:teuthology.orchestra.run.smithi012.stdout:Building perf 2023-07-07T18:17:20.002 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/perf/group.list 2023-07-07T18:17:20.013 INFO:teuthology.orchestra.run.smithi012.stdout:Building ext4 2023-07-07T18:17:20.018 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/ext4/group.list 2023-07-07T18:17:20.053 INFO:teuthology.orchestra.run.smithi012.stdout:Building ocfs2 2023-07-07T18:17:20.058 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/ocfs2/group.list 2023-07-07T18:17:20.070 INFO:teuthology.orchestra.run.smithi012.stdout:Building overlay 2023-07-07T18:17:20.076 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/overlay/group.list 2023-07-07T18:17:20.111 INFO:teuthology.orchestra.run.smithi012.stdout:Building cifs 2023-07-07T18:17:20.116 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/cifs/group.list 2023-07-07T18:17:20.127 INFO:teuthology.orchestra.run.smithi012.stdout:Building generic 2023-07-07T18:17:20.133 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/generic/group.list 2023-07-07T18:17:20.226 INFO:teuthology.orchestra.run.smithi012.stdout:Building shared 2023-07-07T18:17:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/shared/group.list 2023-07-07T18:17:20.247 INFO:teuthology.orchestra.run.smithi012.stdout:Building nfs 2023-07-07T18:17:20.251 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/nfs/group.list 2023-07-07T18:17:20.265 INFO:teuthology.orchestra.run.smithi012.stdout:Building f2fs 2023-07-07T18:17:20.269 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/f2fs/group.list 2023-07-07T18:17:20.285 INFO:teuthology.orchestra.run.smithi012.stdout:Building udf 2023-07-07T18:17:20.290 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/udf/group.list 2023-07-07T18:17:20.301 INFO:teuthology.orchestra.run.smithi012.stdout:Building ceph 2023-07-07T18:17:20.306 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/ceph/group.list 2023-07-07T18:17:20.319 INFO:teuthology.orchestra.run.smithi012.stdout:Building xfs 2023-07-07T18:17:20.325 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/xfs/group.list 2023-07-07T18:17:20.418 INFO:teuthology.orchestra.run.smithi012.stdout:Building btrfs 2023-07-07T18:17:20.424 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/btrfs/group.list 2023-07-07T18:17:20.479 INFO:teuthology.orchestra.run.smithi012.stdout:Building tmpfs 2023-07-07T18:17:20.483 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/tmpfs/group.list 2023-07-07T18:17:20.495 INFO:teuthology.orchestra.run.smithi012.stdout:Building selftest 2023-07-07T18:17:20.500 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/selftest/group.list 2023-07-07T18:17:20.513 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo make install) 2023-07-07T18:17:20.550 INFO:teuthology.orchestra.run.smithi012.stdout:Building include 2023-07-07T18:17:20.554 INFO:teuthology.orchestra.run.smithi012.stdout:Building lib 2023-07-07T18:17:20.557 INFO:teuthology.orchestra.run.smithi012.stdout:Building ltp 2023-07-07T18:17:20.562 INFO:teuthology.orchestra.run.smithi012.stdout:Building src 2023-07-07T18:17:20.595 INFO:teuthology.orchestra.run.smithi012.stdout:Building log-writes 2023-07-07T18:17:20.598 INFO:teuthology.orchestra.run.smithi012.stdout:Building perf 2023-07-07T18:17:20.601 INFO:teuthology.orchestra.run.smithi012.stdout:Building aio-dio-regress 2023-07-07T18:17:20.605 INFO:teuthology.orchestra.run.smithi012.stdout:Building vfs 2023-07-07T18:17:20.609 INFO:teuthology.orchestra.run.smithi012.stdout:Building m4 2023-07-07T18:17:20.612 INFO:teuthology.orchestra.run.smithi012.stdout:Building common 2023-07-07T18:17:20.616 INFO:teuthology.orchestra.run.smithi012.stdout:Building tests 2023-07-07T18:17:20.621 INFO:teuthology.orchestra.run.smithi012.stdout:Building perf 2023-07-07T18:17:20.626 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/perf/group.list 2023-07-07T18:17:20.636 INFO:teuthology.orchestra.run.smithi012.stdout:Building ext4 2023-07-07T18:17:20.642 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/ext4/group.list 2023-07-07T18:17:20.676 INFO:teuthology.orchestra.run.smithi012.stdout:Building ocfs2 2023-07-07T18:17:20.681 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/ocfs2/group.list 2023-07-07T18:17:20.694 INFO:teuthology.orchestra.run.smithi012.stdout:Building overlay 2023-07-07T18:17:20.699 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/overlay/group.list 2023-07-07T18:17:20.734 INFO:teuthology.orchestra.run.smithi012.stdout:Building cifs 2023-07-07T18:17:20.739 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/cifs/group.list 2023-07-07T18:17:20.750 INFO:teuthology.orchestra.run.smithi012.stdout:Building generic 2023-07-07T18:17:20.757 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/generic/group.list 2023-07-07T18:17:20.848 INFO:teuthology.orchestra.run.smithi012.stdout:Building shared 2023-07-07T18:17:20.853 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/shared/group.list 2023-07-07T18:17:20.869 INFO:teuthology.orchestra.run.smithi012.stdout:Building nfs 2023-07-07T18:17:20.874 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/nfs/group.list 2023-07-07T18:17:20.887 INFO:teuthology.orchestra.run.smithi012.stdout:Building f2fs 2023-07-07T18:17:20.892 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/f2fs/group.list 2023-07-07T18:17:20.908 INFO:teuthology.orchestra.run.smithi012.stdout:Building udf 2023-07-07T18:17:20.913 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/udf/group.list 2023-07-07T18:17:20.923 INFO:teuthology.orchestra.run.smithi012.stdout:Building ceph 2023-07-07T18:17:20.929 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/ceph/group.list 2023-07-07T18:17:20.941 INFO:teuthology.orchestra.run.smithi012.stdout:Building xfs 2023-07-07T18:17:20.948 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/xfs/group.list 2023-07-07T18:17:21.040 INFO:teuthology.orchestra.run.smithi012.stdout:Building btrfs 2023-07-07T18:17:21.046 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/btrfs/group.list 2023-07-07T18:17:21.100 INFO:teuthology.orchestra.run.smithi012.stdout:Building tmpfs 2023-07-07T18:17:21.105 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/tmpfs/group.list 2023-07-07T18:17:21.117 INFO:teuthology.orchestra.run.smithi012.stdout:Building selftest 2023-07-07T18:17:21.122 INFO:teuthology.orchestra.run.smithi012.stdout: [GROUP] /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/selftest/group.list 2023-07-07T18:17:21.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-07-07T18:17:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-07T18:17:21.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-07-07T18:17:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-07T18:17:21.137 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-07-07T18:17:21.139 INFO:teuthology.orchestra.run.smithi012.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-07T18:17:21.148 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-07T18:17:21.226 INFO:teuthology.orchestra.run.smithi012.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-07T18:17:21.235 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-07-07T18:17:21.252 INFO:teuthology.orchestra.run.smithi012.stdout:Building log-writes 2023-07-07T18:17:21.255 INFO:teuthology.orchestra.run.smithi012.stdout:Building perf 2023-07-07T18:17:21.258 INFO:teuthology.orchestra.run.smithi012.stdout:Building aio-dio-regress 2023-07-07T18:17:21.262 INFO:teuthology.orchestra.run.smithi012.stdout:Building vfs 2023-07-07T18:17:21.265 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake -C log-writes install 2023-07-07T18:17:21.267 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-07T18:17:21.275 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-07T18:17:21.285 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake -C perf install 2023-07-07T18:17:21.286 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-07T18:17:21.295 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-07T18:17:21.318 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-07-07T18:17:21.320 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-07T18:17:21.329 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-07T18:17:21.384 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake -C vfs install 2023-07-07T18:17:21.386 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-07T18:17:21.394 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-07T18:17:21.407 INFO:teuthology.orchestra.run.smithi012.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-07T18:17:21.416 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-07T18:17:22.643 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-07T18:17:22.739 INFO:teuthology.orchestra.run.smithi012.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-07T18:17:22.770 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-07-07T18:17:22.771 INFO:teuthology.orchestra.run.smithi012.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-07T18:17:22.772 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-07-07T18:17:22.773 INFO:teuthology.orchestra.run.smithi012.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-07T18:17:22.782 INFO:teuthology.orchestra.run.smithi012.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-07T18:17:22.919 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-07-07T18:17:22.921 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/btrfs/ install 2023-07-07T18:17:22.923 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-07T18:17:22.933 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-07-07T18:17:23.756 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-07T18:17:23.765 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 057.out 175.out 186.out 240.out 069.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 177.out 194.out 234.out 249.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 264.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 209.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 250.out 191.out 281.out 046.out 051.out 244.out 219.out 119.out 019.out 128.out 232.out 248.out 162.out 147.out 197.out 196.out 242.out 004.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 233.out 066.out 029.out 229.out 103.out 254.out 111.out 011.out 243.out 275.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 118.out 287.out 067.out 010.out 238.out 138.out 095.out 184.out 160.out 190.out 291.out 081.out 024.out 071.out 061.out 047.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 003.out 211.out 158.out 085.out 146.out 188.out 104.out 089.out 086.out 279.out 225.out 174.out 156.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 053.out 164.out 239.out 241.out 002.out 178.out 141.out 214.out 114.out 074.out 056.out 012.out 041.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 091.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 131.out 213.out 113.out 013.out 031.out 182.out 272.out 078.out 173.out 259.out 210.out 132.out 037.out 093.out 235.out 127.out 230.out 166.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 245.out 145.out 159.out 122.out 076.out 022.out 006.out 284.out 299.out 224.out 154.out 276.out 149.out 064.out 218.out 018.out 168.out 007.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 268.out 253.out 255.out 090.out 221.out 087.out 212.out 112.out 256.out 021.out 247.out 028.out 107.out /var/lib/xfstests/tests/btrfs 2023-07-07T18:17:24.591 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/ceph/ install 2023-07-07T18:17:24.593 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-07T18:17:24.602 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-07T18:17:24.622 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-07T18:17:24.630 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-07T18:17:24.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/cifs/ install 2023-07-07T18:17:24.652 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-07T18:17:24.661 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-07T18:17:24.670 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-07T18:17:24.679 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-07T18:17:24.688 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/ext4/ install 2023-07-07T18:17:24.690 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-07T18:17:24.699 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-07T18:17:24.896 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-07T18:17:24.905 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-07-07T18:17:25.111 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/f2fs/ install 2023-07-07T18:17:25.113 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-07T18:17:25.122 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-07T18:17:25.134 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-07T18:17:25.142 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-07T18:17:25.154 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/generic/ install 2023-07-07T18:17:25.158 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-07T18:17:25.167 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 /var/lib/xfstests/tests/generic 2023-07-07T18:17:27.239 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-07T18:17:27.248 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 476.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 342.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-07-07T18:17:29.349 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/nfs/ install 2023-07-07T18:17:29.351 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-07T18:17:29.360 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-07T18:17:29.369 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-07T18:17:29.378 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-07T18:17:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/ocfs2/ install 2023-07-07T18:17:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-07T18:17:29.397 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-07T18:17:29.406 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-07T18:17:29.415 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-07T18:17:29.424 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/overlay/ install 2023-07-07T18:17:29.426 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-07T18:17:29.435 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-07T18:17:29.710 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-07T18:17:29.719 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 065.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 035.out 108.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 103.out 033.out 066.out 040.out 056.out 075.out /var/lib/xfstests/tests/overlay 2023-07-07T18:17:29.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/perf/ install 2023-07-07T18:17:30.000 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-07T18:17:30.008 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-07T18:17:30.017 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-07T18:17:30.026 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-07T18:17:30.036 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/selftest/ install 2023-07-07T18:17:30.037 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-07T18:17:30.046 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-07T18:17:30.069 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-07T18:17:30.078 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-07T18:17:30.101 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/shared/ install 2023-07-07T18:17:30.103 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-07T18:17:30.111 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-07T18:17:30.126 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-07T18:17:30.135 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-07T18:17:30.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/tmpfs/ install 2023-07-07T18:17:30.151 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-07T18:17:30.160 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-07T18:17:30.169 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-07T18:17:30.178 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-07T18:17:30.187 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/udf/ install 2023-07-07T18:17:30.189 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-07T18:17:30.198 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-07T18:17:30.206 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-07T18:17:30.215 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-07T18:17:30.224 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.XqO9xwZcsPxfstests-dev/tests/xfs/ install 2023-07-07T18:17:30.228 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-07T18:17:30.237 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-07T18:17:32.186 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-07T18:17:32.195 INFO:teuthology.orchestra.run.smithi012.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 040.out 304.out 349.out 457.out 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 746.out 110.out 468.out 018.out 593.out 571.out 567.out 592.out 282.out 267.out 728.out 178.out 799.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 247.out 273.out 474.out 109.out 595.out 506.out 732.out 268.out 035.out 113.out 532.out 591.out 281.out 471.out 723.out 519.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 503.out 526.out 329.out 165.out 229.out 103.out 129.out 371.out 234.out 738.out 078.out 718.out 143.out 716.out 161.out 516.out 416.out 116.out 043.out 155.out 338.out 067.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 017.out 542.out 211.out 783.out 485.out 442.out 099.out 177.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 758.out 278.out 058.out 741.out 384.out 773.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 755.out 364.out 209.out 441.out 440.out 157.out 740.out 356.out 197.out 341.out 187.out 094.out 241.out 501.out 089.out 540.out 365.out 514.out 414.out 314.out 214.out 381.out 056.out 041.out 340.out 793.out 358.out 572.out 568.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 265.out 508.out 408.out 308.out 208.out 737.out 204.out 535.out 104.out 733.out 544.out 059.out 249.out 335.out 142.out 235.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 316.out 169.out 579.out 297.out 393.out 333.out 476.out 087.out 199.out 739.out 068.out 233.out 752.out 736.out 443.out 086.out 053.out 749.out 279.out 276.out 711.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 458.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 186.out 452.out 069.out 252.out 585.out 751.out 724.out 206.out 190.out 794.out 348.out 184.out 435.out 466.out 248.out 725.out 785.out 482.out 750.out 525.out 496.out 325.out 176.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 430.out 583.out 305.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 465.out 395.out 515.out 415.out 389.out 315.out 215.out 115.out 015.out 027.out 250.out 344.out 046.out 051.out 536.out 254.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 005.out 036.out 198.out 008.out 390.out 405.out 588.out 205.out 105.out 367.out 291.out 437.out 719.out 323.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 766.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 232.out 478.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 492.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 044.out 014.out 362.out 387.out 594.out 438.out 721.out 289.out 574.out 284.out 548.out 299.out 419.out 521.out 581.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 345.out 126.out 025.out 121.out 447.out 761.out 580.out 013.out 347.out 275.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 747.out 558.out 162.out 147.out 288.out 050.out 396.out 576.out 350.out 354.out 298.out 301.out 360.out 543.out 261.out 734.out 045.out 292.out 255.out 729.out 378.out 346.out 048.out 062.out 529.out 231.out 343.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 484.out 491.out 767.out 016.out 488.out 731.out 782.out 374.out 285.out 127.out 328.out 260.out 359.out 531.out 376.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 024.out 513.out 131.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 454.out 259.out 449.out 327.out 330.out 777.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 003.out 355.out 386.out 560.out 055.out 245.out 243.out 522.out 787.out 745.out 422.out 394.out 159.out 539.out 524.out 122.out 022.out 424.out 779.out 490.out 795.out 353.out 423.out 134.out 154.out 764.out 271.out 518.out 418.out 318.out 077.out 218.out 118.out 757.out 377.out 172.out 034.out 079.out 469.out 054.out 049.out 765.out 021.out 002.out 456.out 180.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 195.out 283.out 554.out 397.out 185.out 373.out 720.out 481.out 196.out 520.out 242.out 026.out 420.out 188.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 429.out 417.out 317.out 217.out 117.out 475.out 072.out 778.out 097.out 038.out 084.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 257.out 194.out 170.out 133.out 286.out 756.out 175.out 545.out 714.out 559.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 081.out 083.out 800.out 064.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 446.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 009.out 391.out 004.out 557.out 453.out 236.out 566.out 582.out 735.out 383.out 085.out 334.out 504.out 404.out 776.out /var/lib/xfstests/tests/xfs 2023-07-07T18:17:34.177 INFO:teuthology.orchestra.run.smithi012.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-07T18:17:34.186 INFO:teuthology.orchestra.run.smithi012.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-07T18:17:34.195 INFO:teuthology.orchestra.run.smithi012.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-07T18:17:34.204 INFO:teuthology.orchestra.run.smithi012.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-07T18:17:34.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T18:17:34.216 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec ls tests/generic) 2023-07-07T18:17:34.273 INFO:teuthology.orchestra.run.smithi012.stdout:001 2023-07-07T18:17:34.273 INFO:teuthology.orchestra.run.smithi012.stdout:001.out 2023-07-07T18:17:34.273 INFO:teuthology.orchestra.run.smithi012.stdout:002 2023-07-07T18:17:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:002.out 2023-07-07T18:17:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:003 2023-07-07T18:17:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:003.out 2023-07-07T18:17:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:004 2023-07-07T18:17:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:004.out 2023-07-07T18:17:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:005 2023-07-07T18:17:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:005.out 2023-07-07T18:17:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:006 2023-07-07T18:17:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:006.out 2023-07-07T18:17:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:007 2023-07-07T18:17:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:007.out 2023-07-07T18:17:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:008 2023-07-07T18:17:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:008.out 2023-07-07T18:17:34.275 INFO:teuthology.orchestra.run.smithi012.stdout:009 2023-07-07T18:17:34.276 INFO:teuthology.orchestra.run.smithi012.stdout:009.out 2023-07-07T18:17:34.276 INFO:teuthology.orchestra.run.smithi012.stdout:010 2023-07-07T18:17:34.276 INFO:teuthology.orchestra.run.smithi012.stdout:010.out 2023-07-07T18:17:34.277 INFO:teuthology.orchestra.run.smithi012.stdout:011 2023-07-07T18:17:34.277 INFO:teuthology.orchestra.run.smithi012.stdout:011.out 2023-07-07T18:17:34.277 INFO:teuthology.orchestra.run.smithi012.stdout:012 2023-07-07T18:17:34.277 INFO:teuthology.orchestra.run.smithi012.stdout:012.out 2023-07-07T18:17:34.278 INFO:teuthology.orchestra.run.smithi012.stdout:013 2023-07-07T18:17:34.278 INFO:teuthology.orchestra.run.smithi012.stdout:013.out 2023-07-07T18:17:34.278 INFO:teuthology.orchestra.run.smithi012.stdout:014 2023-07-07T18:17:34.278 INFO:teuthology.orchestra.run.smithi012.stdout:014.out 2023-07-07T18:17:34.279 INFO:teuthology.orchestra.run.smithi012.stdout:015 2023-07-07T18:17:34.279 INFO:teuthology.orchestra.run.smithi012.stdout:015.out 2023-07-07T18:17:34.279 INFO:teuthology.orchestra.run.smithi012.stdout:016 2023-07-07T18:17:34.280 INFO:teuthology.orchestra.run.smithi012.stdout:016.out 2023-07-07T18:17:34.280 INFO:teuthology.orchestra.run.smithi012.stdout:017 2023-07-07T18:17:34.280 INFO:teuthology.orchestra.run.smithi012.stdout:017.out 2023-07-07T18:17:34.281 INFO:teuthology.orchestra.run.smithi012.stdout:018 2023-07-07T18:17:34.281 INFO:teuthology.orchestra.run.smithi012.stdout:018.out 2023-07-07T18:17:34.281 INFO:teuthology.orchestra.run.smithi012.stdout:019 2023-07-07T18:17:34.282 INFO:teuthology.orchestra.run.smithi012.stdout:019.out 2023-07-07T18:17:34.282 INFO:teuthology.orchestra.run.smithi012.stdout:020 2023-07-07T18:17:34.282 INFO:teuthology.orchestra.run.smithi012.stdout:020.out 2023-07-07T18:17:34.282 INFO:teuthology.orchestra.run.smithi012.stdout:021 2023-07-07T18:17:34.282 INFO:teuthology.orchestra.run.smithi012.stdout:021.out 2023-07-07T18:17:34.283 INFO:teuthology.orchestra.run.smithi012.stdout:022 2023-07-07T18:17:34.283 INFO:teuthology.orchestra.run.smithi012.stdout:022.out 2023-07-07T18:17:34.283 INFO:teuthology.orchestra.run.smithi012.stdout:023 2023-07-07T18:17:34.283 INFO:teuthology.orchestra.run.smithi012.stdout:023.out 2023-07-07T18:17:34.283 INFO:teuthology.orchestra.run.smithi012.stdout:024 2023-07-07T18:17:34.283 INFO:teuthology.orchestra.run.smithi012.stdout:024.out 2023-07-07T18:17:34.283 INFO:teuthology.orchestra.run.smithi012.stdout:025 2023-07-07T18:17:34.283 INFO:teuthology.orchestra.run.smithi012.stdout:025.out 2023-07-07T18:17:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:026 2023-07-07T18:17:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:026.out 2023-07-07T18:17:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:027 2023-07-07T18:17:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:027.out 2023-07-07T18:17:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:028 2023-07-07T18:17:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:028.out 2023-07-07T18:17:34.284 INFO:teuthology.orchestra.run.smithi012.stdout:029 2023-07-07T18:17:34.285 INFO:teuthology.orchestra.run.smithi012.stdout:029.out 2023-07-07T18:17:34.285 INFO:teuthology.orchestra.run.smithi012.stdout:030 2023-07-07T18:17:34.285 INFO:teuthology.orchestra.run.smithi012.stdout:030.out 2023-07-07T18:17:34.285 INFO:teuthology.orchestra.run.smithi012.stdout:031 2023-07-07T18:17:34.285 INFO:teuthology.orchestra.run.smithi012.stdout:031.out 2023-07-07T18:17:34.285 INFO:teuthology.orchestra.run.smithi012.stdout:032 2023-07-07T18:17:34.285 INFO:teuthology.orchestra.run.smithi012.stdout:032.out 2023-07-07T18:17:34.285 INFO:teuthology.orchestra.run.smithi012.stdout:033 2023-07-07T18:17:34.286 INFO:teuthology.orchestra.run.smithi012.stdout:033.out 2023-07-07T18:17:34.286 INFO:teuthology.orchestra.run.smithi012.stdout:034 2023-07-07T18:17:34.286 INFO:teuthology.orchestra.run.smithi012.stdout:034.out 2023-07-07T18:17:34.286 INFO:teuthology.orchestra.run.smithi012.stdout:035 2023-07-07T18:17:34.286 INFO:teuthology.orchestra.run.smithi012.stdout:035.cfg 2023-07-07T18:17:34.286 INFO:teuthology.orchestra.run.smithi012.stdout:035.out.default 2023-07-07T18:17:34.286 INFO:teuthology.orchestra.run.smithi012.stdout:035.out.nfs 2023-07-07T18:17:34.286 INFO:teuthology.orchestra.run.smithi012.stdout:036 2023-07-07T18:17:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:036.out 2023-07-07T18:17:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:037 2023-07-07T18:17:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:037.out 2023-07-07T18:17:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:038 2023-07-07T18:17:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:038.out 2023-07-07T18:17:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:039 2023-07-07T18:17:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:039.out 2023-07-07T18:17:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:040 2023-07-07T18:17:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:040.out 2023-07-07T18:17:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:041 2023-07-07T18:17:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:041.out 2023-07-07T18:17:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:042 2023-07-07T18:17:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:042.out 2023-07-07T18:17:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:043 2023-07-07T18:17:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:043.out 2023-07-07T18:17:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:044 2023-07-07T18:17:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:044.out 2023-07-07T18:17:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:045 2023-07-07T18:17:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:045.out 2023-07-07T18:17:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:046 2023-07-07T18:17:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:046.out 2023-07-07T18:17:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:047 2023-07-07T18:17:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:047.out 2023-07-07T18:17:34.290 INFO:teuthology.orchestra.run.smithi012.stdout:048 2023-07-07T18:17:34.290 INFO:teuthology.orchestra.run.smithi012.stdout:048.out 2023-07-07T18:17:34.290 INFO:teuthology.orchestra.run.smithi012.stdout:049 2023-07-07T18:17:34.290 INFO:teuthology.orchestra.run.smithi012.stdout:049.out 2023-07-07T18:17:34.290 INFO:teuthology.orchestra.run.smithi012.stdout:050 2023-07-07T18:17:34.290 INFO:teuthology.orchestra.run.smithi012.stdout:050.cfg 2023-07-07T18:17:34.290 INFO:teuthology.orchestra.run.smithi012.stdout:050.out.default 2023-07-07T18:17:34.291 INFO:teuthology.orchestra.run.smithi012.stdout:050.out.nojournal 2023-07-07T18:17:34.291 INFO:teuthology.orchestra.run.smithi012.stdout:050.out.xfsquota 2023-07-07T18:17:34.291 INFO:teuthology.orchestra.run.smithi012.stdout:051 2023-07-07T18:17:34.291 INFO:teuthology.orchestra.run.smithi012.stdout:051.out 2023-07-07T18:17:34.291 INFO:teuthology.orchestra.run.smithi012.stdout:052 2023-07-07T18:17:34.291 INFO:teuthology.orchestra.run.smithi012.stdout:052.out 2023-07-07T18:17:34.291 INFO:teuthology.orchestra.run.smithi012.stdout:053 2023-07-07T18:17:34.291 INFO:teuthology.orchestra.run.smithi012.stdout:053.out 2023-07-07T18:17:34.292 INFO:teuthology.orchestra.run.smithi012.stdout:054 2023-07-07T18:17:34.292 INFO:teuthology.orchestra.run.smithi012.stdout:054.out 2023-07-07T18:17:34.292 INFO:teuthology.orchestra.run.smithi012.stdout:055 2023-07-07T18:17:34.292 INFO:teuthology.orchestra.run.smithi012.stdout:055.out 2023-07-07T18:17:34.292 INFO:teuthology.orchestra.run.smithi012.stdout:056 2023-07-07T18:17:34.292 INFO:teuthology.orchestra.run.smithi012.stdout:056.out 2023-07-07T18:17:34.292 INFO:teuthology.orchestra.run.smithi012.stdout:057 2023-07-07T18:17:34.292 INFO:teuthology.orchestra.run.smithi012.stdout:057.out 2023-07-07T18:17:34.293 INFO:teuthology.orchestra.run.smithi012.stdout:058 2023-07-07T18:17:34.293 INFO:teuthology.orchestra.run.smithi012.stdout:058.out 2023-07-07T18:17:34.293 INFO:teuthology.orchestra.run.smithi012.stdout:059 2023-07-07T18:17:34.293 INFO:teuthology.orchestra.run.smithi012.stdout:059.out 2023-07-07T18:17:34.293 INFO:teuthology.orchestra.run.smithi012.stdout:060 2023-07-07T18:17:34.293 INFO:teuthology.orchestra.run.smithi012.stdout:060.out 2023-07-07T18:17:34.293 INFO:teuthology.orchestra.run.smithi012.stdout:061 2023-07-07T18:17:34.294 INFO:teuthology.orchestra.run.smithi012.stdout:061.out 2023-07-07T18:17:34.294 INFO:teuthology.orchestra.run.smithi012.stdout:062 2023-07-07T18:17:34.294 INFO:teuthology.orchestra.run.smithi012.stdout:062.out 2023-07-07T18:17:34.294 INFO:teuthology.orchestra.run.smithi012.stdout:063 2023-07-07T18:17:34.294 INFO:teuthology.orchestra.run.smithi012.stdout:063.out 2023-07-07T18:17:34.294 INFO:teuthology.orchestra.run.smithi012.stdout:064 2023-07-07T18:17:34.294 INFO:teuthology.orchestra.run.smithi012.stdout:064.out 2023-07-07T18:17:34.294 INFO:teuthology.orchestra.run.smithi012.stdout:065 2023-07-07T18:17:34.295 INFO:teuthology.orchestra.run.smithi012.stdout:065.out 2023-07-07T18:17:34.295 INFO:teuthology.orchestra.run.smithi012.stdout:066 2023-07-07T18:17:34.295 INFO:teuthology.orchestra.run.smithi012.stdout:066.out 2023-07-07T18:17:34.295 INFO:teuthology.orchestra.run.smithi012.stdout:067 2023-07-07T18:17:34.295 INFO:teuthology.orchestra.run.smithi012.stdout:067.out 2023-07-07T18:17:34.295 INFO:teuthology.orchestra.run.smithi012.stdout:068 2023-07-07T18:17:34.295 INFO:teuthology.orchestra.run.smithi012.stdout:068.out 2023-07-07T18:17:34.295 INFO:teuthology.orchestra.run.smithi012.stdout:069 2023-07-07T18:17:34.296 INFO:teuthology.orchestra.run.smithi012.stdout:069.out 2023-07-07T18:17:34.296 INFO:teuthology.orchestra.run.smithi012.stdout:070 2023-07-07T18:17:34.296 INFO:teuthology.orchestra.run.smithi012.stdout:070.out 2023-07-07T18:17:34.296 INFO:teuthology.orchestra.run.smithi012.stdout:071 2023-07-07T18:17:34.296 INFO:teuthology.orchestra.run.smithi012.stdout:071.out 2023-07-07T18:17:34.296 INFO:teuthology.orchestra.run.smithi012.stdout:072 2023-07-07T18:17:34.296 INFO:teuthology.orchestra.run.smithi012.stdout:072.out 2023-07-07T18:17:34.297 INFO:teuthology.orchestra.run.smithi012.stdout:073 2023-07-07T18:17:34.297 INFO:teuthology.orchestra.run.smithi012.stdout:073.out 2023-07-07T18:17:34.297 INFO:teuthology.orchestra.run.smithi012.stdout:074 2023-07-07T18:17:34.297 INFO:teuthology.orchestra.run.smithi012.stdout:074.out 2023-07-07T18:17:34.297 INFO:teuthology.orchestra.run.smithi012.stdout:075 2023-07-07T18:17:34.297 INFO:teuthology.orchestra.run.smithi012.stdout:075.out 2023-07-07T18:17:34.297 INFO:teuthology.orchestra.run.smithi012.stdout:076 2023-07-07T18:17:34.297 INFO:teuthology.orchestra.run.smithi012.stdout:076.out 2023-07-07T18:17:34.298 INFO:teuthology.orchestra.run.smithi012.stdout:077 2023-07-07T18:17:34.298 INFO:teuthology.orchestra.run.smithi012.stdout:077.out 2023-07-07T18:17:34.298 INFO:teuthology.orchestra.run.smithi012.stdout:078 2023-07-07T18:17:34.298 INFO:teuthology.orchestra.run.smithi012.stdout:078.out 2023-07-07T18:17:34.298 INFO:teuthology.orchestra.run.smithi012.stdout:079 2023-07-07T18:17:34.298 INFO:teuthology.orchestra.run.smithi012.stdout:079.out 2023-07-07T18:17:34.299 INFO:teuthology.orchestra.run.smithi012.stdout:080 2023-07-07T18:17:34.299 INFO:teuthology.orchestra.run.smithi012.stdout:080.out 2023-07-07T18:17:34.299 INFO:teuthology.orchestra.run.smithi012.stdout:081 2023-07-07T18:17:34.299 INFO:teuthology.orchestra.run.smithi012.stdout:081.out 2023-07-07T18:17:34.299 INFO:teuthology.orchestra.run.smithi012.stdout:082 2023-07-07T18:17:34.299 INFO:teuthology.orchestra.run.smithi012.stdout:082.out 2023-07-07T18:17:34.299 INFO:teuthology.orchestra.run.smithi012.stdout:083 2023-07-07T18:17:34.299 INFO:teuthology.orchestra.run.smithi012.stdout:083.out 2023-07-07T18:17:34.300 INFO:teuthology.orchestra.run.smithi012.stdout:084 2023-07-07T18:17:34.300 INFO:teuthology.orchestra.run.smithi012.stdout:084.out 2023-07-07T18:17:34.300 INFO:teuthology.orchestra.run.smithi012.stdout:085 2023-07-07T18:17:34.300 INFO:teuthology.orchestra.run.smithi012.stdout:085.out 2023-07-07T18:17:34.300 INFO:teuthology.orchestra.run.smithi012.stdout:086 2023-07-07T18:17:34.300 INFO:teuthology.orchestra.run.smithi012.stdout:086.out 2023-07-07T18:17:34.300 INFO:teuthology.orchestra.run.smithi012.stdout:087 2023-07-07T18:17:34.301 INFO:teuthology.orchestra.run.smithi012.stdout:087.out 2023-07-07T18:17:34.301 INFO:teuthology.orchestra.run.smithi012.stdout:088 2023-07-07T18:17:34.301 INFO:teuthology.orchestra.run.smithi012.stdout:088.out 2023-07-07T18:17:34.301 INFO:teuthology.orchestra.run.smithi012.stdout:089 2023-07-07T18:17:34.301 INFO:teuthology.orchestra.run.smithi012.stdout:089.out 2023-07-07T18:17:34.301 INFO:teuthology.orchestra.run.smithi012.stdout:090 2023-07-07T18:17:34.301 INFO:teuthology.orchestra.run.smithi012.stdout:090.out 2023-07-07T18:17:34.301 INFO:teuthology.orchestra.run.smithi012.stdout:091 2023-07-07T18:17:34.302 INFO:teuthology.orchestra.run.smithi012.stdout:091.out 2023-07-07T18:17:34.302 INFO:teuthology.orchestra.run.smithi012.stdout:092 2023-07-07T18:17:34.302 INFO:teuthology.orchestra.run.smithi012.stdout:092.out 2023-07-07T18:17:34.302 INFO:teuthology.orchestra.run.smithi012.stdout:093 2023-07-07T18:17:34.302 INFO:teuthology.orchestra.run.smithi012.stdout:093.out 2023-07-07T18:17:34.302 INFO:teuthology.orchestra.run.smithi012.stdout:094 2023-07-07T18:17:34.302 INFO:teuthology.orchestra.run.smithi012.stdout:094.out 2023-07-07T18:17:34.302 INFO:teuthology.orchestra.run.smithi012.stdout:095 2023-07-07T18:17:34.303 INFO:teuthology.orchestra.run.smithi012.stdout:095.out 2023-07-07T18:17:34.303 INFO:teuthology.orchestra.run.smithi012.stdout:096 2023-07-07T18:17:34.303 INFO:teuthology.orchestra.run.smithi012.stdout:096.out 2023-07-07T18:17:34.303 INFO:teuthology.orchestra.run.smithi012.stdout:097 2023-07-07T18:17:34.303 INFO:teuthology.orchestra.run.smithi012.stdout:097.out 2023-07-07T18:17:34.303 INFO:teuthology.orchestra.run.smithi012.stdout:098 2023-07-07T18:17:34.303 INFO:teuthology.orchestra.run.smithi012.stdout:098.out 2023-07-07T18:17:34.303 INFO:teuthology.orchestra.run.smithi012.stdout:099 2023-07-07T18:17:34.304 INFO:teuthology.orchestra.run.smithi012.stdout:099.out 2023-07-07T18:17:34.304 INFO:teuthology.orchestra.run.smithi012.stdout:100 2023-07-07T18:17:34.304 INFO:teuthology.orchestra.run.smithi012.stdout:100.out 2023-07-07T18:17:34.304 INFO:teuthology.orchestra.run.smithi012.stdout:101 2023-07-07T18:17:34.304 INFO:teuthology.orchestra.run.smithi012.stdout:101.out 2023-07-07T18:17:34.304 INFO:teuthology.orchestra.run.smithi012.stdout:102 2023-07-07T18:17:34.304 INFO:teuthology.orchestra.run.smithi012.stdout:102.out 2023-07-07T18:17:34.305 INFO:teuthology.orchestra.run.smithi012.stdout:103 2023-07-07T18:17:34.305 INFO:teuthology.orchestra.run.smithi012.stdout:103.out 2023-07-07T18:17:34.305 INFO:teuthology.orchestra.run.smithi012.stdout:104 2023-07-07T18:17:34.305 INFO:teuthology.orchestra.run.smithi012.stdout:104.out 2023-07-07T18:17:34.305 INFO:teuthology.orchestra.run.smithi012.stdout:105 2023-07-07T18:17:34.305 INFO:teuthology.orchestra.run.smithi012.stdout:105.out 2023-07-07T18:17:34.305 INFO:teuthology.orchestra.run.smithi012.stdout:106 2023-07-07T18:17:34.305 INFO:teuthology.orchestra.run.smithi012.stdout:106.out 2023-07-07T18:17:34.306 INFO:teuthology.orchestra.run.smithi012.stdout:107 2023-07-07T18:17:34.306 INFO:teuthology.orchestra.run.smithi012.stdout:107.out 2023-07-07T18:17:34.306 INFO:teuthology.orchestra.run.smithi012.stdout:108 2023-07-07T18:17:34.306 INFO:teuthology.orchestra.run.smithi012.stdout:108.out 2023-07-07T18:17:34.306 INFO:teuthology.orchestra.run.smithi012.stdout:109 2023-07-07T18:17:34.306 INFO:teuthology.orchestra.run.smithi012.stdout:109.out 2023-07-07T18:17:34.306 INFO:teuthology.orchestra.run.smithi012.stdout:110 2023-07-07T18:17:34.307 INFO:teuthology.orchestra.run.smithi012.stdout:110.out 2023-07-07T18:17:34.307 INFO:teuthology.orchestra.run.smithi012.stdout:111 2023-07-07T18:17:34.307 INFO:teuthology.orchestra.run.smithi012.stdout:111.out 2023-07-07T18:17:34.307 INFO:teuthology.orchestra.run.smithi012.stdout:112 2023-07-07T18:17:34.307 INFO:teuthology.orchestra.run.smithi012.stdout:112.out 2023-07-07T18:17:34.307 INFO:teuthology.orchestra.run.smithi012.stdout:113 2023-07-07T18:17:34.307 INFO:teuthology.orchestra.run.smithi012.stdout:113.out 2023-07-07T18:17:34.307 INFO:teuthology.orchestra.run.smithi012.stdout:114 2023-07-07T18:17:34.308 INFO:teuthology.orchestra.run.smithi012.stdout:114.out 2023-07-07T18:17:34.308 INFO:teuthology.orchestra.run.smithi012.stdout:115 2023-07-07T18:17:34.308 INFO:teuthology.orchestra.run.smithi012.stdout:115.out 2023-07-07T18:17:34.308 INFO:teuthology.orchestra.run.smithi012.stdout:116 2023-07-07T18:17:34.308 INFO:teuthology.orchestra.run.smithi012.stdout:116.out 2023-07-07T18:17:34.308 INFO:teuthology.orchestra.run.smithi012.stdout:117 2023-07-07T18:17:34.308 INFO:teuthology.orchestra.run.smithi012.stdout:117.out 2023-07-07T18:17:34.308 INFO:teuthology.orchestra.run.smithi012.stdout:118 2023-07-07T18:17:34.309 INFO:teuthology.orchestra.run.smithi012.stdout:118.out 2023-07-07T18:17:34.309 INFO:teuthology.orchestra.run.smithi012.stdout:119 2023-07-07T18:17:34.309 INFO:teuthology.orchestra.run.smithi012.stdout:119.out 2023-07-07T18:17:34.309 INFO:teuthology.orchestra.run.smithi012.stdout:120 2023-07-07T18:17:34.309 INFO:teuthology.orchestra.run.smithi012.stdout:120.out 2023-07-07T18:17:34.309 INFO:teuthology.orchestra.run.smithi012.stdout:121 2023-07-07T18:17:34.309 INFO:teuthology.orchestra.run.smithi012.stdout:121.out 2023-07-07T18:17:34.309 INFO:teuthology.orchestra.run.smithi012.stdout:122 2023-07-07T18:17:34.310 INFO:teuthology.orchestra.run.smithi012.stdout:122.out 2023-07-07T18:17:34.310 INFO:teuthology.orchestra.run.smithi012.stdout:123 2023-07-07T18:17:34.310 INFO:teuthology.orchestra.run.smithi012.stdout:123.out 2023-07-07T18:17:34.310 INFO:teuthology.orchestra.run.smithi012.stdout:124 2023-07-07T18:17:34.310 INFO:teuthology.orchestra.run.smithi012.stdout:124.out 2023-07-07T18:17:34.310 INFO:teuthology.orchestra.run.smithi012.stdout:125 2023-07-07T18:17:34.310 INFO:teuthology.orchestra.run.smithi012.stdout:125.out 2023-07-07T18:17:34.310 INFO:teuthology.orchestra.run.smithi012.stdout:126 2023-07-07T18:17:34.311 INFO:teuthology.orchestra.run.smithi012.stdout:126.out 2023-07-07T18:17:34.311 INFO:teuthology.orchestra.run.smithi012.stdout:127 2023-07-07T18:17:34.311 INFO:teuthology.orchestra.run.smithi012.stdout:127.out 2023-07-07T18:17:34.311 INFO:teuthology.orchestra.run.smithi012.stdout:128 2023-07-07T18:17:34.311 INFO:teuthology.orchestra.run.smithi012.stdout:128.out 2023-07-07T18:17:34.311 INFO:teuthology.orchestra.run.smithi012.stdout:129 2023-07-07T18:17:34.311 INFO:teuthology.orchestra.run.smithi012.stdout:129.out 2023-07-07T18:17:34.312 INFO:teuthology.orchestra.run.smithi012.stdout:130 2023-07-07T18:17:34.312 INFO:teuthology.orchestra.run.smithi012.stdout:130.out 2023-07-07T18:17:34.312 INFO:teuthology.orchestra.run.smithi012.stdout:131 2023-07-07T18:17:34.312 INFO:teuthology.orchestra.run.smithi012.stdout:131.out 2023-07-07T18:17:34.312 INFO:teuthology.orchestra.run.smithi012.stdout:132 2023-07-07T18:17:34.312 INFO:teuthology.orchestra.run.smithi012.stdout:132.out 2023-07-07T18:17:34.312 INFO:teuthology.orchestra.run.smithi012.stdout:133 2023-07-07T18:17:34.312 INFO:teuthology.orchestra.run.smithi012.stdout:133.out 2023-07-07T18:17:34.313 INFO:teuthology.orchestra.run.smithi012.stdout:134 2023-07-07T18:17:34.313 INFO:teuthology.orchestra.run.smithi012.stdout:134.out 2023-07-07T18:17:34.313 INFO:teuthology.orchestra.run.smithi012.stdout:135 2023-07-07T18:17:34.313 INFO:teuthology.orchestra.run.smithi012.stdout:135.out 2023-07-07T18:17:34.313 INFO:teuthology.orchestra.run.smithi012.stdout:136 2023-07-07T18:17:34.313 INFO:teuthology.orchestra.run.smithi012.stdout:136.out 2023-07-07T18:17:34.313 INFO:teuthology.orchestra.run.smithi012.stdout:137 2023-07-07T18:17:34.314 INFO:teuthology.orchestra.run.smithi012.stdout:137.out 2023-07-07T18:17:34.314 INFO:teuthology.orchestra.run.smithi012.stdout:138 2023-07-07T18:17:34.314 INFO:teuthology.orchestra.run.smithi012.stdout:138.out 2023-07-07T18:17:34.314 INFO:teuthology.orchestra.run.smithi012.stdout:139 2023-07-07T18:17:34.314 INFO:teuthology.orchestra.run.smithi012.stdout:139.out 2023-07-07T18:17:34.314 INFO:teuthology.orchestra.run.smithi012.stdout:140 2023-07-07T18:17:34.314 INFO:teuthology.orchestra.run.smithi012.stdout:140.out 2023-07-07T18:17:34.314 INFO:teuthology.orchestra.run.smithi012.stdout:141 2023-07-07T18:17:34.315 INFO:teuthology.orchestra.run.smithi012.stdout:141.out 2023-07-07T18:17:34.315 INFO:teuthology.orchestra.run.smithi012.stdout:142 2023-07-07T18:17:34.315 INFO:teuthology.orchestra.run.smithi012.stdout:142.out 2023-07-07T18:17:34.315 INFO:teuthology.orchestra.run.smithi012.stdout:143 2023-07-07T18:17:34.315 INFO:teuthology.orchestra.run.smithi012.stdout:143.out 2023-07-07T18:17:34.315 INFO:teuthology.orchestra.run.smithi012.stdout:144 2023-07-07T18:17:34.315 INFO:teuthology.orchestra.run.smithi012.stdout:144.out 2023-07-07T18:17:34.315 INFO:teuthology.orchestra.run.smithi012.stdout:145 2023-07-07T18:17:34.316 INFO:teuthology.orchestra.run.smithi012.stdout:145.out 2023-07-07T18:17:34.316 INFO:teuthology.orchestra.run.smithi012.stdout:146 2023-07-07T18:17:34.316 INFO:teuthology.orchestra.run.smithi012.stdout:146.out 2023-07-07T18:17:34.316 INFO:teuthology.orchestra.run.smithi012.stdout:147 2023-07-07T18:17:34.316 INFO:teuthology.orchestra.run.smithi012.stdout:147.out 2023-07-07T18:17:34.316 INFO:teuthology.orchestra.run.smithi012.stdout:148 2023-07-07T18:17:34.316 INFO:teuthology.orchestra.run.smithi012.stdout:148.out 2023-07-07T18:17:34.317 INFO:teuthology.orchestra.run.smithi012.stdout:149 2023-07-07T18:17:34.317 INFO:teuthology.orchestra.run.smithi012.stdout:149.out 2023-07-07T18:17:34.317 INFO:teuthology.orchestra.run.smithi012.stdout:150 2023-07-07T18:17:34.317 INFO:teuthology.orchestra.run.smithi012.stdout:150.out 2023-07-07T18:17:34.317 INFO:teuthology.orchestra.run.smithi012.stdout:151 2023-07-07T18:17:34.317 INFO:teuthology.orchestra.run.smithi012.stdout:151.out 2023-07-07T18:17:34.317 INFO:teuthology.orchestra.run.smithi012.stdout:152 2023-07-07T18:17:34.318 INFO:teuthology.orchestra.run.smithi012.stdout:152.out 2023-07-07T18:17:34.318 INFO:teuthology.orchestra.run.smithi012.stdout:153 2023-07-07T18:17:34.318 INFO:teuthology.orchestra.run.smithi012.stdout:153.out 2023-07-07T18:17:34.318 INFO:teuthology.orchestra.run.smithi012.stdout:154 2023-07-07T18:17:34.318 INFO:teuthology.orchestra.run.smithi012.stdout:154.out 2023-07-07T18:17:34.318 INFO:teuthology.orchestra.run.smithi012.stdout:155 2023-07-07T18:17:34.318 INFO:teuthology.orchestra.run.smithi012.stdout:155.out 2023-07-07T18:17:34.318 INFO:teuthology.orchestra.run.smithi012.stdout:156 2023-07-07T18:17:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:156.out 2023-07-07T18:17:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:157 2023-07-07T18:17:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:157.out 2023-07-07T18:17:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:158 2023-07-07T18:17:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:158.out 2023-07-07T18:17:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:159 2023-07-07T18:17:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:159.out 2023-07-07T18:17:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:160 2023-07-07T18:17:34.320 INFO:teuthology.orchestra.run.smithi012.stdout:160.out 2023-07-07T18:17:34.320 INFO:teuthology.orchestra.run.smithi012.stdout:161 2023-07-07T18:17:34.320 INFO:teuthology.orchestra.run.smithi012.stdout:161.out 2023-07-07T18:17:34.320 INFO:teuthology.orchestra.run.smithi012.stdout:162 2023-07-07T18:17:34.320 INFO:teuthology.orchestra.run.smithi012.stdout:162.out 2023-07-07T18:17:34.320 INFO:teuthology.orchestra.run.smithi012.stdout:163 2023-07-07T18:17:34.320 INFO:teuthology.orchestra.run.smithi012.stdout:163.out 2023-07-07T18:17:34.321 INFO:teuthology.orchestra.run.smithi012.stdout:164 2023-07-07T18:17:34.321 INFO:teuthology.orchestra.run.smithi012.stdout:164.out 2023-07-07T18:17:34.321 INFO:teuthology.orchestra.run.smithi012.stdout:165 2023-07-07T18:17:34.321 INFO:teuthology.orchestra.run.smithi012.stdout:165.out 2023-07-07T18:17:34.321 INFO:teuthology.orchestra.run.smithi012.stdout:166 2023-07-07T18:17:34.321 INFO:teuthology.orchestra.run.smithi012.stdout:166.out 2023-07-07T18:17:34.321 INFO:teuthology.orchestra.run.smithi012.stdout:167 2023-07-07T18:17:34.321 INFO:teuthology.orchestra.run.smithi012.stdout:167.out 2023-07-07T18:17:34.322 INFO:teuthology.orchestra.run.smithi012.stdout:168 2023-07-07T18:17:34.322 INFO:teuthology.orchestra.run.smithi012.stdout:168.out 2023-07-07T18:17:34.322 INFO:teuthology.orchestra.run.smithi012.stdout:169 2023-07-07T18:17:34.322 INFO:teuthology.orchestra.run.smithi012.stdout:169.out 2023-07-07T18:17:34.322 INFO:teuthology.orchestra.run.smithi012.stdout:170 2023-07-07T18:17:34.322 INFO:teuthology.orchestra.run.smithi012.stdout:170.out 2023-07-07T18:17:34.322 INFO:teuthology.orchestra.run.smithi012.stdout:171 2023-07-07T18:17:34.322 INFO:teuthology.orchestra.run.smithi012.stdout:171.out 2023-07-07T18:17:34.323 INFO:teuthology.orchestra.run.smithi012.stdout:172 2023-07-07T18:17:34.323 INFO:teuthology.orchestra.run.smithi012.stdout:172.out 2023-07-07T18:17:34.323 INFO:teuthology.orchestra.run.smithi012.stdout:173 2023-07-07T18:17:34.323 INFO:teuthology.orchestra.run.smithi012.stdout:173.out 2023-07-07T18:17:34.323 INFO:teuthology.orchestra.run.smithi012.stdout:174 2023-07-07T18:17:34.323 INFO:teuthology.orchestra.run.smithi012.stdout:174.out 2023-07-07T18:17:34.323 INFO:teuthology.orchestra.run.smithi012.stdout:175 2023-07-07T18:17:34.323 INFO:teuthology.orchestra.run.smithi012.stdout:175.out 2023-07-07T18:17:34.324 INFO:teuthology.orchestra.run.smithi012.stdout:176 2023-07-07T18:17:34.324 INFO:teuthology.orchestra.run.smithi012.stdout:176.out 2023-07-07T18:17:34.324 INFO:teuthology.orchestra.run.smithi012.stdout:177 2023-07-07T18:17:34.324 INFO:teuthology.orchestra.run.smithi012.stdout:177.out 2023-07-07T18:17:34.324 INFO:teuthology.orchestra.run.smithi012.stdout:178 2023-07-07T18:17:34.324 INFO:teuthology.orchestra.run.smithi012.stdout:178.out 2023-07-07T18:17:34.324 INFO:teuthology.orchestra.run.smithi012.stdout:179 2023-07-07T18:17:34.325 INFO:teuthology.orchestra.run.smithi012.stdout:179.out 2023-07-07T18:17:34.325 INFO:teuthology.orchestra.run.smithi012.stdout:180 2023-07-07T18:17:34.325 INFO:teuthology.orchestra.run.smithi012.stdout:180.out 2023-07-07T18:17:34.325 INFO:teuthology.orchestra.run.smithi012.stdout:181 2023-07-07T18:17:34.325 INFO:teuthology.orchestra.run.smithi012.stdout:181.out 2023-07-07T18:17:34.325 INFO:teuthology.orchestra.run.smithi012.stdout:182 2023-07-07T18:17:34.325 INFO:teuthology.orchestra.run.smithi012.stdout:182.out 2023-07-07T18:17:34.325 INFO:teuthology.orchestra.run.smithi012.stdout:183 2023-07-07T18:17:34.326 INFO:teuthology.orchestra.run.smithi012.stdout:183.out 2023-07-07T18:17:34.326 INFO:teuthology.orchestra.run.smithi012.stdout:184 2023-07-07T18:17:34.326 INFO:teuthology.orchestra.run.smithi012.stdout:184.out 2023-07-07T18:17:34.326 INFO:teuthology.orchestra.run.smithi012.stdout:185 2023-07-07T18:17:34.326 INFO:teuthology.orchestra.run.smithi012.stdout:185.out 2023-07-07T18:17:34.326 INFO:teuthology.orchestra.run.smithi012.stdout:186 2023-07-07T18:17:34.326 INFO:teuthology.orchestra.run.smithi012.stdout:186.out 2023-07-07T18:17:34.326 INFO:teuthology.orchestra.run.smithi012.stdout:187 2023-07-07T18:17:34.327 INFO:teuthology.orchestra.run.smithi012.stdout:187.out 2023-07-07T18:17:34.327 INFO:teuthology.orchestra.run.smithi012.stdout:188 2023-07-07T18:17:34.327 INFO:teuthology.orchestra.run.smithi012.stdout:188.out 2023-07-07T18:17:34.327 INFO:teuthology.orchestra.run.smithi012.stdout:189 2023-07-07T18:17:34.327 INFO:teuthology.orchestra.run.smithi012.stdout:189.out 2023-07-07T18:17:34.327 INFO:teuthology.orchestra.run.smithi012.stdout:190 2023-07-07T18:17:34.327 INFO:teuthology.orchestra.run.smithi012.stdout:190.out 2023-07-07T18:17:34.327 INFO:teuthology.orchestra.run.smithi012.stdout:191 2023-07-07T18:17:34.328 INFO:teuthology.orchestra.run.smithi012.stdout:191.out 2023-07-07T18:17:34.328 INFO:teuthology.orchestra.run.smithi012.stdout:192 2023-07-07T18:17:34.328 INFO:teuthology.orchestra.run.smithi012.stdout:192.out 2023-07-07T18:17:34.328 INFO:teuthology.orchestra.run.smithi012.stdout:193 2023-07-07T18:17:34.328 INFO:teuthology.orchestra.run.smithi012.stdout:193.out 2023-07-07T18:17:34.328 INFO:teuthology.orchestra.run.smithi012.stdout:194 2023-07-07T18:17:34.328 INFO:teuthology.orchestra.run.smithi012.stdout:194.out 2023-07-07T18:17:34.329 INFO:teuthology.orchestra.run.smithi012.stdout:195 2023-07-07T18:17:34.329 INFO:teuthology.orchestra.run.smithi012.stdout:195.out 2023-07-07T18:17:34.329 INFO:teuthology.orchestra.run.smithi012.stdout:196 2023-07-07T18:17:34.329 INFO:teuthology.orchestra.run.smithi012.stdout:196.out 2023-07-07T18:17:34.329 INFO:teuthology.orchestra.run.smithi012.stdout:197 2023-07-07T18:17:34.329 INFO:teuthology.orchestra.run.smithi012.stdout:197.out 2023-07-07T18:17:34.329 INFO:teuthology.orchestra.run.smithi012.stdout:198 2023-07-07T18:17:34.330 INFO:teuthology.orchestra.run.smithi012.stdout:198.out 2023-07-07T18:17:34.330 INFO:teuthology.orchestra.run.smithi012.stdout:199 2023-07-07T18:17:34.330 INFO:teuthology.orchestra.run.smithi012.stdout:199.out 2023-07-07T18:17:34.330 INFO:teuthology.orchestra.run.smithi012.stdout:200 2023-07-07T18:17:34.330 INFO:teuthology.orchestra.run.smithi012.stdout:200.out 2023-07-07T18:17:34.330 INFO:teuthology.orchestra.run.smithi012.stdout:201 2023-07-07T18:17:34.330 INFO:teuthology.orchestra.run.smithi012.stdout:201.out 2023-07-07T18:17:34.330 INFO:teuthology.orchestra.run.smithi012.stdout:202 2023-07-07T18:17:34.331 INFO:teuthology.orchestra.run.smithi012.stdout:202.out 2023-07-07T18:17:34.331 INFO:teuthology.orchestra.run.smithi012.stdout:203 2023-07-07T18:17:34.331 INFO:teuthology.orchestra.run.smithi012.stdout:203.out 2023-07-07T18:17:34.331 INFO:teuthology.orchestra.run.smithi012.stdout:204 2023-07-07T18:17:34.331 INFO:teuthology.orchestra.run.smithi012.stdout:204.out 2023-07-07T18:17:34.331 INFO:teuthology.orchestra.run.smithi012.stdout:205 2023-07-07T18:17:34.331 INFO:teuthology.orchestra.run.smithi012.stdout:205.out 2023-07-07T18:17:34.332 INFO:teuthology.orchestra.run.smithi012.stdout:206 2023-07-07T18:17:34.332 INFO:teuthology.orchestra.run.smithi012.stdout:206.out 2023-07-07T18:17:34.332 INFO:teuthology.orchestra.run.smithi012.stdout:207 2023-07-07T18:17:34.332 INFO:teuthology.orchestra.run.smithi012.stdout:207.out 2023-07-07T18:17:34.332 INFO:teuthology.orchestra.run.smithi012.stdout:208 2023-07-07T18:17:34.332 INFO:teuthology.orchestra.run.smithi012.stdout:208.out 2023-07-07T18:17:34.332 INFO:teuthology.orchestra.run.smithi012.stdout:209 2023-07-07T18:17:34.332 INFO:teuthology.orchestra.run.smithi012.stdout:209.out 2023-07-07T18:17:34.333 INFO:teuthology.orchestra.run.smithi012.stdout:210 2023-07-07T18:17:34.333 INFO:teuthology.orchestra.run.smithi012.stdout:210.out 2023-07-07T18:17:34.333 INFO:teuthology.orchestra.run.smithi012.stdout:211 2023-07-07T18:17:34.333 INFO:teuthology.orchestra.run.smithi012.stdout:211.out 2023-07-07T18:17:34.333 INFO:teuthology.orchestra.run.smithi012.stdout:212 2023-07-07T18:17:34.333 INFO:teuthology.orchestra.run.smithi012.stdout:212.out 2023-07-07T18:17:34.333 INFO:teuthology.orchestra.run.smithi012.stdout:213 2023-07-07T18:17:34.334 INFO:teuthology.orchestra.run.smithi012.stdout:213.out 2023-07-07T18:17:34.334 INFO:teuthology.orchestra.run.smithi012.stdout:214 2023-07-07T18:17:34.334 INFO:teuthology.orchestra.run.smithi012.stdout:214.out 2023-07-07T18:17:34.334 INFO:teuthology.orchestra.run.smithi012.stdout:215 2023-07-07T18:17:34.334 INFO:teuthology.orchestra.run.smithi012.stdout:215.out 2023-07-07T18:17:34.334 INFO:teuthology.orchestra.run.smithi012.stdout:216 2023-07-07T18:17:34.334 INFO:teuthology.orchestra.run.smithi012.stdout:216.out 2023-07-07T18:17:34.334 INFO:teuthology.orchestra.run.smithi012.stdout:217 2023-07-07T18:17:34.335 INFO:teuthology.orchestra.run.smithi012.stdout:217.out 2023-07-07T18:17:34.335 INFO:teuthology.orchestra.run.smithi012.stdout:218 2023-07-07T18:17:34.335 INFO:teuthology.orchestra.run.smithi012.stdout:218.out 2023-07-07T18:17:34.335 INFO:teuthology.orchestra.run.smithi012.stdout:219 2023-07-07T18:17:34.335 INFO:teuthology.orchestra.run.smithi012.stdout:219.out 2023-07-07T18:17:34.335 INFO:teuthology.orchestra.run.smithi012.stdout:220 2023-07-07T18:17:34.335 INFO:teuthology.orchestra.run.smithi012.stdout:220.out 2023-07-07T18:17:34.335 INFO:teuthology.orchestra.run.smithi012.stdout:221 2023-07-07T18:17:34.336 INFO:teuthology.orchestra.run.smithi012.stdout:221.out 2023-07-07T18:17:34.336 INFO:teuthology.orchestra.run.smithi012.stdout:222 2023-07-07T18:17:34.336 INFO:teuthology.orchestra.run.smithi012.stdout:222.out 2023-07-07T18:17:34.336 INFO:teuthology.orchestra.run.smithi012.stdout:223 2023-07-07T18:17:34.336 INFO:teuthology.orchestra.run.smithi012.stdout:223.out 2023-07-07T18:17:34.336 INFO:teuthology.orchestra.run.smithi012.stdout:224 2023-07-07T18:17:34.336 INFO:teuthology.orchestra.run.smithi012.stdout:224.out 2023-07-07T18:17:34.337 INFO:teuthology.orchestra.run.smithi012.stdout:225 2023-07-07T18:17:34.337 INFO:teuthology.orchestra.run.smithi012.stdout:225.out 2023-07-07T18:17:34.337 INFO:teuthology.orchestra.run.smithi012.stdout:226 2023-07-07T18:17:34.337 INFO:teuthology.orchestra.run.smithi012.stdout:226.out 2023-07-07T18:17:34.337 INFO:teuthology.orchestra.run.smithi012.stdout:227 2023-07-07T18:17:34.337 INFO:teuthology.orchestra.run.smithi012.stdout:227.out 2023-07-07T18:17:34.337 INFO:teuthology.orchestra.run.smithi012.stdout:228 2023-07-07T18:17:34.337 INFO:teuthology.orchestra.run.smithi012.stdout:228.out 2023-07-07T18:17:34.338 INFO:teuthology.orchestra.run.smithi012.stdout:229 2023-07-07T18:17:34.338 INFO:teuthology.orchestra.run.smithi012.stdout:229.out 2023-07-07T18:17:34.338 INFO:teuthology.orchestra.run.smithi012.stdout:230 2023-07-07T18:17:34.338 INFO:teuthology.orchestra.run.smithi012.stdout:230.out 2023-07-07T18:17:34.338 INFO:teuthology.orchestra.run.smithi012.stdout:231 2023-07-07T18:17:34.338 INFO:teuthology.orchestra.run.smithi012.stdout:231.out 2023-07-07T18:17:34.339 INFO:teuthology.orchestra.run.smithi012.stdout:232 2023-07-07T18:17:34.339 INFO:teuthology.orchestra.run.smithi012.stdout:232.out 2023-07-07T18:17:34.339 INFO:teuthology.orchestra.run.smithi012.stdout:233 2023-07-07T18:17:34.339 INFO:teuthology.orchestra.run.smithi012.stdout:233.out 2023-07-07T18:17:34.339 INFO:teuthology.orchestra.run.smithi012.stdout:234 2023-07-07T18:17:34.339 INFO:teuthology.orchestra.run.smithi012.stdout:234.out 2023-07-07T18:17:34.339 INFO:teuthology.orchestra.run.smithi012.stdout:235 2023-07-07T18:17:34.340 INFO:teuthology.orchestra.run.smithi012.stdout:235.out 2023-07-07T18:17:34.340 INFO:teuthology.orchestra.run.smithi012.stdout:236 2023-07-07T18:17:34.340 INFO:teuthology.orchestra.run.smithi012.stdout:236.out 2023-07-07T18:17:34.340 INFO:teuthology.orchestra.run.smithi012.stdout:237 2023-07-07T18:17:34.340 INFO:teuthology.orchestra.run.smithi012.stdout:237.out 2023-07-07T18:17:34.340 INFO:teuthology.orchestra.run.smithi012.stdout:238 2023-07-07T18:17:34.340 INFO:teuthology.orchestra.run.smithi012.stdout:238.out 2023-07-07T18:17:34.340 INFO:teuthology.orchestra.run.smithi012.stdout:239 2023-07-07T18:17:34.341 INFO:teuthology.orchestra.run.smithi012.stdout:239.out 2023-07-07T18:17:34.341 INFO:teuthology.orchestra.run.smithi012.stdout:240 2023-07-07T18:17:34.341 INFO:teuthology.orchestra.run.smithi012.stdout:240.out 2023-07-07T18:17:34.341 INFO:teuthology.orchestra.run.smithi012.stdout:241 2023-07-07T18:17:34.341 INFO:teuthology.orchestra.run.smithi012.stdout:241.out 2023-07-07T18:17:34.341 INFO:teuthology.orchestra.run.smithi012.stdout:242 2023-07-07T18:17:34.341 INFO:teuthology.orchestra.run.smithi012.stdout:242.out 2023-07-07T18:17:34.341 INFO:teuthology.orchestra.run.smithi012.stdout:243 2023-07-07T18:17:34.342 INFO:teuthology.orchestra.run.smithi012.stdout:243.out 2023-07-07T18:17:34.342 INFO:teuthology.orchestra.run.smithi012.stdout:244 2023-07-07T18:17:34.342 INFO:teuthology.orchestra.run.smithi012.stdout:244.out 2023-07-07T18:17:34.342 INFO:teuthology.orchestra.run.smithi012.stdout:245 2023-07-07T18:17:34.342 INFO:teuthology.orchestra.run.smithi012.stdout:245.out 2023-07-07T18:17:34.342 INFO:teuthology.orchestra.run.smithi012.stdout:246 2023-07-07T18:17:34.342 INFO:teuthology.orchestra.run.smithi012.stdout:246.out 2023-07-07T18:17:34.343 INFO:teuthology.orchestra.run.smithi012.stdout:247 2023-07-07T18:17:34.343 INFO:teuthology.orchestra.run.smithi012.stdout:247.out 2023-07-07T18:17:34.343 INFO:teuthology.orchestra.run.smithi012.stdout:248 2023-07-07T18:17:34.343 INFO:teuthology.orchestra.run.smithi012.stdout:248.out 2023-07-07T18:17:34.343 INFO:teuthology.orchestra.run.smithi012.stdout:249 2023-07-07T18:17:34.343 INFO:teuthology.orchestra.run.smithi012.stdout:249.out 2023-07-07T18:17:34.343 INFO:teuthology.orchestra.run.smithi012.stdout:250 2023-07-07T18:17:34.343 INFO:teuthology.orchestra.run.smithi012.stdout:250.out 2023-07-07T18:17:34.344 INFO:teuthology.orchestra.run.smithi012.stdout:251 2023-07-07T18:17:34.344 INFO:teuthology.orchestra.run.smithi012.stdout:251.out 2023-07-07T18:17:34.344 INFO:teuthology.orchestra.run.smithi012.stdout:252 2023-07-07T18:17:34.344 INFO:teuthology.orchestra.run.smithi012.stdout:252.out 2023-07-07T18:17:34.344 INFO:teuthology.orchestra.run.smithi012.stdout:253 2023-07-07T18:17:34.344 INFO:teuthology.orchestra.run.smithi012.stdout:253.out 2023-07-07T18:17:34.344 INFO:teuthology.orchestra.run.smithi012.stdout:254 2023-07-07T18:17:34.344 INFO:teuthology.orchestra.run.smithi012.stdout:254.out 2023-07-07T18:17:34.345 INFO:teuthology.orchestra.run.smithi012.stdout:255 2023-07-07T18:17:34.345 INFO:teuthology.orchestra.run.smithi012.stdout:255.out 2023-07-07T18:17:34.345 INFO:teuthology.orchestra.run.smithi012.stdout:256 2023-07-07T18:17:34.345 INFO:teuthology.orchestra.run.smithi012.stdout:256.out 2023-07-07T18:17:34.345 INFO:teuthology.orchestra.run.smithi012.stdout:257 2023-07-07T18:17:34.345 INFO:teuthology.orchestra.run.smithi012.stdout:257.out 2023-07-07T18:17:34.345 INFO:teuthology.orchestra.run.smithi012.stdout:258 2023-07-07T18:17:34.345 INFO:teuthology.orchestra.run.smithi012.stdout:258.out 2023-07-07T18:17:34.346 INFO:teuthology.orchestra.run.smithi012.stdout:259 2023-07-07T18:17:34.346 INFO:teuthology.orchestra.run.smithi012.stdout:259.out 2023-07-07T18:17:34.346 INFO:teuthology.orchestra.run.smithi012.stdout:260 2023-07-07T18:17:34.346 INFO:teuthology.orchestra.run.smithi012.stdout:260.out 2023-07-07T18:17:34.346 INFO:teuthology.orchestra.run.smithi012.stdout:261 2023-07-07T18:17:34.346 INFO:teuthology.orchestra.run.smithi012.stdout:261.out 2023-07-07T18:17:34.346 INFO:teuthology.orchestra.run.smithi012.stdout:262 2023-07-07T18:17:34.346 INFO:teuthology.orchestra.run.smithi012.stdout:262.out 2023-07-07T18:17:34.347 INFO:teuthology.orchestra.run.smithi012.stdout:263 2023-07-07T18:17:34.347 INFO:teuthology.orchestra.run.smithi012.stdout:263.out 2023-07-07T18:17:34.347 INFO:teuthology.orchestra.run.smithi012.stdout:264 2023-07-07T18:17:34.347 INFO:teuthology.orchestra.run.smithi012.stdout:264.out 2023-07-07T18:17:34.347 INFO:teuthology.orchestra.run.smithi012.stdout:265 2023-07-07T18:17:34.347 INFO:teuthology.orchestra.run.smithi012.stdout:265.out 2023-07-07T18:17:34.347 INFO:teuthology.orchestra.run.smithi012.stdout:266 2023-07-07T18:17:34.347 INFO:teuthology.orchestra.run.smithi012.stdout:266.out 2023-07-07T18:17:34.348 INFO:teuthology.orchestra.run.smithi012.stdout:267 2023-07-07T18:17:34.348 INFO:teuthology.orchestra.run.smithi012.stdout:267.out 2023-07-07T18:17:34.348 INFO:teuthology.orchestra.run.smithi012.stdout:268 2023-07-07T18:17:34.348 INFO:teuthology.orchestra.run.smithi012.stdout:268.out 2023-07-07T18:17:34.348 INFO:teuthology.orchestra.run.smithi012.stdout:269 2023-07-07T18:17:34.349 INFO:teuthology.orchestra.run.smithi012.stdout:269.out 2023-07-07T18:17:34.349 INFO:teuthology.orchestra.run.smithi012.stdout:270 2023-07-07T18:17:34.349 INFO:teuthology.orchestra.run.smithi012.stdout:270.out 2023-07-07T18:17:34.349 INFO:teuthology.orchestra.run.smithi012.stdout:271 2023-07-07T18:17:34.349 INFO:teuthology.orchestra.run.smithi012.stdout:271.out 2023-07-07T18:17:34.349 INFO:teuthology.orchestra.run.smithi012.stdout:272 2023-07-07T18:17:34.349 INFO:teuthology.orchestra.run.smithi012.stdout:272.out 2023-07-07T18:17:34.350 INFO:teuthology.orchestra.run.smithi012.stdout:273 2023-07-07T18:17:34.350 INFO:teuthology.orchestra.run.smithi012.stdout:273.out 2023-07-07T18:17:34.350 INFO:teuthology.orchestra.run.smithi012.stdout:274 2023-07-07T18:17:34.350 INFO:teuthology.orchestra.run.smithi012.stdout:274.out 2023-07-07T18:17:34.350 INFO:teuthology.orchestra.run.smithi012.stdout:275 2023-07-07T18:17:34.350 INFO:teuthology.orchestra.run.smithi012.stdout:275.out 2023-07-07T18:17:34.350 INFO:teuthology.orchestra.run.smithi012.stdout:276 2023-07-07T18:17:34.350 INFO:teuthology.orchestra.run.smithi012.stdout:276.out 2023-07-07T18:17:34.351 INFO:teuthology.orchestra.run.smithi012.stdout:277 2023-07-07T18:17:34.351 INFO:teuthology.orchestra.run.smithi012.stdout:277.out 2023-07-07T18:17:34.351 INFO:teuthology.orchestra.run.smithi012.stdout:278 2023-07-07T18:17:34.351 INFO:teuthology.orchestra.run.smithi012.stdout:278.out 2023-07-07T18:17:34.351 INFO:teuthology.orchestra.run.smithi012.stdout:279 2023-07-07T18:17:34.351 INFO:teuthology.orchestra.run.smithi012.stdout:279.out 2023-07-07T18:17:34.351 INFO:teuthology.orchestra.run.smithi012.stdout:280 2023-07-07T18:17:34.351 INFO:teuthology.orchestra.run.smithi012.stdout:280.out 2023-07-07T18:17:34.352 INFO:teuthology.orchestra.run.smithi012.stdout:281 2023-07-07T18:17:34.352 INFO:teuthology.orchestra.run.smithi012.stdout:281.out 2023-07-07T18:17:34.352 INFO:teuthology.orchestra.run.smithi012.stdout:282 2023-07-07T18:17:34.352 INFO:teuthology.orchestra.run.smithi012.stdout:282.out 2023-07-07T18:17:34.352 INFO:teuthology.orchestra.run.smithi012.stdout:283 2023-07-07T18:17:34.352 INFO:teuthology.orchestra.run.smithi012.stdout:283.out 2023-07-07T18:17:34.352 INFO:teuthology.orchestra.run.smithi012.stdout:284 2023-07-07T18:17:34.353 INFO:teuthology.orchestra.run.smithi012.stdout:284.out 2023-07-07T18:17:34.353 INFO:teuthology.orchestra.run.smithi012.stdout:285 2023-07-07T18:17:34.353 INFO:teuthology.orchestra.run.smithi012.stdout:285.out 2023-07-07T18:17:34.353 INFO:teuthology.orchestra.run.smithi012.stdout:286 2023-07-07T18:17:34.353 INFO:teuthology.orchestra.run.smithi012.stdout:286.out 2023-07-07T18:17:34.353 INFO:teuthology.orchestra.run.smithi012.stdout:287 2023-07-07T18:17:34.353 INFO:teuthology.orchestra.run.smithi012.stdout:287.out 2023-07-07T18:17:34.353 INFO:teuthology.orchestra.run.smithi012.stdout:288 2023-07-07T18:17:34.354 INFO:teuthology.orchestra.run.smithi012.stdout:288.out 2023-07-07T18:17:34.354 INFO:teuthology.orchestra.run.smithi012.stdout:289 2023-07-07T18:17:34.354 INFO:teuthology.orchestra.run.smithi012.stdout:289.out 2023-07-07T18:17:34.354 INFO:teuthology.orchestra.run.smithi012.stdout:290 2023-07-07T18:17:34.354 INFO:teuthology.orchestra.run.smithi012.stdout:290.out 2023-07-07T18:17:34.354 INFO:teuthology.orchestra.run.smithi012.stdout:291 2023-07-07T18:17:34.354 INFO:teuthology.orchestra.run.smithi012.stdout:291.out 2023-07-07T18:17:34.354 INFO:teuthology.orchestra.run.smithi012.stdout:292 2023-07-07T18:17:34.355 INFO:teuthology.orchestra.run.smithi012.stdout:292.out 2023-07-07T18:17:34.355 INFO:teuthology.orchestra.run.smithi012.stdout:293 2023-07-07T18:17:34.355 INFO:teuthology.orchestra.run.smithi012.stdout:293.out 2023-07-07T18:17:34.355 INFO:teuthology.orchestra.run.smithi012.stdout:294 2023-07-07T18:17:34.355 INFO:teuthology.orchestra.run.smithi012.stdout:294.out 2023-07-07T18:17:34.355 INFO:teuthology.orchestra.run.smithi012.stdout:295 2023-07-07T18:17:34.355 INFO:teuthology.orchestra.run.smithi012.stdout:295.out 2023-07-07T18:17:34.355 INFO:teuthology.orchestra.run.smithi012.stdout:296 2023-07-07T18:17:34.356 INFO:teuthology.orchestra.run.smithi012.stdout:296.out 2023-07-07T18:17:34.356 INFO:teuthology.orchestra.run.smithi012.stdout:297 2023-07-07T18:17:34.356 INFO:teuthology.orchestra.run.smithi012.stdout:297.out 2023-07-07T18:17:34.356 INFO:teuthology.orchestra.run.smithi012.stdout:298 2023-07-07T18:17:34.356 INFO:teuthology.orchestra.run.smithi012.stdout:298.out 2023-07-07T18:17:34.356 INFO:teuthology.orchestra.run.smithi012.stdout:299 2023-07-07T18:17:34.356 INFO:teuthology.orchestra.run.smithi012.stdout:299.out 2023-07-07T18:17:34.356 INFO:teuthology.orchestra.run.smithi012.stdout:300 2023-07-07T18:17:34.357 INFO:teuthology.orchestra.run.smithi012.stdout:300.out 2023-07-07T18:17:34.357 INFO:teuthology.orchestra.run.smithi012.stdout:301 2023-07-07T18:17:34.357 INFO:teuthology.orchestra.run.smithi012.stdout:301.out 2023-07-07T18:17:34.357 INFO:teuthology.orchestra.run.smithi012.stdout:302 2023-07-07T18:17:34.357 INFO:teuthology.orchestra.run.smithi012.stdout:302.out 2023-07-07T18:17:34.357 INFO:teuthology.orchestra.run.smithi012.stdout:303 2023-07-07T18:17:34.357 INFO:teuthology.orchestra.run.smithi012.stdout:303.out 2023-07-07T18:17:34.358 INFO:teuthology.orchestra.run.smithi012.stdout:304 2023-07-07T18:17:34.358 INFO:teuthology.orchestra.run.smithi012.stdout:304.out 2023-07-07T18:17:34.358 INFO:teuthology.orchestra.run.smithi012.stdout:305 2023-07-07T18:17:34.358 INFO:teuthology.orchestra.run.smithi012.stdout:305.out 2023-07-07T18:17:34.358 INFO:teuthology.orchestra.run.smithi012.stdout:306 2023-07-07T18:17:34.358 INFO:teuthology.orchestra.run.smithi012.stdout:306.out 2023-07-07T18:17:34.358 INFO:teuthology.orchestra.run.smithi012.stdout:307 2023-07-07T18:17:34.358 INFO:teuthology.orchestra.run.smithi012.stdout:307.out 2023-07-07T18:17:34.359 INFO:teuthology.orchestra.run.smithi012.stdout:308 2023-07-07T18:17:34.359 INFO:teuthology.orchestra.run.smithi012.stdout:308.out 2023-07-07T18:17:34.359 INFO:teuthology.orchestra.run.smithi012.stdout:309 2023-07-07T18:17:34.359 INFO:teuthology.orchestra.run.smithi012.stdout:309.out 2023-07-07T18:17:34.359 INFO:teuthology.orchestra.run.smithi012.stdout:310 2023-07-07T18:17:34.359 INFO:teuthology.orchestra.run.smithi012.stdout:310.out 2023-07-07T18:17:34.360 INFO:teuthology.orchestra.run.smithi012.stdout:311 2023-07-07T18:17:34.360 INFO:teuthology.orchestra.run.smithi012.stdout:311.out 2023-07-07T18:17:34.360 INFO:teuthology.orchestra.run.smithi012.stdout:312 2023-07-07T18:17:34.360 INFO:teuthology.orchestra.run.smithi012.stdout:312.out 2023-07-07T18:17:34.360 INFO:teuthology.orchestra.run.smithi012.stdout:313 2023-07-07T18:17:34.360 INFO:teuthology.orchestra.run.smithi012.stdout:313.out 2023-07-07T18:17:34.360 INFO:teuthology.orchestra.run.smithi012.stdout:314 2023-07-07T18:17:34.360 INFO:teuthology.orchestra.run.smithi012.stdout:314.out 2023-07-07T18:17:34.361 INFO:teuthology.orchestra.run.smithi012.stdout:315 2023-07-07T18:17:34.361 INFO:teuthology.orchestra.run.smithi012.stdout:315.out 2023-07-07T18:17:34.361 INFO:teuthology.orchestra.run.smithi012.stdout:316 2023-07-07T18:17:34.361 INFO:teuthology.orchestra.run.smithi012.stdout:316.out 2023-07-07T18:17:34.361 INFO:teuthology.orchestra.run.smithi012.stdout:317 2023-07-07T18:17:34.361 INFO:teuthology.orchestra.run.smithi012.stdout:317.out 2023-07-07T18:17:34.361 INFO:teuthology.orchestra.run.smithi012.stdout:318 2023-07-07T18:17:34.361 INFO:teuthology.orchestra.run.smithi012.stdout:318.out 2023-07-07T18:17:34.362 INFO:teuthology.orchestra.run.smithi012.stdout:319 2023-07-07T18:17:34.362 INFO:teuthology.orchestra.run.smithi012.stdout:319.out 2023-07-07T18:17:34.362 INFO:teuthology.orchestra.run.smithi012.stdout:320 2023-07-07T18:17:34.362 INFO:teuthology.orchestra.run.smithi012.stdout:320.out 2023-07-07T18:17:34.362 INFO:teuthology.orchestra.run.smithi012.stdout:321 2023-07-07T18:17:34.362 INFO:teuthology.orchestra.run.smithi012.stdout:321.out 2023-07-07T18:17:34.362 INFO:teuthology.orchestra.run.smithi012.stdout:322 2023-07-07T18:17:34.363 INFO:teuthology.orchestra.run.smithi012.stdout:322.out 2023-07-07T18:17:34.363 INFO:teuthology.orchestra.run.smithi012.stdout:323 2023-07-07T18:17:34.363 INFO:teuthology.orchestra.run.smithi012.stdout:323.out 2023-07-07T18:17:34.363 INFO:teuthology.orchestra.run.smithi012.stdout:324 2023-07-07T18:17:34.363 INFO:teuthology.orchestra.run.smithi012.stdout:324.out 2023-07-07T18:17:34.363 INFO:teuthology.orchestra.run.smithi012.stdout:325 2023-07-07T18:17:34.363 INFO:teuthology.orchestra.run.smithi012.stdout:325.out 2023-07-07T18:17:34.363 INFO:teuthology.orchestra.run.smithi012.stdout:326 2023-07-07T18:17:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:326.out 2023-07-07T18:17:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:327 2023-07-07T18:17:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:327.out 2023-07-07T18:17:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:328 2023-07-07T18:17:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:328.out 2023-07-07T18:17:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:329 2023-07-07T18:17:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:329.out 2023-07-07T18:17:34.364 INFO:teuthology.orchestra.run.smithi012.stdout:330 2023-07-07T18:17:34.365 INFO:teuthology.orchestra.run.smithi012.stdout:330.out 2023-07-07T18:17:34.365 INFO:teuthology.orchestra.run.smithi012.stdout:331 2023-07-07T18:17:34.365 INFO:teuthology.orchestra.run.smithi012.stdout:331.out 2023-07-07T18:17:34.365 INFO:teuthology.orchestra.run.smithi012.stdout:332 2023-07-07T18:17:34.365 INFO:teuthology.orchestra.run.smithi012.stdout:332.out 2023-07-07T18:17:34.365 INFO:teuthology.orchestra.run.smithi012.stdout:333 2023-07-07T18:17:34.365 INFO:teuthology.orchestra.run.smithi012.stdout:333.out 2023-07-07T18:17:34.365 INFO:teuthology.orchestra.run.smithi012.stdout:334 2023-07-07T18:17:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:334.out 2023-07-07T18:17:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:335 2023-07-07T18:17:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:335.out 2023-07-07T18:17:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:336 2023-07-07T18:17:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:336.out 2023-07-07T18:17:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:337 2023-07-07T18:17:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:337.out 2023-07-07T18:17:34.366 INFO:teuthology.orchestra.run.smithi012.stdout:338 2023-07-07T18:17:34.367 INFO:teuthology.orchestra.run.smithi012.stdout:338.out 2023-07-07T18:17:34.367 INFO:teuthology.orchestra.run.smithi012.stdout:339 2023-07-07T18:17:34.367 INFO:teuthology.orchestra.run.smithi012.stdout:339.out 2023-07-07T18:17:34.367 INFO:teuthology.orchestra.run.smithi012.stdout:340 2023-07-07T18:17:34.367 INFO:teuthology.orchestra.run.smithi012.stdout:340.out 2023-07-07T18:17:34.367 INFO:teuthology.orchestra.run.smithi012.stdout:341 2023-07-07T18:17:34.367 INFO:teuthology.orchestra.run.smithi012.stdout:341.out 2023-07-07T18:17:34.367 INFO:teuthology.orchestra.run.smithi012.stdout:342 2023-07-07T18:17:34.368 INFO:teuthology.orchestra.run.smithi012.stdout:342.out 2023-07-07T18:17:34.368 INFO:teuthology.orchestra.run.smithi012.stdout:343 2023-07-07T18:17:34.368 INFO:teuthology.orchestra.run.smithi012.stdout:343.out 2023-07-07T18:17:34.368 INFO:teuthology.orchestra.run.smithi012.stdout:344 2023-07-07T18:17:34.368 INFO:teuthology.orchestra.run.smithi012.stdout:344.out 2023-07-07T18:17:34.368 INFO:teuthology.orchestra.run.smithi012.stdout:345 2023-07-07T18:17:34.368 INFO:teuthology.orchestra.run.smithi012.stdout:345.out 2023-07-07T18:17:34.369 INFO:teuthology.orchestra.run.smithi012.stdout:346 2023-07-07T18:17:34.369 INFO:teuthology.orchestra.run.smithi012.stdout:346.out 2023-07-07T18:17:34.369 INFO:teuthology.orchestra.run.smithi012.stdout:347 2023-07-07T18:17:34.369 INFO:teuthology.orchestra.run.smithi012.stdout:347.out 2023-07-07T18:17:34.369 INFO:teuthology.orchestra.run.smithi012.stdout:348 2023-07-07T18:17:34.369 INFO:teuthology.orchestra.run.smithi012.stdout:348.out 2023-07-07T18:17:34.369 INFO:teuthology.orchestra.run.smithi012.stdout:349 2023-07-07T18:17:34.370 INFO:teuthology.orchestra.run.smithi012.stdout:349.out 2023-07-07T18:17:34.370 INFO:teuthology.orchestra.run.smithi012.stdout:350 2023-07-07T18:17:34.370 INFO:teuthology.orchestra.run.smithi012.stdout:350.out 2023-07-07T18:17:34.370 INFO:teuthology.orchestra.run.smithi012.stdout:351 2023-07-07T18:17:34.370 INFO:teuthology.orchestra.run.smithi012.stdout:351.out 2023-07-07T18:17:34.370 INFO:teuthology.orchestra.run.smithi012.stdout:352 2023-07-07T18:17:34.370 INFO:teuthology.orchestra.run.smithi012.stdout:352.out 2023-07-07T18:17:34.371 INFO:teuthology.orchestra.run.smithi012.stdout:353 2023-07-07T18:17:34.371 INFO:teuthology.orchestra.run.smithi012.stdout:353.out 2023-07-07T18:17:34.371 INFO:teuthology.orchestra.run.smithi012.stdout:354 2023-07-07T18:17:34.371 INFO:teuthology.orchestra.run.smithi012.stdout:354.out 2023-07-07T18:17:34.371 INFO:teuthology.orchestra.run.smithi012.stdout:355 2023-07-07T18:17:34.371 INFO:teuthology.orchestra.run.smithi012.stdout:355.out 2023-07-07T18:17:34.371 INFO:teuthology.orchestra.run.smithi012.stdout:356 2023-07-07T18:17:34.371 INFO:teuthology.orchestra.run.smithi012.stdout:356.out 2023-07-07T18:17:34.372 INFO:teuthology.orchestra.run.smithi012.stdout:357 2023-07-07T18:17:34.372 INFO:teuthology.orchestra.run.smithi012.stdout:357.out 2023-07-07T18:17:34.372 INFO:teuthology.orchestra.run.smithi012.stdout:358 2023-07-07T18:17:34.372 INFO:teuthology.orchestra.run.smithi012.stdout:358.out 2023-07-07T18:17:34.372 INFO:teuthology.orchestra.run.smithi012.stdout:359 2023-07-07T18:17:34.372 INFO:teuthology.orchestra.run.smithi012.stdout:359.out 2023-07-07T18:17:34.372 INFO:teuthology.orchestra.run.smithi012.stdout:360 2023-07-07T18:17:34.372 INFO:teuthology.orchestra.run.smithi012.stdout:360.out 2023-07-07T18:17:34.373 INFO:teuthology.orchestra.run.smithi012.stdout:361 2023-07-07T18:17:34.373 INFO:teuthology.orchestra.run.smithi012.stdout:361.out 2023-07-07T18:17:34.373 INFO:teuthology.orchestra.run.smithi012.stdout:362 2023-07-07T18:17:34.373 INFO:teuthology.orchestra.run.smithi012.stdout:362.out 2023-07-07T18:17:34.373 INFO:teuthology.orchestra.run.smithi012.stdout:363 2023-07-07T18:17:34.373 INFO:teuthology.orchestra.run.smithi012.stdout:363.out 2023-07-07T18:17:34.373 INFO:teuthology.orchestra.run.smithi012.stdout:364 2023-07-07T18:17:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:364.out 2023-07-07T18:17:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:365 2023-07-07T18:17:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:365.out 2023-07-07T18:17:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:366 2023-07-07T18:17:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:366.out 2023-07-07T18:17:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:367 2023-07-07T18:17:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:367.out 2023-07-07T18:17:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:368 2023-07-07T18:17:34.375 INFO:teuthology.orchestra.run.smithi012.stdout:368.out 2023-07-07T18:17:34.375 INFO:teuthology.orchestra.run.smithi012.stdout:369 2023-07-07T18:17:34.375 INFO:teuthology.orchestra.run.smithi012.stdout:369.out 2023-07-07T18:17:34.375 INFO:teuthology.orchestra.run.smithi012.stdout:370 2023-07-07T18:17:34.375 INFO:teuthology.orchestra.run.smithi012.stdout:370.out 2023-07-07T18:17:34.375 INFO:teuthology.orchestra.run.smithi012.stdout:371 2023-07-07T18:17:34.375 INFO:teuthology.orchestra.run.smithi012.stdout:371.out 2023-07-07T18:17:34.375 INFO:teuthology.orchestra.run.smithi012.stdout:372 2023-07-07T18:17:34.376 INFO:teuthology.orchestra.run.smithi012.stdout:372.out 2023-07-07T18:17:34.376 INFO:teuthology.orchestra.run.smithi012.stdout:373 2023-07-07T18:17:34.376 INFO:teuthology.orchestra.run.smithi012.stdout:373.out 2023-07-07T18:17:34.376 INFO:teuthology.orchestra.run.smithi012.stdout:374 2023-07-07T18:17:34.376 INFO:teuthology.orchestra.run.smithi012.stdout:374.out 2023-07-07T18:17:34.376 INFO:teuthology.orchestra.run.smithi012.stdout:375 2023-07-07T18:17:34.376 INFO:teuthology.orchestra.run.smithi012.stdout:375.out 2023-07-07T18:17:34.376 INFO:teuthology.orchestra.run.smithi012.stdout:376 2023-07-07T18:17:34.377 INFO:teuthology.orchestra.run.smithi012.stdout:376.out 2023-07-07T18:17:34.377 INFO:teuthology.orchestra.run.smithi012.stdout:377 2023-07-07T18:17:34.377 INFO:teuthology.orchestra.run.smithi012.stdout:377.out 2023-07-07T18:17:34.377 INFO:teuthology.orchestra.run.smithi012.stdout:378 2023-07-07T18:17:34.377 INFO:teuthology.orchestra.run.smithi012.stdout:378.out 2023-07-07T18:17:34.377 INFO:teuthology.orchestra.run.smithi012.stdout:379 2023-07-07T18:17:34.377 INFO:teuthology.orchestra.run.smithi012.stdout:379.out 2023-07-07T18:17:34.377 INFO:teuthology.orchestra.run.smithi012.stdout:380 2023-07-07T18:17:34.378 INFO:teuthology.orchestra.run.smithi012.stdout:380.out 2023-07-07T18:17:34.378 INFO:teuthology.orchestra.run.smithi012.stdout:381 2023-07-07T18:17:34.378 INFO:teuthology.orchestra.run.smithi012.stdout:381.out 2023-07-07T18:17:34.378 INFO:teuthology.orchestra.run.smithi012.stdout:382 2023-07-07T18:17:34.378 INFO:teuthology.orchestra.run.smithi012.stdout:382.out 2023-07-07T18:17:34.378 INFO:teuthology.orchestra.run.smithi012.stdout:383 2023-07-07T18:17:34.378 INFO:teuthology.orchestra.run.smithi012.stdout:383.out 2023-07-07T18:17:34.378 INFO:teuthology.orchestra.run.smithi012.stdout:384 2023-07-07T18:17:34.379 INFO:teuthology.orchestra.run.smithi012.stdout:384.out 2023-07-07T18:17:34.379 INFO:teuthology.orchestra.run.smithi012.stdout:385 2023-07-07T18:17:34.379 INFO:teuthology.orchestra.run.smithi012.stdout:385.out 2023-07-07T18:17:34.379 INFO:teuthology.orchestra.run.smithi012.stdout:386 2023-07-07T18:17:34.379 INFO:teuthology.orchestra.run.smithi012.stdout:386.out 2023-07-07T18:17:34.379 INFO:teuthology.orchestra.run.smithi012.stdout:387 2023-07-07T18:17:34.379 INFO:teuthology.orchestra.run.smithi012.stdout:387.out 2023-07-07T18:17:34.379 INFO:teuthology.orchestra.run.smithi012.stdout:388 2023-07-07T18:17:34.380 INFO:teuthology.orchestra.run.smithi012.stdout:388.out 2023-07-07T18:17:34.380 INFO:teuthology.orchestra.run.smithi012.stdout:389 2023-07-07T18:17:34.380 INFO:teuthology.orchestra.run.smithi012.stdout:389.out 2023-07-07T18:17:34.380 INFO:teuthology.orchestra.run.smithi012.stdout:390 2023-07-07T18:17:34.380 INFO:teuthology.orchestra.run.smithi012.stdout:390.out 2023-07-07T18:17:34.381 INFO:teuthology.orchestra.run.smithi012.stdout:391 2023-07-07T18:17:34.381 INFO:teuthology.orchestra.run.smithi012.stdout:391.out 2023-07-07T18:17:34.381 INFO:teuthology.orchestra.run.smithi012.stdout:392 2023-07-07T18:17:34.381 INFO:teuthology.orchestra.run.smithi012.stdout:392.out 2023-07-07T18:17:34.381 INFO:teuthology.orchestra.run.smithi012.stdout:393 2023-07-07T18:17:34.381 INFO:teuthology.orchestra.run.smithi012.stdout:393.out 2023-07-07T18:17:34.381 INFO:teuthology.orchestra.run.smithi012.stdout:394 2023-07-07T18:17:34.381 INFO:teuthology.orchestra.run.smithi012.stdout:394.out 2023-07-07T18:17:34.382 INFO:teuthology.orchestra.run.smithi012.stdout:395 2023-07-07T18:17:34.382 INFO:teuthology.orchestra.run.smithi012.stdout:395.out 2023-07-07T18:17:34.382 INFO:teuthology.orchestra.run.smithi012.stdout:396 2023-07-07T18:17:34.382 INFO:teuthology.orchestra.run.smithi012.stdout:396.out 2023-07-07T18:17:34.382 INFO:teuthology.orchestra.run.smithi012.stdout:397 2023-07-07T18:17:34.382 INFO:teuthology.orchestra.run.smithi012.stdout:397.out 2023-07-07T18:17:34.382 INFO:teuthology.orchestra.run.smithi012.stdout:398 2023-07-07T18:17:34.382 INFO:teuthology.orchestra.run.smithi012.stdout:398.out 2023-07-07T18:17:34.383 INFO:teuthology.orchestra.run.smithi012.stdout:399 2023-07-07T18:17:34.383 INFO:teuthology.orchestra.run.smithi012.stdout:399.out 2023-07-07T18:17:34.383 INFO:teuthology.orchestra.run.smithi012.stdout:400 2023-07-07T18:17:34.383 INFO:teuthology.orchestra.run.smithi012.stdout:400.out 2023-07-07T18:17:34.383 INFO:teuthology.orchestra.run.smithi012.stdout:401 2023-07-07T18:17:34.383 INFO:teuthology.orchestra.run.smithi012.stdout:401.out 2023-07-07T18:17:34.383 INFO:teuthology.orchestra.run.smithi012.stdout:402 2023-07-07T18:17:34.383 INFO:teuthology.orchestra.run.smithi012.stdout:402.out 2023-07-07T18:17:34.384 INFO:teuthology.orchestra.run.smithi012.stdout:403 2023-07-07T18:17:34.384 INFO:teuthology.orchestra.run.smithi012.stdout:403.out 2023-07-07T18:17:34.384 INFO:teuthology.orchestra.run.smithi012.stdout:404 2023-07-07T18:17:34.384 INFO:teuthology.orchestra.run.smithi012.stdout:404.out 2023-07-07T18:17:34.384 INFO:teuthology.orchestra.run.smithi012.stdout:405 2023-07-07T18:17:34.384 INFO:teuthology.orchestra.run.smithi012.stdout:405.out 2023-07-07T18:17:34.384 INFO:teuthology.orchestra.run.smithi012.stdout:406 2023-07-07T18:17:34.384 INFO:teuthology.orchestra.run.smithi012.stdout:406.out 2023-07-07T18:17:34.385 INFO:teuthology.orchestra.run.smithi012.stdout:407 2023-07-07T18:17:34.385 INFO:teuthology.orchestra.run.smithi012.stdout:407.out 2023-07-07T18:17:34.385 INFO:teuthology.orchestra.run.smithi012.stdout:408 2023-07-07T18:17:34.385 INFO:teuthology.orchestra.run.smithi012.stdout:408.out 2023-07-07T18:17:34.385 INFO:teuthology.orchestra.run.smithi012.stdout:409 2023-07-07T18:17:34.385 INFO:teuthology.orchestra.run.smithi012.stdout:409.out 2023-07-07T18:17:34.385 INFO:teuthology.orchestra.run.smithi012.stdout:410 2023-07-07T18:17:34.386 INFO:teuthology.orchestra.run.smithi012.stdout:410.out 2023-07-07T18:17:34.386 INFO:teuthology.orchestra.run.smithi012.stdout:411 2023-07-07T18:17:34.389 INFO:teuthology.orchestra.run.smithi012.stdout:411.out 2023-07-07T18:17:34.389 INFO:teuthology.orchestra.run.smithi012.stdout:412 2023-07-07T18:17:34.389 INFO:teuthology.orchestra.run.smithi012.stdout:412.out 2023-07-07T18:17:34.389 INFO:teuthology.orchestra.run.smithi012.stdout:413 2023-07-07T18:17:34.389 INFO:teuthology.orchestra.run.smithi012.stdout:413.out 2023-07-07T18:17:34.389 INFO:teuthology.orchestra.run.smithi012.stdout:414 2023-07-07T18:17:34.389 INFO:teuthology.orchestra.run.smithi012.stdout:414.out 2023-07-07T18:17:34.390 INFO:teuthology.orchestra.run.smithi012.stdout:415 2023-07-07T18:17:34.390 INFO:teuthology.orchestra.run.smithi012.stdout:415.out 2023-07-07T18:17:34.390 INFO:teuthology.orchestra.run.smithi012.stdout:416 2023-07-07T18:17:34.390 INFO:teuthology.orchestra.run.smithi012.stdout:416.out 2023-07-07T18:17:34.390 INFO:teuthology.orchestra.run.smithi012.stdout:417 2023-07-07T18:17:34.391 INFO:teuthology.orchestra.run.smithi012.stdout:417.out 2023-07-07T18:17:34.391 INFO:teuthology.orchestra.run.smithi012.stdout:418 2023-07-07T18:17:34.391 INFO:teuthology.orchestra.run.smithi012.stdout:418.out 2023-07-07T18:17:34.391 INFO:teuthology.orchestra.run.smithi012.stdout:419 2023-07-07T18:17:34.391 INFO:teuthology.orchestra.run.smithi012.stdout:419.out 2023-07-07T18:17:34.391 INFO:teuthology.orchestra.run.smithi012.stdout:420 2023-07-07T18:17:34.391 INFO:teuthology.orchestra.run.smithi012.stdout:420.out 2023-07-07T18:17:34.391 INFO:teuthology.orchestra.run.smithi012.stdout:421 2023-07-07T18:17:34.392 INFO:teuthology.orchestra.run.smithi012.stdout:421.out 2023-07-07T18:17:34.392 INFO:teuthology.orchestra.run.smithi012.stdout:422 2023-07-07T18:17:34.392 INFO:teuthology.orchestra.run.smithi012.stdout:422.out 2023-07-07T18:17:34.392 INFO:teuthology.orchestra.run.smithi012.stdout:423 2023-07-07T18:17:34.392 INFO:teuthology.orchestra.run.smithi012.stdout:423.out 2023-07-07T18:17:34.392 INFO:teuthology.orchestra.run.smithi012.stdout:424 2023-07-07T18:17:34.392 INFO:teuthology.orchestra.run.smithi012.stdout:424.out 2023-07-07T18:17:34.393 INFO:teuthology.orchestra.run.smithi012.stdout:425 2023-07-07T18:17:34.393 INFO:teuthology.orchestra.run.smithi012.stdout:425.out 2023-07-07T18:17:34.393 INFO:teuthology.orchestra.run.smithi012.stdout:426 2023-07-07T18:17:34.393 INFO:teuthology.orchestra.run.smithi012.stdout:426.out 2023-07-07T18:17:34.393 INFO:teuthology.orchestra.run.smithi012.stdout:427 2023-07-07T18:17:34.393 INFO:teuthology.orchestra.run.smithi012.stdout:427.out 2023-07-07T18:17:34.393 INFO:teuthology.orchestra.run.smithi012.stdout:428 2023-07-07T18:17:34.393 INFO:teuthology.orchestra.run.smithi012.stdout:428.out 2023-07-07T18:17:34.394 INFO:teuthology.orchestra.run.smithi012.stdout:429 2023-07-07T18:17:34.394 INFO:teuthology.orchestra.run.smithi012.stdout:429.out 2023-07-07T18:17:34.394 INFO:teuthology.orchestra.run.smithi012.stdout:430 2023-07-07T18:17:34.394 INFO:teuthology.orchestra.run.smithi012.stdout:430.out 2023-07-07T18:17:34.394 INFO:teuthology.orchestra.run.smithi012.stdout:431 2023-07-07T18:17:34.394 INFO:teuthology.orchestra.run.smithi012.stdout:431.out 2023-07-07T18:17:34.394 INFO:teuthology.orchestra.run.smithi012.stdout:432 2023-07-07T18:17:34.394 INFO:teuthology.orchestra.run.smithi012.stdout:432.out 2023-07-07T18:17:34.395 INFO:teuthology.orchestra.run.smithi012.stdout:433 2023-07-07T18:17:34.395 INFO:teuthology.orchestra.run.smithi012.stdout:433.out 2023-07-07T18:17:34.395 INFO:teuthology.orchestra.run.smithi012.stdout:434 2023-07-07T18:17:34.395 INFO:teuthology.orchestra.run.smithi012.stdout:434.out 2023-07-07T18:17:34.395 INFO:teuthology.orchestra.run.smithi012.stdout:435 2023-07-07T18:17:34.395 INFO:teuthology.orchestra.run.smithi012.stdout:435.out 2023-07-07T18:17:34.395 INFO:teuthology.orchestra.run.smithi012.stdout:436 2023-07-07T18:17:34.395 INFO:teuthology.orchestra.run.smithi012.stdout:436.out 2023-07-07T18:17:34.396 INFO:teuthology.orchestra.run.smithi012.stdout:437 2023-07-07T18:17:34.396 INFO:teuthology.orchestra.run.smithi012.stdout:437.out 2023-07-07T18:17:34.396 INFO:teuthology.orchestra.run.smithi012.stdout:438 2023-07-07T18:17:34.396 INFO:teuthology.orchestra.run.smithi012.stdout:438.out 2023-07-07T18:17:34.396 INFO:teuthology.orchestra.run.smithi012.stdout:439 2023-07-07T18:17:34.396 INFO:teuthology.orchestra.run.smithi012.stdout:439.out 2023-07-07T18:17:34.396 INFO:teuthology.orchestra.run.smithi012.stdout:440 2023-07-07T18:17:34.396 INFO:teuthology.orchestra.run.smithi012.stdout:440.out 2023-07-07T18:17:34.397 INFO:teuthology.orchestra.run.smithi012.stdout:441 2023-07-07T18:17:34.397 INFO:teuthology.orchestra.run.smithi012.stdout:441.out 2023-07-07T18:17:34.397 INFO:teuthology.orchestra.run.smithi012.stdout:442 2023-07-07T18:17:34.397 INFO:teuthology.orchestra.run.smithi012.stdout:442.out 2023-07-07T18:17:34.397 INFO:teuthology.orchestra.run.smithi012.stdout:443 2023-07-07T18:17:34.397 INFO:teuthology.orchestra.run.smithi012.stdout:443.out 2023-07-07T18:17:34.397 INFO:teuthology.orchestra.run.smithi012.stdout:444 2023-07-07T18:17:34.398 INFO:teuthology.orchestra.run.smithi012.stdout:444.out 2023-07-07T18:17:34.398 INFO:teuthology.orchestra.run.smithi012.stdout:445 2023-07-07T18:17:34.398 INFO:teuthology.orchestra.run.smithi012.stdout:445.out 2023-07-07T18:17:34.398 INFO:teuthology.orchestra.run.smithi012.stdout:446 2023-07-07T18:17:34.398 INFO:teuthology.orchestra.run.smithi012.stdout:446.out 2023-07-07T18:17:34.398 INFO:teuthology.orchestra.run.smithi012.stdout:447 2023-07-07T18:17:34.398 INFO:teuthology.orchestra.run.smithi012.stdout:447.out 2023-07-07T18:17:34.398 INFO:teuthology.orchestra.run.smithi012.stdout:448 2023-07-07T18:17:34.399 INFO:teuthology.orchestra.run.smithi012.stdout:448.out 2023-07-07T18:17:34.399 INFO:teuthology.orchestra.run.smithi012.stdout:449 2023-07-07T18:17:34.399 INFO:teuthology.orchestra.run.smithi012.stdout:449.out 2023-07-07T18:17:34.399 INFO:teuthology.orchestra.run.smithi012.stdout:450 2023-07-07T18:17:34.400 INFO:teuthology.orchestra.run.smithi012.stdout:450.out 2023-07-07T18:17:34.400 INFO:teuthology.orchestra.run.smithi012.stdout:451 2023-07-07T18:17:34.400 INFO:teuthology.orchestra.run.smithi012.stdout:451.out 2023-07-07T18:17:34.400 INFO:teuthology.orchestra.run.smithi012.stdout:452 2023-07-07T18:17:34.400 INFO:teuthology.orchestra.run.smithi012.stdout:452.out 2023-07-07T18:17:34.400 INFO:teuthology.orchestra.run.smithi012.stdout:453 2023-07-07T18:17:34.400 INFO:teuthology.orchestra.run.smithi012.stdout:453.out 2023-07-07T18:17:34.401 INFO:teuthology.orchestra.run.smithi012.stdout:454 2023-07-07T18:17:34.401 INFO:teuthology.orchestra.run.smithi012.stdout:454.out 2023-07-07T18:17:34.401 INFO:teuthology.orchestra.run.smithi012.stdout:455 2023-07-07T18:17:34.401 INFO:teuthology.orchestra.run.smithi012.stdout:455.out 2023-07-07T18:17:34.401 INFO:teuthology.orchestra.run.smithi012.stdout:456 2023-07-07T18:17:34.401 INFO:teuthology.orchestra.run.smithi012.stdout:456.out 2023-07-07T18:17:34.402 INFO:teuthology.orchestra.run.smithi012.stdout:457 2023-07-07T18:17:34.402 INFO:teuthology.orchestra.run.smithi012.stdout:457.out 2023-07-07T18:17:34.402 INFO:teuthology.orchestra.run.smithi012.stdout:458 2023-07-07T18:17:34.402 INFO:teuthology.orchestra.run.smithi012.stdout:458.out 2023-07-07T18:17:34.402 INFO:teuthology.orchestra.run.smithi012.stdout:459 2023-07-07T18:17:34.402 INFO:teuthology.orchestra.run.smithi012.stdout:459.out 2023-07-07T18:17:34.402 INFO:teuthology.orchestra.run.smithi012.stdout:460 2023-07-07T18:17:34.402 INFO:teuthology.orchestra.run.smithi012.stdout:460.out 2023-07-07T18:17:34.403 INFO:teuthology.orchestra.run.smithi012.stdout:461 2023-07-07T18:17:34.403 INFO:teuthology.orchestra.run.smithi012.stdout:461.out 2023-07-07T18:17:34.403 INFO:teuthology.orchestra.run.smithi012.stdout:462 2023-07-07T18:17:34.403 INFO:teuthology.orchestra.run.smithi012.stdout:462.out 2023-07-07T18:17:34.403 INFO:teuthology.orchestra.run.smithi012.stdout:463 2023-07-07T18:17:34.403 INFO:teuthology.orchestra.run.smithi012.stdout:463.out 2023-07-07T18:17:34.403 INFO:teuthology.orchestra.run.smithi012.stdout:464 2023-07-07T18:17:34.404 INFO:teuthology.orchestra.run.smithi012.stdout:464.out 2023-07-07T18:17:34.404 INFO:teuthology.orchestra.run.smithi012.stdout:465 2023-07-07T18:17:34.404 INFO:teuthology.orchestra.run.smithi012.stdout:465.out 2023-07-07T18:17:34.404 INFO:teuthology.orchestra.run.smithi012.stdout:466 2023-07-07T18:17:34.404 INFO:teuthology.orchestra.run.smithi012.stdout:466.out 2023-07-07T18:17:34.405 INFO:teuthology.orchestra.run.smithi012.stdout:467 2023-07-07T18:17:34.405 INFO:teuthology.orchestra.run.smithi012.stdout:467.out 2023-07-07T18:17:34.405 INFO:teuthology.orchestra.run.smithi012.stdout:468 2023-07-07T18:17:34.405 INFO:teuthology.orchestra.run.smithi012.stdout:468.out 2023-07-07T18:17:34.405 INFO:teuthology.orchestra.run.smithi012.stdout:469 2023-07-07T18:17:34.405 INFO:teuthology.orchestra.run.smithi012.stdout:469.out 2023-07-07T18:17:34.405 INFO:teuthology.orchestra.run.smithi012.stdout:470 2023-07-07T18:17:34.406 INFO:teuthology.orchestra.run.smithi012.stdout:470.out 2023-07-07T18:17:34.406 INFO:teuthology.orchestra.run.smithi012.stdout:471 2023-07-07T18:17:34.406 INFO:teuthology.orchestra.run.smithi012.stdout:471.out 2023-07-07T18:17:34.406 INFO:teuthology.orchestra.run.smithi012.stdout:472 2023-07-07T18:17:34.406 INFO:teuthology.orchestra.run.smithi012.stdout:472.out 2023-07-07T18:17:34.406 INFO:teuthology.orchestra.run.smithi012.stdout:473 2023-07-07T18:17:34.406 INFO:teuthology.orchestra.run.smithi012.stdout:473.out 2023-07-07T18:17:34.406 INFO:teuthology.orchestra.run.smithi012.stdout:474 2023-07-07T18:17:34.407 INFO:teuthology.orchestra.run.smithi012.stdout:474.out 2023-07-07T18:17:34.407 INFO:teuthology.orchestra.run.smithi012.stdout:475 2023-07-07T18:17:34.407 INFO:teuthology.orchestra.run.smithi012.stdout:475.out 2023-07-07T18:17:34.407 INFO:teuthology.orchestra.run.smithi012.stdout:476 2023-07-07T18:17:34.407 INFO:teuthology.orchestra.run.smithi012.stdout:476.out 2023-07-07T18:17:34.407 INFO:teuthology.orchestra.run.smithi012.stdout:477 2023-07-07T18:17:34.407 INFO:teuthology.orchestra.run.smithi012.stdout:477.out 2023-07-07T18:17:34.407 INFO:teuthology.orchestra.run.smithi012.stdout:478 2023-07-07T18:17:34.408 INFO:teuthology.orchestra.run.smithi012.stdout:478.out 2023-07-07T18:17:34.408 INFO:teuthology.orchestra.run.smithi012.stdout:479 2023-07-07T18:17:34.408 INFO:teuthology.orchestra.run.smithi012.stdout:479.out 2023-07-07T18:17:34.408 INFO:teuthology.orchestra.run.smithi012.stdout:480 2023-07-07T18:17:34.408 INFO:teuthology.orchestra.run.smithi012.stdout:480.out 2023-07-07T18:17:34.408 INFO:teuthology.orchestra.run.smithi012.stdout:481 2023-07-07T18:17:34.408 INFO:teuthology.orchestra.run.smithi012.stdout:481.out 2023-07-07T18:17:34.409 INFO:teuthology.orchestra.run.smithi012.stdout:482 2023-07-07T18:17:34.409 INFO:teuthology.orchestra.run.smithi012.stdout:482.out 2023-07-07T18:17:34.409 INFO:teuthology.orchestra.run.smithi012.stdout:483 2023-07-07T18:17:34.409 INFO:teuthology.orchestra.run.smithi012.stdout:483.out 2023-07-07T18:17:34.409 INFO:teuthology.orchestra.run.smithi012.stdout:484 2023-07-07T18:17:34.409 INFO:teuthology.orchestra.run.smithi012.stdout:484.out 2023-07-07T18:17:34.409 INFO:teuthology.orchestra.run.smithi012.stdout:485 2023-07-07T18:17:34.409 INFO:teuthology.orchestra.run.smithi012.stdout:485.out 2023-07-07T18:17:34.410 INFO:teuthology.orchestra.run.smithi012.stdout:486 2023-07-07T18:17:34.410 INFO:teuthology.orchestra.run.smithi012.stdout:486.out 2023-07-07T18:17:34.410 INFO:teuthology.orchestra.run.smithi012.stdout:487 2023-07-07T18:17:34.410 INFO:teuthology.orchestra.run.smithi012.stdout:487.out 2023-07-07T18:17:34.410 INFO:teuthology.orchestra.run.smithi012.stdout:488 2023-07-07T18:17:34.410 INFO:teuthology.orchestra.run.smithi012.stdout:488.out 2023-07-07T18:17:34.410 INFO:teuthology.orchestra.run.smithi012.stdout:489 2023-07-07T18:17:34.410 INFO:teuthology.orchestra.run.smithi012.stdout:489.out 2023-07-07T18:17:34.411 INFO:teuthology.orchestra.run.smithi012.stdout:490 2023-07-07T18:17:34.411 INFO:teuthology.orchestra.run.smithi012.stdout:490.out 2023-07-07T18:17:34.411 INFO:teuthology.orchestra.run.smithi012.stdout:491 2023-07-07T18:17:34.411 INFO:teuthology.orchestra.run.smithi012.stdout:491.out 2023-07-07T18:17:34.411 INFO:teuthology.orchestra.run.smithi012.stdout:492 2023-07-07T18:17:34.411 INFO:teuthology.orchestra.run.smithi012.stdout:492.out 2023-07-07T18:17:34.412 INFO:teuthology.orchestra.run.smithi012.stdout:493 2023-07-07T18:17:34.412 INFO:teuthology.orchestra.run.smithi012.stdout:493.out 2023-07-07T18:17:34.412 INFO:teuthology.orchestra.run.smithi012.stdout:494 2023-07-07T18:17:34.412 INFO:teuthology.orchestra.run.smithi012.stdout:494.out 2023-07-07T18:17:34.412 INFO:teuthology.orchestra.run.smithi012.stdout:495 2023-07-07T18:17:34.412 INFO:teuthology.orchestra.run.smithi012.stdout:495.out 2023-07-07T18:17:34.412 INFO:teuthology.orchestra.run.smithi012.stdout:496 2023-07-07T18:17:34.413 INFO:teuthology.orchestra.run.smithi012.stdout:496.out 2023-07-07T18:17:34.413 INFO:teuthology.orchestra.run.smithi012.stdout:497 2023-07-07T18:17:34.413 INFO:teuthology.orchestra.run.smithi012.stdout:497.out 2023-07-07T18:17:34.413 INFO:teuthology.orchestra.run.smithi012.stdout:498 2023-07-07T18:17:34.413 INFO:teuthology.orchestra.run.smithi012.stdout:498.out 2023-07-07T18:17:34.413 INFO:teuthology.orchestra.run.smithi012.stdout:499 2023-07-07T18:17:34.413 INFO:teuthology.orchestra.run.smithi012.stdout:499.out 2023-07-07T18:17:34.413 INFO:teuthology.orchestra.run.smithi012.stdout:500 2023-07-07T18:17:34.414 INFO:teuthology.orchestra.run.smithi012.stdout:500.out 2023-07-07T18:17:34.414 INFO:teuthology.orchestra.run.smithi012.stdout:501 2023-07-07T18:17:34.414 INFO:teuthology.orchestra.run.smithi012.stdout:501.out 2023-07-07T18:17:34.414 INFO:teuthology.orchestra.run.smithi012.stdout:502 2023-07-07T18:17:34.414 INFO:teuthology.orchestra.run.smithi012.stdout:502.out 2023-07-07T18:17:34.414 INFO:teuthology.orchestra.run.smithi012.stdout:503 2023-07-07T18:17:34.414 INFO:teuthology.orchestra.run.smithi012.stdout:503.out 2023-07-07T18:17:34.414 INFO:teuthology.orchestra.run.smithi012.stdout:504 2023-07-07T18:17:34.415 INFO:teuthology.orchestra.run.smithi012.stdout:504.out 2023-07-07T18:17:34.415 INFO:teuthology.orchestra.run.smithi012.stdout:505 2023-07-07T18:17:34.415 INFO:teuthology.orchestra.run.smithi012.stdout:505.out 2023-07-07T18:17:34.415 INFO:teuthology.orchestra.run.smithi012.stdout:506 2023-07-07T18:17:34.415 INFO:teuthology.orchestra.run.smithi012.stdout:506.out 2023-07-07T18:17:34.415 INFO:teuthology.orchestra.run.smithi012.stdout:507 2023-07-07T18:17:34.415 INFO:teuthology.orchestra.run.smithi012.stdout:507.out 2023-07-07T18:17:34.415 INFO:teuthology.orchestra.run.smithi012.stdout:508 2023-07-07T18:17:34.416 INFO:teuthology.orchestra.run.smithi012.stdout:508.out 2023-07-07T18:17:34.416 INFO:teuthology.orchestra.run.smithi012.stdout:509 2023-07-07T18:17:34.416 INFO:teuthology.orchestra.run.smithi012.stdout:509.out 2023-07-07T18:17:34.416 INFO:teuthology.orchestra.run.smithi012.stdout:510 2023-07-07T18:17:34.416 INFO:teuthology.orchestra.run.smithi012.stdout:510.out 2023-07-07T18:17:34.416 INFO:teuthology.orchestra.run.smithi012.stdout:511 2023-07-07T18:17:34.416 INFO:teuthology.orchestra.run.smithi012.stdout:511.out 2023-07-07T18:17:34.417 INFO:teuthology.orchestra.run.smithi012.stdout:512 2023-07-07T18:17:34.417 INFO:teuthology.orchestra.run.smithi012.stdout:512.out 2023-07-07T18:17:34.417 INFO:teuthology.orchestra.run.smithi012.stdout:513 2023-07-07T18:17:34.417 INFO:teuthology.orchestra.run.smithi012.stdout:513.out 2023-07-07T18:17:34.417 INFO:teuthology.orchestra.run.smithi012.stdout:514 2023-07-07T18:17:34.417 INFO:teuthology.orchestra.run.smithi012.stdout:514.out 2023-07-07T18:17:34.418 INFO:teuthology.orchestra.run.smithi012.stdout:515 2023-07-07T18:17:34.418 INFO:teuthology.orchestra.run.smithi012.stdout:515.out 2023-07-07T18:17:34.418 INFO:teuthology.orchestra.run.smithi012.stdout:516 2023-07-07T18:17:34.418 INFO:teuthology.orchestra.run.smithi012.stdout:516.out 2023-07-07T18:17:34.418 INFO:teuthology.orchestra.run.smithi012.stdout:517 2023-07-07T18:17:34.418 INFO:teuthology.orchestra.run.smithi012.stdout:517.out 2023-07-07T18:17:34.418 INFO:teuthology.orchestra.run.smithi012.stdout:518 2023-07-07T18:17:34.418 INFO:teuthology.orchestra.run.smithi012.stdout:518.out 2023-07-07T18:17:34.419 INFO:teuthology.orchestra.run.smithi012.stdout:519 2023-07-07T18:17:34.419 INFO:teuthology.orchestra.run.smithi012.stdout:519.out 2023-07-07T18:17:34.419 INFO:teuthology.orchestra.run.smithi012.stdout:520 2023-07-07T18:17:34.419 INFO:teuthology.orchestra.run.smithi012.stdout:520.out 2023-07-07T18:17:34.419 INFO:teuthology.orchestra.run.smithi012.stdout:521 2023-07-07T18:17:34.419 INFO:teuthology.orchestra.run.smithi012.stdout:521.out 2023-07-07T18:17:34.419 INFO:teuthology.orchestra.run.smithi012.stdout:522 2023-07-07T18:17:34.419 INFO:teuthology.orchestra.run.smithi012.stdout:522.out 2023-07-07T18:17:34.420 INFO:teuthology.orchestra.run.smithi012.stdout:523 2023-07-07T18:17:34.420 INFO:teuthology.orchestra.run.smithi012.stdout:523.out 2023-07-07T18:17:34.420 INFO:teuthology.orchestra.run.smithi012.stdout:524 2023-07-07T18:17:34.420 INFO:teuthology.orchestra.run.smithi012.stdout:524.out 2023-07-07T18:17:34.420 INFO:teuthology.orchestra.run.smithi012.stdout:525 2023-07-07T18:17:34.420 INFO:teuthology.orchestra.run.smithi012.stdout:525.out 2023-07-07T18:17:34.420 INFO:teuthology.orchestra.run.smithi012.stdout:526 2023-07-07T18:17:34.421 INFO:teuthology.orchestra.run.smithi012.stdout:526.out 2023-07-07T18:17:34.421 INFO:teuthology.orchestra.run.smithi012.stdout:527 2023-07-07T18:17:34.421 INFO:teuthology.orchestra.run.smithi012.stdout:527.out 2023-07-07T18:17:34.421 INFO:teuthology.orchestra.run.smithi012.stdout:528 2023-07-07T18:17:34.421 INFO:teuthology.orchestra.run.smithi012.stdout:528.out 2023-07-07T18:17:34.421 INFO:teuthology.orchestra.run.smithi012.stdout:529 2023-07-07T18:17:34.421 INFO:teuthology.orchestra.run.smithi012.stdout:529.out 2023-07-07T18:17:34.422 INFO:teuthology.orchestra.run.smithi012.stdout:530 2023-07-07T18:17:34.422 INFO:teuthology.orchestra.run.smithi012.stdout:530.out 2023-07-07T18:17:34.422 INFO:teuthology.orchestra.run.smithi012.stdout:531 2023-07-07T18:17:34.422 INFO:teuthology.orchestra.run.smithi012.stdout:531.out 2023-07-07T18:17:34.422 INFO:teuthology.orchestra.run.smithi012.stdout:532 2023-07-07T18:17:34.422 INFO:teuthology.orchestra.run.smithi012.stdout:532.out 2023-07-07T18:17:34.422 INFO:teuthology.orchestra.run.smithi012.stdout:533 2023-07-07T18:17:34.423 INFO:teuthology.orchestra.run.smithi012.stdout:533.out 2023-07-07T18:17:34.423 INFO:teuthology.orchestra.run.smithi012.stdout:534 2023-07-07T18:17:34.423 INFO:teuthology.orchestra.run.smithi012.stdout:534.out 2023-07-07T18:17:34.423 INFO:teuthology.orchestra.run.smithi012.stdout:535 2023-07-07T18:17:34.423 INFO:teuthology.orchestra.run.smithi012.stdout:535.out 2023-07-07T18:17:34.423 INFO:teuthology.orchestra.run.smithi012.stdout:536 2023-07-07T18:17:34.423 INFO:teuthology.orchestra.run.smithi012.stdout:536.out 2023-07-07T18:17:34.423 INFO:teuthology.orchestra.run.smithi012.stdout:537 2023-07-07T18:17:34.424 INFO:teuthology.orchestra.run.smithi012.stdout:537.out 2023-07-07T18:17:34.424 INFO:teuthology.orchestra.run.smithi012.stdout:538 2023-07-07T18:17:34.424 INFO:teuthology.orchestra.run.smithi012.stdout:538.out 2023-07-07T18:17:34.424 INFO:teuthology.orchestra.run.smithi012.stdout:539 2023-07-07T18:17:34.424 INFO:teuthology.orchestra.run.smithi012.stdout:539.out 2023-07-07T18:17:34.424 INFO:teuthology.orchestra.run.smithi012.stdout:540 2023-07-07T18:17:34.424 INFO:teuthology.orchestra.run.smithi012.stdout:540.out 2023-07-07T18:17:34.425 INFO:teuthology.orchestra.run.smithi012.stdout:541 2023-07-07T18:17:34.425 INFO:teuthology.orchestra.run.smithi012.stdout:541.out 2023-07-07T18:17:34.425 INFO:teuthology.orchestra.run.smithi012.stdout:542 2023-07-07T18:17:34.425 INFO:teuthology.orchestra.run.smithi012.stdout:542.out 2023-07-07T18:17:34.425 INFO:teuthology.orchestra.run.smithi012.stdout:543 2023-07-07T18:17:34.425 INFO:teuthology.orchestra.run.smithi012.stdout:543.out 2023-07-07T18:17:34.425 INFO:teuthology.orchestra.run.smithi012.stdout:544 2023-07-07T18:17:34.425 INFO:teuthology.orchestra.run.smithi012.stdout:544.out 2023-07-07T18:17:34.426 INFO:teuthology.orchestra.run.smithi012.stdout:545 2023-07-07T18:17:34.426 INFO:teuthology.orchestra.run.smithi012.stdout:545.out 2023-07-07T18:17:34.426 INFO:teuthology.orchestra.run.smithi012.stdout:546 2023-07-07T18:17:34.426 INFO:teuthology.orchestra.run.smithi012.stdout:546.out 2023-07-07T18:17:34.426 INFO:teuthology.orchestra.run.smithi012.stdout:547 2023-07-07T18:17:34.426 INFO:teuthology.orchestra.run.smithi012.stdout:547.out 2023-07-07T18:17:34.426 INFO:teuthology.orchestra.run.smithi012.stdout:548 2023-07-07T18:17:34.426 INFO:teuthology.orchestra.run.smithi012.stdout:548.out 2023-07-07T18:17:34.427 INFO:teuthology.orchestra.run.smithi012.stdout:549 2023-07-07T18:17:34.427 INFO:teuthology.orchestra.run.smithi012.stdout:549.out 2023-07-07T18:17:34.427 INFO:teuthology.orchestra.run.smithi012.stdout:550 2023-07-07T18:17:34.427 INFO:teuthology.orchestra.run.smithi012.stdout:550.out 2023-07-07T18:17:34.427 INFO:teuthology.orchestra.run.smithi012.stdout:551 2023-07-07T18:17:34.427 INFO:teuthology.orchestra.run.smithi012.stdout:551.out 2023-07-07T18:17:34.427 INFO:teuthology.orchestra.run.smithi012.stdout:552 2023-07-07T18:17:34.427 INFO:teuthology.orchestra.run.smithi012.stdout:552.out 2023-07-07T18:17:34.428 INFO:teuthology.orchestra.run.smithi012.stdout:553 2023-07-07T18:17:34.428 INFO:teuthology.orchestra.run.smithi012.stdout:553.out 2023-07-07T18:17:34.428 INFO:teuthology.orchestra.run.smithi012.stdout:554 2023-07-07T18:17:34.428 INFO:teuthology.orchestra.run.smithi012.stdout:554.out 2023-07-07T18:17:34.428 INFO:teuthology.orchestra.run.smithi012.stdout:555 2023-07-07T18:17:34.428 INFO:teuthology.orchestra.run.smithi012.stdout:555.out 2023-07-07T18:17:34.428 INFO:teuthology.orchestra.run.smithi012.stdout:556 2023-07-07T18:17:34.429 INFO:teuthology.orchestra.run.smithi012.stdout:556.out 2023-07-07T18:17:34.429 INFO:teuthology.orchestra.run.smithi012.stdout:557 2023-07-07T18:17:34.429 INFO:teuthology.orchestra.run.smithi012.stdout:557.out 2023-07-07T18:17:34.429 INFO:teuthology.orchestra.run.smithi012.stdout:558 2023-07-07T18:17:34.429 INFO:teuthology.orchestra.run.smithi012.stdout:558.out 2023-07-07T18:17:34.429 INFO:teuthology.orchestra.run.smithi012.stdout:559 2023-07-07T18:17:34.429 INFO:teuthology.orchestra.run.smithi012.stdout:559.out 2023-07-07T18:17:34.430 INFO:teuthology.orchestra.run.smithi012.stdout:560 2023-07-07T18:17:34.430 INFO:teuthology.orchestra.run.smithi012.stdout:560.out 2023-07-07T18:17:34.430 INFO:teuthology.orchestra.run.smithi012.stdout:561 2023-07-07T18:17:34.430 INFO:teuthology.orchestra.run.smithi012.stdout:561.out 2023-07-07T18:17:34.430 INFO:teuthology.orchestra.run.smithi012.stdout:562 2023-07-07T18:17:34.430 INFO:teuthology.orchestra.run.smithi012.stdout:562.out 2023-07-07T18:17:34.430 INFO:teuthology.orchestra.run.smithi012.stdout:563 2023-07-07T18:17:34.430 INFO:teuthology.orchestra.run.smithi012.stdout:563.out 2023-07-07T18:17:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:564 2023-07-07T18:17:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:564.out 2023-07-07T18:17:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:565 2023-07-07T18:17:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:565.out 2023-07-07T18:17:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:566 2023-07-07T18:17:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:566.out 2023-07-07T18:17:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:567 2023-07-07T18:17:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:567.out 2023-07-07T18:17:34.432 INFO:teuthology.orchestra.run.smithi012.stdout:568 2023-07-07T18:17:34.432 INFO:teuthology.orchestra.run.smithi012.stdout:568.out 2023-07-07T18:17:34.432 INFO:teuthology.orchestra.run.smithi012.stdout:569 2023-07-07T18:17:34.432 INFO:teuthology.orchestra.run.smithi012.stdout:569.out 2023-07-07T18:17:34.432 INFO:teuthology.orchestra.run.smithi012.stdout:570 2023-07-07T18:17:34.432 INFO:teuthology.orchestra.run.smithi012.stdout:570.out 2023-07-07T18:17:34.433 INFO:teuthology.orchestra.run.smithi012.stdout:571 2023-07-07T18:17:34.433 INFO:teuthology.orchestra.run.smithi012.stdout:571.out 2023-07-07T18:17:34.433 INFO:teuthology.orchestra.run.smithi012.stdout:572 2023-07-07T18:17:34.433 INFO:teuthology.orchestra.run.smithi012.stdout:572.out 2023-07-07T18:17:34.433 INFO:teuthology.orchestra.run.smithi012.stdout:573 2023-07-07T18:17:34.433 INFO:teuthology.orchestra.run.smithi012.stdout:573.out 2023-07-07T18:17:34.433 INFO:teuthology.orchestra.run.smithi012.stdout:574 2023-07-07T18:17:34.434 INFO:teuthology.orchestra.run.smithi012.stdout:574.out 2023-07-07T18:17:34.434 INFO:teuthology.orchestra.run.smithi012.stdout:575 2023-07-07T18:17:34.434 INFO:teuthology.orchestra.run.smithi012.stdout:575.out 2023-07-07T18:17:34.434 INFO:teuthology.orchestra.run.smithi012.stdout:576 2023-07-07T18:17:34.434 INFO:teuthology.orchestra.run.smithi012.stdout:576.out 2023-07-07T18:17:34.434 INFO:teuthology.orchestra.run.smithi012.stdout:577 2023-07-07T18:17:34.434 INFO:teuthology.orchestra.run.smithi012.stdout:577.out 2023-07-07T18:17:34.434 INFO:teuthology.orchestra.run.smithi012.stdout:578 2023-07-07T18:17:34.435 INFO:teuthology.orchestra.run.smithi012.stdout:578.out 2023-07-07T18:17:34.435 INFO:teuthology.orchestra.run.smithi012.stdout:579 2023-07-07T18:17:34.435 INFO:teuthology.orchestra.run.smithi012.stdout:579.out 2023-07-07T18:17:34.435 INFO:teuthology.orchestra.run.smithi012.stdout:580 2023-07-07T18:17:34.435 INFO:teuthology.orchestra.run.smithi012.stdout:580.out 2023-07-07T18:17:34.435 INFO:teuthology.orchestra.run.smithi012.stdout:581 2023-07-07T18:17:34.435 INFO:teuthology.orchestra.run.smithi012.stdout:581.out 2023-07-07T18:17:34.435 INFO:teuthology.orchestra.run.smithi012.stdout:582 2023-07-07T18:17:34.436 INFO:teuthology.orchestra.run.smithi012.stdout:582.out 2023-07-07T18:17:34.436 INFO:teuthology.orchestra.run.smithi012.stdout:583 2023-07-07T18:17:34.436 INFO:teuthology.orchestra.run.smithi012.stdout:583.out 2023-07-07T18:17:34.436 INFO:teuthology.orchestra.run.smithi012.stdout:584 2023-07-07T18:17:34.436 INFO:teuthology.orchestra.run.smithi012.stdout:584.out 2023-07-07T18:17:34.436 INFO:teuthology.orchestra.run.smithi012.stdout:585 2023-07-07T18:17:34.436 INFO:teuthology.orchestra.run.smithi012.stdout:585.out 2023-07-07T18:17:34.436 INFO:teuthology.orchestra.run.smithi012.stdout:586 2023-07-07T18:17:34.437 INFO:teuthology.orchestra.run.smithi012.stdout:586.out 2023-07-07T18:17:34.437 INFO:teuthology.orchestra.run.smithi012.stdout:587 2023-07-07T18:17:34.437 INFO:teuthology.orchestra.run.smithi012.stdout:587.out 2023-07-07T18:17:34.437 INFO:teuthology.orchestra.run.smithi012.stdout:588 2023-07-07T18:17:34.437 INFO:teuthology.orchestra.run.smithi012.stdout:588.out 2023-07-07T18:17:34.437 INFO:teuthology.orchestra.run.smithi012.stdout:589 2023-07-07T18:17:34.437 INFO:teuthology.orchestra.run.smithi012.stdout:589.out 2023-07-07T18:17:34.437 INFO:teuthology.orchestra.run.smithi012.stdout:590 2023-07-07T18:17:34.438 INFO:teuthology.orchestra.run.smithi012.stdout:590.out 2023-07-07T18:17:34.438 INFO:teuthology.orchestra.run.smithi012.stdout:591 2023-07-07T18:17:34.438 INFO:teuthology.orchestra.run.smithi012.stdout:591.out 2023-07-07T18:17:34.438 INFO:teuthology.orchestra.run.smithi012.stdout:592 2023-07-07T18:17:34.438 INFO:teuthology.orchestra.run.smithi012.stdout:592.out 2023-07-07T18:17:34.438 INFO:teuthology.orchestra.run.smithi012.stdout:593 2023-07-07T18:17:34.438 INFO:teuthology.orchestra.run.smithi012.stdout:593.out 2023-07-07T18:17:34.438 INFO:teuthology.orchestra.run.smithi012.stdout:594 2023-07-07T18:17:34.439 INFO:teuthology.orchestra.run.smithi012.stdout:594.out 2023-07-07T18:17:34.439 INFO:teuthology.orchestra.run.smithi012.stdout:595 2023-07-07T18:17:34.439 INFO:teuthology.orchestra.run.smithi012.stdout:595.out 2023-07-07T18:17:34.439 INFO:teuthology.orchestra.run.smithi012.stdout:596 2023-07-07T18:17:34.439 INFO:teuthology.orchestra.run.smithi012.stdout:596.out 2023-07-07T18:17:34.439 INFO:teuthology.orchestra.run.smithi012.stdout:597 2023-07-07T18:17:34.439 INFO:teuthology.orchestra.run.smithi012.stdout:597.out 2023-07-07T18:17:34.439 INFO:teuthology.orchestra.run.smithi012.stdout:598 2023-07-07T18:17:34.440 INFO:teuthology.orchestra.run.smithi012.stdout:598.out 2023-07-07T18:17:34.440 INFO:teuthology.orchestra.run.smithi012.stdout:599 2023-07-07T18:17:34.440 INFO:teuthology.orchestra.run.smithi012.stdout:599.out 2023-07-07T18:17:34.440 INFO:teuthology.orchestra.run.smithi012.stdout:600 2023-07-07T18:17:34.440 INFO:teuthology.orchestra.run.smithi012.stdout:600.out 2023-07-07T18:17:34.440 INFO:teuthology.orchestra.run.smithi012.stdout:601 2023-07-07T18:17:34.440 INFO:teuthology.orchestra.run.smithi012.stdout:601.out 2023-07-07T18:17:34.441 INFO:teuthology.orchestra.run.smithi012.stdout:602 2023-07-07T18:17:34.441 INFO:teuthology.orchestra.run.smithi012.stdout:602.out 2023-07-07T18:17:34.441 INFO:teuthology.orchestra.run.smithi012.stdout:603 2023-07-07T18:17:34.441 INFO:teuthology.orchestra.run.smithi012.stdout:603.out 2023-07-07T18:17:34.441 INFO:teuthology.orchestra.run.smithi012.stdout:604 2023-07-07T18:17:34.441 INFO:teuthology.orchestra.run.smithi012.stdout:604.out 2023-07-07T18:17:34.441 INFO:teuthology.orchestra.run.smithi012.stdout:605 2023-07-07T18:17:34.441 INFO:teuthology.orchestra.run.smithi012.stdout:605.out 2023-07-07T18:17:34.442 INFO:teuthology.orchestra.run.smithi012.stdout:606 2023-07-07T18:17:34.442 INFO:teuthology.orchestra.run.smithi012.stdout:606.out 2023-07-07T18:17:34.442 INFO:teuthology.orchestra.run.smithi012.stdout:607 2023-07-07T18:17:34.442 INFO:teuthology.orchestra.run.smithi012.stdout:607.out 2023-07-07T18:17:34.442 INFO:teuthology.orchestra.run.smithi012.stdout:608 2023-07-07T18:17:34.442 INFO:teuthology.orchestra.run.smithi012.stdout:608.out 2023-07-07T18:17:34.443 INFO:teuthology.orchestra.run.smithi012.stdout:609 2023-07-07T18:17:34.443 INFO:teuthology.orchestra.run.smithi012.stdout:609.out 2023-07-07T18:17:34.443 INFO:teuthology.orchestra.run.smithi012.stdout:610 2023-07-07T18:17:34.443 INFO:teuthology.orchestra.run.smithi012.stdout:610.out 2023-07-07T18:17:34.443 INFO:teuthology.orchestra.run.smithi012.stdout:611 2023-07-07T18:17:34.443 INFO:teuthology.orchestra.run.smithi012.stdout:611.out 2023-07-07T18:17:34.443 INFO:teuthology.orchestra.run.smithi012.stdout:612 2023-07-07T18:17:34.443 INFO:teuthology.orchestra.run.smithi012.stdout:612.out 2023-07-07T18:17:34.444 INFO:teuthology.orchestra.run.smithi012.stdout:613 2023-07-07T18:17:34.444 INFO:teuthology.orchestra.run.smithi012.stdout:613.out 2023-07-07T18:17:34.444 INFO:teuthology.orchestra.run.smithi012.stdout:614 2023-07-07T18:17:34.444 INFO:teuthology.orchestra.run.smithi012.stdout:614.out 2023-07-07T18:17:34.444 INFO:teuthology.orchestra.run.smithi012.stdout:615 2023-07-07T18:17:34.444 INFO:teuthology.orchestra.run.smithi012.stdout:615.out 2023-07-07T18:17:34.444 INFO:teuthology.orchestra.run.smithi012.stdout:616 2023-07-07T18:17:34.445 INFO:teuthology.orchestra.run.smithi012.stdout:616.out 2023-07-07T18:17:34.445 INFO:teuthology.orchestra.run.smithi012.stdout:617 2023-07-07T18:17:34.445 INFO:teuthology.orchestra.run.smithi012.stdout:617.out 2023-07-07T18:17:34.445 INFO:teuthology.orchestra.run.smithi012.stdout:618 2023-07-07T18:17:34.445 INFO:teuthology.orchestra.run.smithi012.stdout:618.out 2023-07-07T18:17:34.445 INFO:teuthology.orchestra.run.smithi012.stdout:619 2023-07-07T18:17:34.445 INFO:teuthology.orchestra.run.smithi012.stdout:619.out 2023-07-07T18:17:34.445 INFO:teuthology.orchestra.run.smithi012.stdout:620 2023-07-07T18:17:34.446 INFO:teuthology.orchestra.run.smithi012.stdout:620.out 2023-07-07T18:17:34.446 INFO:teuthology.orchestra.run.smithi012.stdout:621 2023-07-07T18:17:34.446 INFO:teuthology.orchestra.run.smithi012.stdout:621.out 2023-07-07T18:17:34.446 INFO:teuthology.orchestra.run.smithi012.stdout:622 2023-07-07T18:17:34.446 INFO:teuthology.orchestra.run.smithi012.stdout:622.out 2023-07-07T18:17:34.446 INFO:teuthology.orchestra.run.smithi012.stdout:623 2023-07-07T18:17:34.446 INFO:teuthology.orchestra.run.smithi012.stdout:623.out 2023-07-07T18:17:34.446 INFO:teuthology.orchestra.run.smithi012.stdout:624 2023-07-07T18:17:34.447 INFO:teuthology.orchestra.run.smithi012.stdout:624.out 2023-07-07T18:17:34.447 INFO:teuthology.orchestra.run.smithi012.stdout:625 2023-07-07T18:17:34.447 INFO:teuthology.orchestra.run.smithi012.stdout:625.out 2023-07-07T18:17:34.447 INFO:teuthology.orchestra.run.smithi012.stdout:626 2023-07-07T18:17:34.447 INFO:teuthology.orchestra.run.smithi012.stdout:626.out 2023-07-07T18:17:34.447 INFO:teuthology.orchestra.run.smithi012.stdout:627 2023-07-07T18:17:34.447 INFO:teuthology.orchestra.run.smithi012.stdout:627.out 2023-07-07T18:17:34.447 INFO:teuthology.orchestra.run.smithi012.stdout:628 2023-07-07T18:17:34.448 INFO:teuthology.orchestra.run.smithi012.stdout:628.out 2023-07-07T18:17:34.448 INFO:teuthology.orchestra.run.smithi012.stdout:629 2023-07-07T18:17:34.448 INFO:teuthology.orchestra.run.smithi012.stdout:629.out 2023-07-07T18:17:34.448 INFO:teuthology.orchestra.run.smithi012.stdout:630 2023-07-07T18:17:34.448 INFO:teuthology.orchestra.run.smithi012.stdout:630.out 2023-07-07T18:17:34.448 INFO:teuthology.orchestra.run.smithi012.stdout:631 2023-07-07T18:17:34.448 INFO:teuthology.orchestra.run.smithi012.stdout:631.out 2023-07-07T18:17:34.449 INFO:teuthology.orchestra.run.smithi012.stdout:632 2023-07-07T18:17:34.449 INFO:teuthology.orchestra.run.smithi012.stdout:632.out 2023-07-07T18:17:34.449 INFO:teuthology.orchestra.run.smithi012.stdout:633 2023-07-07T18:17:34.449 INFO:teuthology.orchestra.run.smithi012.stdout:633.out 2023-07-07T18:17:34.449 INFO:teuthology.orchestra.run.smithi012.stdout:634 2023-07-07T18:17:34.449 INFO:teuthology.orchestra.run.smithi012.stdout:634.out 2023-07-07T18:17:34.449 INFO:teuthology.orchestra.run.smithi012.stdout:635 2023-07-07T18:17:34.450 INFO:teuthology.orchestra.run.smithi012.stdout:635.out 2023-07-07T18:17:34.450 INFO:teuthology.orchestra.run.smithi012.stdout:636 2023-07-07T18:17:34.450 INFO:teuthology.orchestra.run.smithi012.stdout:636.out 2023-07-07T18:17:34.450 INFO:teuthology.orchestra.run.smithi012.stdout:637 2023-07-07T18:17:34.450 INFO:teuthology.orchestra.run.smithi012.stdout:637.out 2023-07-07T18:17:34.450 INFO:teuthology.orchestra.run.smithi012.stdout:638 2023-07-07T18:17:34.450 INFO:teuthology.orchestra.run.smithi012.stdout:638.out 2023-07-07T18:17:34.450 INFO:teuthology.orchestra.run.smithi012.stdout:639 2023-07-07T18:17:34.451 INFO:teuthology.orchestra.run.smithi012.stdout:639.out 2023-07-07T18:17:34.451 INFO:teuthology.orchestra.run.smithi012.stdout:640 2023-07-07T18:17:34.451 INFO:teuthology.orchestra.run.smithi012.stdout:640.out 2023-07-07T18:17:34.451 INFO:teuthology.orchestra.run.smithi012.stdout:641 2023-07-07T18:17:34.451 INFO:teuthology.orchestra.run.smithi012.stdout:641.out 2023-07-07T18:17:34.451 INFO:teuthology.orchestra.run.smithi012.stdout:642 2023-07-07T18:17:34.451 INFO:teuthology.orchestra.run.smithi012.stdout:642.out 2023-07-07T18:17:34.451 INFO:teuthology.orchestra.run.smithi012.stdout:643 2023-07-07T18:17:34.452 INFO:teuthology.orchestra.run.smithi012.stdout:643.out 2023-07-07T18:17:34.452 INFO:teuthology.orchestra.run.smithi012.stdout:644 2023-07-07T18:17:34.452 INFO:teuthology.orchestra.run.smithi012.stdout:644.out 2023-07-07T18:17:34.452 INFO:teuthology.orchestra.run.smithi012.stdout:645 2023-07-07T18:17:34.452 INFO:teuthology.orchestra.run.smithi012.stdout:645.out 2023-07-07T18:17:34.452 INFO:teuthology.orchestra.run.smithi012.stdout:646 2023-07-07T18:17:34.453 INFO:teuthology.orchestra.run.smithi012.stdout:646.out 2023-07-07T18:17:34.453 INFO:teuthology.orchestra.run.smithi012.stdout:647 2023-07-07T18:17:34.453 INFO:teuthology.orchestra.run.smithi012.stdout:647.out 2023-07-07T18:17:34.453 INFO:teuthology.orchestra.run.smithi012.stdout:648 2023-07-07T18:17:34.453 INFO:teuthology.orchestra.run.smithi012.stdout:648.out 2023-07-07T18:17:34.453 INFO:teuthology.orchestra.run.smithi012.stdout:649 2023-07-07T18:17:34.453 INFO:teuthology.orchestra.run.smithi012.stdout:649.out 2023-07-07T18:17:34.454 INFO:teuthology.orchestra.run.smithi012.stdout:650 2023-07-07T18:17:34.454 INFO:teuthology.orchestra.run.smithi012.stdout:650.out 2023-07-07T18:17:34.454 INFO:teuthology.orchestra.run.smithi012.stdout:651 2023-07-07T18:17:34.454 INFO:teuthology.orchestra.run.smithi012.stdout:651.out 2023-07-07T18:17:34.454 INFO:teuthology.orchestra.run.smithi012.stdout:652 2023-07-07T18:17:34.454 INFO:teuthology.orchestra.run.smithi012.stdout:652.out 2023-07-07T18:17:34.455 INFO:teuthology.orchestra.run.smithi012.stdout:653 2023-07-07T18:17:34.455 INFO:teuthology.orchestra.run.smithi012.stdout:653.out 2023-07-07T18:17:34.455 INFO:teuthology.orchestra.run.smithi012.stdout:654 2023-07-07T18:17:34.455 INFO:teuthology.orchestra.run.smithi012.stdout:654.out 2023-07-07T18:17:34.456 INFO:teuthology.orchestra.run.smithi012.stdout:655 2023-07-07T18:17:34.456 INFO:teuthology.orchestra.run.smithi012.stdout:655.out 2023-07-07T18:17:34.456 INFO:teuthology.orchestra.run.smithi012.stdout:656 2023-07-07T18:17:34.456 INFO:teuthology.orchestra.run.smithi012.stdout:656.out 2023-07-07T18:17:34.457 INFO:teuthology.orchestra.run.smithi012.stdout:657 2023-07-07T18:17:34.457 INFO:teuthology.orchestra.run.smithi012.stdout:657.out 2023-07-07T18:17:34.457 INFO:teuthology.orchestra.run.smithi012.stdout:658 2023-07-07T18:17:34.458 INFO:teuthology.orchestra.run.smithi012.stdout:658.out 2023-07-07T18:17:34.458 INFO:teuthology.orchestra.run.smithi012.stdout:659 2023-07-07T18:17:34.458 INFO:teuthology.orchestra.run.smithi012.stdout:659.out 2023-07-07T18:17:34.458 INFO:teuthology.orchestra.run.smithi012.stdout:660 2023-07-07T18:17:34.459 INFO:teuthology.orchestra.run.smithi012.stdout:660.out 2023-07-07T18:17:34.459 INFO:teuthology.orchestra.run.smithi012.stdout:661 2023-07-07T18:17:34.459 INFO:teuthology.orchestra.run.smithi012.stdout:661.out 2023-07-07T18:17:34.459 INFO:teuthology.orchestra.run.smithi012.stdout:662 2023-07-07T18:17:34.460 INFO:teuthology.orchestra.run.smithi012.stdout:662.out 2023-07-07T18:17:34.460 INFO:teuthology.orchestra.run.smithi012.stdout:663 2023-07-07T18:17:34.460 INFO:teuthology.orchestra.run.smithi012.stdout:663.out 2023-07-07T18:17:34.460 INFO:teuthology.orchestra.run.smithi012.stdout:664 2023-07-07T18:17:34.461 INFO:teuthology.orchestra.run.smithi012.stdout:664.out 2023-07-07T18:17:34.461 INFO:teuthology.orchestra.run.smithi012.stdout:665 2023-07-07T18:17:34.461 INFO:teuthology.orchestra.run.smithi012.stdout:665.out 2023-07-07T18:17:34.461 INFO:teuthology.orchestra.run.smithi012.stdout:666 2023-07-07T18:17:34.461 INFO:teuthology.orchestra.run.smithi012.stdout:666.out 2023-07-07T18:17:34.462 INFO:teuthology.orchestra.run.smithi012.stdout:667 2023-07-07T18:17:34.462 INFO:teuthology.orchestra.run.smithi012.stdout:667.out 2023-07-07T18:17:34.462 INFO:teuthology.orchestra.run.smithi012.stdout:668 2023-07-07T18:17:34.462 INFO:teuthology.orchestra.run.smithi012.stdout:668.out 2023-07-07T18:17:34.462 INFO:teuthology.orchestra.run.smithi012.stdout:669 2023-07-07T18:17:34.462 INFO:teuthology.orchestra.run.smithi012.stdout:669.out 2023-07-07T18:17:34.462 INFO:teuthology.orchestra.run.smithi012.stdout:670 2023-07-07T18:17:34.462 INFO:teuthology.orchestra.run.smithi012.stdout:670.out 2023-07-07T18:17:34.463 INFO:teuthology.orchestra.run.smithi012.stdout:671 2023-07-07T18:17:34.463 INFO:teuthology.orchestra.run.smithi012.stdout:671.out 2023-07-07T18:17:34.463 INFO:teuthology.orchestra.run.smithi012.stdout:672 2023-07-07T18:17:34.463 INFO:teuthology.orchestra.run.smithi012.stdout:672.out 2023-07-07T18:17:34.463 INFO:teuthology.orchestra.run.smithi012.stdout:673 2023-07-07T18:17:34.464 INFO:teuthology.orchestra.run.smithi012.stdout:673.out 2023-07-07T18:17:34.464 INFO:teuthology.orchestra.run.smithi012.stdout:674 2023-07-07T18:17:34.464 INFO:teuthology.orchestra.run.smithi012.stdout:674.out 2023-07-07T18:17:34.464 INFO:teuthology.orchestra.run.smithi012.stdout:675 2023-07-07T18:17:34.464 INFO:teuthology.orchestra.run.smithi012.stdout:675.out 2023-07-07T18:17:34.464 INFO:teuthology.orchestra.run.smithi012.stdout:676 2023-07-07T18:17:34.464 INFO:teuthology.orchestra.run.smithi012.stdout:676.out 2023-07-07T18:17:34.464 INFO:teuthology.orchestra.run.smithi012.stdout:677 2023-07-07T18:17:34.465 INFO:teuthology.orchestra.run.smithi012.stdout:677.out 2023-07-07T18:17:34.465 INFO:teuthology.orchestra.run.smithi012.stdout:678 2023-07-07T18:17:34.465 INFO:teuthology.orchestra.run.smithi012.stdout:678.out 2023-07-07T18:17:34.465 INFO:teuthology.orchestra.run.smithi012.stdout:679 2023-07-07T18:17:34.465 INFO:teuthology.orchestra.run.smithi012.stdout:679.out 2023-07-07T18:17:34.465 INFO:teuthology.orchestra.run.smithi012.stdout:680 2023-07-07T18:17:34.465 INFO:teuthology.orchestra.run.smithi012.stdout:680.out 2023-07-07T18:17:34.466 INFO:teuthology.orchestra.run.smithi012.stdout:681 2023-07-07T18:17:34.466 INFO:teuthology.orchestra.run.smithi012.stdout:681.out 2023-07-07T18:17:34.466 INFO:teuthology.orchestra.run.smithi012.stdout:682 2023-07-07T18:17:34.466 INFO:teuthology.orchestra.run.smithi012.stdout:682.out 2023-07-07T18:17:34.466 INFO:teuthology.orchestra.run.smithi012.stdout:683 2023-07-07T18:17:34.466 INFO:teuthology.orchestra.run.smithi012.stdout:683.out 2023-07-07T18:17:34.466 INFO:teuthology.orchestra.run.smithi012.stdout:684 2023-07-07T18:17:34.466 INFO:teuthology.orchestra.run.smithi012.stdout:684.out 2023-07-07T18:17:34.467 INFO:teuthology.orchestra.run.smithi012.stdout:685 2023-07-07T18:17:34.467 INFO:teuthology.orchestra.run.smithi012.stdout:685.out 2023-07-07T18:17:34.467 INFO:teuthology.orchestra.run.smithi012.stdout:686 2023-07-07T18:17:34.467 INFO:teuthology.orchestra.run.smithi012.stdout:686.out 2023-07-07T18:17:34.467 INFO:teuthology.orchestra.run.smithi012.stdout:687 2023-07-07T18:17:34.467 INFO:teuthology.orchestra.run.smithi012.stdout:687.out 2023-07-07T18:17:34.467 INFO:teuthology.orchestra.run.smithi012.stdout:688 2023-07-07T18:17:34.467 INFO:teuthology.orchestra.run.smithi012.stdout:688.out 2023-07-07T18:17:34.468 INFO:teuthology.orchestra.run.smithi012.stdout:689 2023-07-07T18:17:34.468 INFO:teuthology.orchestra.run.smithi012.stdout:689.out 2023-07-07T18:17:34.468 INFO:teuthology.orchestra.run.smithi012.stdout:690 2023-07-07T18:17:34.468 INFO:teuthology.orchestra.run.smithi012.stdout:690.out 2023-07-07T18:17:34.468 INFO:teuthology.orchestra.run.smithi012.stdout:691 2023-07-07T18:17:34.468 INFO:teuthology.orchestra.run.smithi012.stdout:691.out 2023-07-07T18:17:34.468 INFO:teuthology.orchestra.run.smithi012.stdout:692 2023-07-07T18:17:34.469 INFO:teuthology.orchestra.run.smithi012.stdout:692.out 2023-07-07T18:17:34.469 INFO:teuthology.orchestra.run.smithi012.stdout:693 2023-07-07T18:17:34.469 INFO:teuthology.orchestra.run.smithi012.stdout:693.out 2023-07-07T18:17:34.469 INFO:teuthology.orchestra.run.smithi012.stdout:694 2023-07-07T18:17:34.469 INFO:teuthology.orchestra.run.smithi012.stdout:694.out 2023-07-07T18:17:34.469 INFO:teuthology.orchestra.run.smithi012.stdout:695 2023-07-07T18:17:34.469 INFO:teuthology.orchestra.run.smithi012.stdout:695.out 2023-07-07T18:17:34.469 INFO:teuthology.orchestra.run.smithi012.stdout:696 2023-07-07T18:17:34.470 INFO:teuthology.orchestra.run.smithi012.stdout:696.out 2023-07-07T18:17:34.470 INFO:teuthology.orchestra.run.smithi012.stdout:697 2023-07-07T18:17:34.470 INFO:teuthology.orchestra.run.smithi012.stdout:697.out 2023-07-07T18:17:34.470 INFO:teuthology.orchestra.run.smithi012.stdout:698 2023-07-07T18:17:34.470 INFO:teuthology.orchestra.run.smithi012.stdout:698.out 2023-07-07T18:17:34.470 INFO:teuthology.orchestra.run.smithi012.stdout:699 2023-07-07T18:17:34.470 INFO:teuthology.orchestra.run.smithi012.stdout:699.out 2023-07-07T18:17:34.470 INFO:teuthology.orchestra.run.smithi012.stdout:700 2023-07-07T18:17:34.471 INFO:teuthology.orchestra.run.smithi012.stdout:700.out 2023-07-07T18:17:34.471 INFO:teuthology.orchestra.run.smithi012.stdout:701 2023-07-07T18:17:34.471 INFO:teuthology.orchestra.run.smithi012.stdout:701.out 2023-07-07T18:17:34.471 INFO:teuthology.orchestra.run.smithi012.stdout:702 2023-07-07T18:17:34.471 INFO:teuthology.orchestra.run.smithi012.stdout:702.out 2023-07-07T18:17:34.471 INFO:teuthology.orchestra.run.smithi012.stdout:703 2023-07-07T18:17:34.471 INFO:teuthology.orchestra.run.smithi012.stdout:703.out 2023-07-07T18:17:34.471 INFO:teuthology.orchestra.run.smithi012.stdout:704 2023-07-07T18:17:34.472 INFO:teuthology.orchestra.run.smithi012.stdout:704.out 2023-07-07T18:17:34.472 INFO:teuthology.orchestra.run.smithi012.stdout:705 2023-07-07T18:17:34.472 INFO:teuthology.orchestra.run.smithi012.stdout:705.out 2023-07-07T18:17:34.472 INFO:teuthology.orchestra.run.smithi012.stdout:706 2023-07-07T18:17:34.472 INFO:teuthology.orchestra.run.smithi012.stdout:706.out 2023-07-07T18:17:34.472 INFO:teuthology.orchestra.run.smithi012.stdout:707 2023-07-07T18:17:34.472 INFO:teuthology.orchestra.run.smithi012.stdout:707.out 2023-07-07T18:17:34.473 INFO:teuthology.orchestra.run.smithi012.stdout:708 2023-07-07T18:17:34.473 INFO:teuthology.orchestra.run.smithi012.stdout:708.out 2023-07-07T18:17:34.473 INFO:teuthology.orchestra.run.smithi012.stdout:709 2023-07-07T18:17:34.473 INFO:teuthology.orchestra.run.smithi012.stdout:709.out 2023-07-07T18:17:34.473 INFO:teuthology.orchestra.run.smithi012.stdout:710 2023-07-07T18:17:34.473 INFO:teuthology.orchestra.run.smithi012.stdout:710.out 2023-07-07T18:17:34.474 INFO:teuthology.orchestra.run.smithi012.stdout:711 2023-07-07T18:17:34.474 INFO:teuthology.orchestra.run.smithi012.stdout:711.out 2023-07-07T18:17:34.474 INFO:teuthology.orchestra.run.smithi012.stdout:712 2023-07-07T18:17:34.474 INFO:teuthology.orchestra.run.smithi012.stdout:712.out 2023-07-07T18:17:34.474 INFO:teuthology.orchestra.run.smithi012.stdout:713 2023-07-07T18:17:34.474 INFO:teuthology.orchestra.run.smithi012.stdout:713.out 2023-07-07T18:17:34.474 INFO:teuthology.orchestra.run.smithi012.stdout:714 2023-07-07T18:17:34.474 INFO:teuthology.orchestra.run.smithi012.stdout:714.out 2023-07-07T18:17:34.475 INFO:teuthology.orchestra.run.smithi012.stdout:715 2023-07-07T18:17:34.475 INFO:teuthology.orchestra.run.smithi012.stdout:715.out 2023-07-07T18:17:34.475 INFO:teuthology.orchestra.run.smithi012.stdout:716 2023-07-07T18:17:34.475 INFO:teuthology.orchestra.run.smithi012.stdout:716.out 2023-07-07T18:17:34.475 INFO:teuthology.orchestra.run.smithi012.stdout:717 2023-07-07T18:17:34.475 INFO:teuthology.orchestra.run.smithi012.stdout:717.out 2023-07-07T18:17:34.475 INFO:teuthology.orchestra.run.smithi012.stdout:718 2023-07-07T18:17:34.475 INFO:teuthology.orchestra.run.smithi012.stdout:718.out 2023-07-07T18:17:34.476 INFO:teuthology.orchestra.run.smithi012.stdout:719 2023-07-07T18:17:34.476 INFO:teuthology.orchestra.run.smithi012.stdout:719.out 2023-07-07T18:17:34.476 INFO:teuthology.orchestra.run.smithi012.stdout:720 2023-07-07T18:17:34.476 INFO:teuthology.orchestra.run.smithi012.stdout:720.out 2023-07-07T18:17:34.476 INFO:teuthology.orchestra.run.smithi012.stdout:721 2023-07-07T18:17:34.476 INFO:teuthology.orchestra.run.smithi012.stdout:721.out 2023-07-07T18:17:34.476 INFO:teuthology.orchestra.run.smithi012.stdout:722 2023-07-07T18:17:34.477 INFO:teuthology.orchestra.run.smithi012.stdout:722.out 2023-07-07T18:17:34.477 INFO:teuthology.orchestra.run.smithi012.stdout:723 2023-07-07T18:17:34.477 INFO:teuthology.orchestra.run.smithi012.stdout:723.out 2023-07-07T18:17:34.477 INFO:teuthology.orchestra.run.smithi012.stdout:724 2023-07-07T18:17:34.477 INFO:teuthology.orchestra.run.smithi012.stdout:724.out 2023-07-07T18:17:34.477 INFO:teuthology.orchestra.run.smithi012.stdout:725 2023-07-07T18:17:34.477 INFO:teuthology.orchestra.run.smithi012.stdout:725.out 2023-07-07T18:17:34.477 INFO:teuthology.orchestra.run.smithi012.stdout:726 2023-07-07T18:17:34.478 INFO:teuthology.orchestra.run.smithi012.stdout:726.out 2023-07-07T18:17:34.478 INFO:teuthology.orchestra.run.smithi012.stdout:727 2023-07-07T18:17:34.478 INFO:teuthology.orchestra.run.smithi012.stdout:727.out 2023-07-07T18:17:34.478 INFO:teuthology.orchestra.run.smithi012.stdout:728 2023-07-07T18:17:34.478 INFO:teuthology.orchestra.run.smithi012.stdout:728.out 2023-07-07T18:17:34.478 INFO:teuthology.orchestra.run.smithi012.stdout:group.list 2023-07-07T18:17:34.478 INFO:teuthology.orchestra.run.smithi012.stdout:Makefile 2023-07-07T18:17:34.479 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-07-07T18:17:34.723 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:17:34.727 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:17:34.727 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:17:34.728 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:17:34.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:39.491 INFO:teuthology.orchestra.run.smithi012.stdout:generic/001 5s 2023-07-07T18:17:39.496 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/001 2023-07-07T18:17:39.496 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:17:39.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:40.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:17:40.287 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-07-07T18:17:40.576 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:17:40.582 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:17:40.583 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:17:40.584 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:17:40.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:41.161 INFO:teuthology.orchestra.run.smithi012.stdout:generic/002 1s 2023-07-07T18:17:41.165 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/002 2023-07-07T18:17:41.166 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:17:41.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:41.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:17:41.246 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-07-07T18:17:41.466 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:17:41.471 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:17:41.471 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:17:41.472 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:17:41.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:41.806 INFO:teuthology.orchestra.run.smithi012.stdout:generic/003 [not run] atime not maintained by ceph 2023-07-07T18:17:41.810 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/003 2023-07-07T18:17:41.811 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/003 2023-07-07T18:17:41.811 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:17:41.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:41.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:17:41.836 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-07-07T18:17:42.064 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:17:42.069 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:17:42.069 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:17:42.070 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:17:42.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:42.398 INFO:teuthology.orchestra.run.smithi012.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-07T18:17:42.402 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/004 2023-07-07T18:17:42.402 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/004 2023-07-07T18:17:42.403 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:17:42.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:42.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:17:42.428 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-07-07T18:17:42.651 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:17:42.655 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:17:42.656 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:17:42.657 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:17:42.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:43.142 INFO:teuthology.orchestra.run.smithi012.stdout:generic/005 1s 2023-07-07T18:17:43.147 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/005 2023-07-07T18:17:43.147 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:17:43.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:43.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:17:43.249 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-07-07T18:17:43.482 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:17:43.486 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:17:43.487 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:17:43.488 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:17:43.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:17:44.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:17:44.748 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:18:08.193 INFO:teuthology.orchestra.run.smithi012.stdout:generic/006 25s 2023-07-07T18:18:08.268 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/006 2023-07-07T18:18:08.269 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:18:08.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:18:08.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:18:08.343 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-07-07T18:18:08.568 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:18:08.572 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:18:08.573 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:18:08.574 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:18:08.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:18:14.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:18:14.810 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:18:44.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:18:44.898 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:18:59.021 INFO:teuthology.orchestra.run.smithi012.stdout:generic/007 50s 2023-07-07T18:18:59.064 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/007 2023-07-07T18:18:59.064 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:18:59.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:18:59.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:18:59.167 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-07-07T18:18:59.391 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:18:59.395 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:18:59.395 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:18:59.396 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:18:59.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:18:59.849 INFO:teuthology.orchestra.run.smithi012.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-07T18:18:59.853 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/008 2023-07-07T18:18:59.853 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/008 2023-07-07T18:18:59.853 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:18:59.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:18:59.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:18:59.888 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-07-07T18:19:00.107 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:19:00.111 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:19:00.111 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:19:00.112 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:19:00.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:19:00.517 INFO:teuthology.orchestra.run.smithi012.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-07T18:19:00.521 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/009 2023-07-07T18:19:00.522 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/009 2023-07-07T18:19:00.522 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:19:00.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:19:00.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:19:00.555 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-07-07T18:19:00.765 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:19:00.769 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:19:00.770 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:19:00.771 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:19:00.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:19:01.097 INFO:teuthology.orchestra.run.smithi012.stdout:generic/010 [not run] /tmp/tmp.XqO9xwZcsPxfstests-dev/src/dbtest not built 2023-07-07T18:19:01.101 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/010 2023-07-07T18:19:01.102 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/010 2023-07-07T18:19:01.102 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:19:01.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:19:01.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:19:01.131 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-07-07T18:19:01.346 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:19:01.350 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:19:01.351 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:19:01.352 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:19:01.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:19:15.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:19:15.008 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:19:33.217 INFO:teuthology.orchestra.run.smithi012.stdout:generic/011 32s 2023-07-07T18:19:33.262 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/011 2023-07-07T18:19:33.263 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:19:33.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:19:33.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:19:33.530 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-07-07T18:19:33.754 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:19:33.758 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:19:33.758 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:19:33.759 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:19:33.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:19:34.256 INFO:teuthology.orchestra.run.smithi012.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:19:34.260 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/012 2023-07-07T18:19:34.260 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/012 2023-07-07T18:19:34.261 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:19:34.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:19:34.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:19:34.336 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-07-07T18:19:34.559 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:19:34.563 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:19:34.564 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:19:34.565 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:19:34.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:19:45.094 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:19:45.097 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:20:15.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:20:15.326 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:20:35.520 INFO:teuthology.orchestra.run.smithi012.stdout:generic/013 61s 2023-07-07T18:20:35.574 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/013 2023-07-07T18:20:35.574 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:20:35.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:20:35.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:20:35.635 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-07-07T18:20:35.962 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:20:35.969 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:20:35.969 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:20:35.971 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:20:35.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:20:45.400 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:20:45.403 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:21:15.843 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:21:15.850 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:21:45.962 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:21:45.969 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:22:16.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:22:16.347 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:22:46.706 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:22:46.719 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:23:17.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:23:17.013 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:23:47.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:23:47.308 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:24:17.698 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:24:17.701 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:24:48.118 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:24:48.131 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:25:18.530 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:25:18.539 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:25:28.819 INFO:teuthology.orchestra.run.smithi012.stdout:generic/014 292s 2023-07-07T18:25:28.827 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/014 2023-07-07T18:25:28.827 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:25:28.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:28.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:25:28.885 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-07-07T18:25:29.276 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:25:29.283 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:25:29.283 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:25:29.284 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:25:29.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:29.765 INFO:teuthology.orchestra.run.smithi012.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T18:25:29.772 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/015 2023-07-07T18:25:29.772 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/015 2023-07-07T18:25:29.773 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:25:29.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:29.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:25:29.811 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-07-07T18:25:30.189 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:25:30.196 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:25:30.197 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:25:30.198 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:25:30.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:30.848 INFO:teuthology.orchestra.run.smithi012.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:25:30.855 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/016 2023-07-07T18:25:30.855 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/016 2023-07-07T18:25:30.855 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:25:30.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:31.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:25:31.012 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-07-07T18:25:31.581 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:25:31.586 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:25:31.586 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:25:31.587 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:25:31.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:32.160 INFO:teuthology.orchestra.run.smithi012.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-07T18:25:32.168 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/017 2023-07-07T18:25:32.168 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/017 2023-07-07T18:25:32.168 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:25:32.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:32.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:25:32.204 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-07-07T18:25:32.569 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:25:32.588 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:25:32.589 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:25:32.590 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:25:32.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:33.218 INFO:teuthology.orchestra.run.smithi012.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-07-07T18:25:33.241 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/018 2023-07-07T18:25:33.241 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/018 2023-07-07T18:25:33.241 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:25:33.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:33.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:25:33.280 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-07-07T18:25:33.680 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:25:33.685 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:25:33.685 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:25:33.689 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:25:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:34.207 INFO:teuthology.orchestra.run.smithi012.stdout:generic/019 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:25:34.215 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/019 2023-07-07T18:25:34.215 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/019 2023-07-07T18:25:34.215 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:25:34.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:34.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:25:34.254 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-07-07T18:25:34.632 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:25:34.638 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:25:34.639 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:25:34.640 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:25:34.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:38.637 INFO:teuthology.orchestra.run.smithi012.stdout:generic/020 4s 2023-07-07T18:25:38.645 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/020 2023-07-07T18:25:38.645 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:25:38.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:38.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:25:38.945 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-07-07T18:25:39.371 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:25:39.376 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:25:39.377 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:25:39.378 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:25:39.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:40.058 INFO:teuthology.orchestra.run.smithi012.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:25:40.063 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/021 2023-07-07T18:25:40.063 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/021 2023-07-07T18:25:40.063 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:25:40.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:40.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:25:40.437 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-07-07T18:25:40.802 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:25:40.807 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:25:40.808 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:25:40.812 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:25:40.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:41.477 INFO:teuthology.orchestra.run.smithi012.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/022 2023-07-07T18:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/022 2023-07-07T18:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:41.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:25:41.840 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-07-07T18:25:42.204 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:25:42.212 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:25:42.213 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:25:42.214 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:25:42.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:25:48.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:25:48.911 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:26:19.383 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:26:19.386 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:26:47.445 INFO:teuthology.orchestra.run.smithi012.stdout:generic/023 65s 2023-07-07T18:26:47.450 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/023 2023-07-07T18:26:47.451 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:26:47.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:47.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:26:47.829 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-07-07T18:26:48.274 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:26:48.290 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:26:48.290 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:26:48.293 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:26:48.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:48.824 INFO:teuthology.orchestra.run.smithi012.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-07T18:26:48.834 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/024 2023-07-07T18:26:48.834 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/024 2023-07-07T18:26:48.834 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:26:48.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:49.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:26:49.150 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-07-07T18:26:49.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:26:49.473 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:26:49.611 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:26:49.625 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:26:49.625 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:26:49.626 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:26:49.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:50.178 INFO:teuthology.orchestra.run.smithi012.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-07T18:26:50.182 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/025 2023-07-07T18:26:50.183 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/025 2023-07-07T18:26:50.183 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:26:50.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:50.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:26:50.576 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-07-07T18:26:51.031 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:26:51.051 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:26:51.054 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:26:51.055 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:26:51.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:51.595 INFO:teuthology.orchestra.run.smithi012.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-07-07T18:26:51.601 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/026 2023-07-07T18:26:51.601 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/026 2023-07-07T18:26:51.602 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:26:51.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:51.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:26:51.667 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-07-07T18:26:52.075 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:26:52.083 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:26:52.084 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:26:52.085 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:26:52.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:52.581 INFO:teuthology.orchestra.run.smithi012.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T18:26:52.586 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/027 2023-07-07T18:26:52.587 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/027 2023-07-07T18:26:52.587 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:26:52.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:52.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:26:52.617 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-07-07T18:26:53.003 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:26:53.014 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:26:53.015 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:26:53.016 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:26:53.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:58.517 INFO:teuthology.orchestra.run.smithi012.stdout:generic/028 5s 2023-07-07T18:26:58.523 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/028 2023-07-07T18:26:58.523 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:26:58.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:26:58.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:26:58.568 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-07-07T18:26:58.946 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:26:58.952 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:26:58.952 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:26:58.954 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:26:58.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:04.923 INFO:teuthology.orchestra.run.smithi012.stdout:generic/029 5s 2023-07-07T18:27:04.928 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/029 2023-07-07T18:27:04.928 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:04.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:04.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:04.938 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-07-07T18:27:05.158 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:05.163 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:05.163 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:05.164 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:05.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:07.708 INFO:teuthology.orchestra.run.smithi012.stdout:generic/030 2s 2023-07-07T18:27:07.713 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/030 2023-07-07T18:27:07.713 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:07.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:07.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:07.724 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-07-07T18:27:07.936 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:07.941 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:07.941 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:07.942 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:07.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:08.346 INFO:teuthology.orchestra.run.smithi012.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-07T18:27:08.350 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/031 2023-07-07T18:27:08.350 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/031 2023-07-07T18:27:08.350 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:08.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:08.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:08.380 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-07-07T18:27:08.664 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:08.668 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:08.669 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:08.670 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:08.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:08.983 INFO:teuthology.orchestra.run.smithi012.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:27:08.987 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/032 2023-07-07T18:27:08.987 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/032 2023-07-07T18:27:08.987 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:08.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:09.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:09.016 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-07-07T18:27:09.234 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:09.238 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:09.238 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:09.239 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:09.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:09.661 INFO:teuthology.orchestra.run.smithi012.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-07T18:27:09.665 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/033 2023-07-07T18:27:09.665 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/033 2023-07-07T18:27:09.665 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:09.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:09.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:09.690 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-07-07T18:27:09.911 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:09.915 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:09.915 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:09.916 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:09.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:10.261 INFO:teuthology.orchestra.run.smithi012.stdout:generic/034 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:10.270 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/034 2023-07-07T18:27:10.271 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/034 2023-07-07T18:27:10.271 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:10.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:10.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:10.296 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-07-07T18:27:10.520 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:10.525 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:10.525 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:10.526 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:10.904 INFO:teuthology.orchestra.run.smithi012.stdout:generic/035 0s 2023-07-07T18:27:10.909 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/035 2023-07-07T18:27:10.909 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:11.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:11.175 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-07-07T18:27:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:11.503 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:11.503 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:11.504 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:19.610 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:27:19.612 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:27:21.924 INFO:teuthology.orchestra.run.smithi012.stdout:generic/036 10s 2023-07-07T18:27:21.929 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/036 2023-07-07T18:27:21.929 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:21.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:22.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:22.180 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-07-07T18:27:22.562 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:22.566 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:22.567 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:22.568 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:22.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:25.236 INFO:teuthology.orchestra.run.smithi012.stdout:generic/037 3s 2023-07-07T18:27:25.240 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/037 2023-07-07T18:27:25.241 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:25.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:25.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:25.251 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-07-07T18:27:25.468 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:25.472 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:25.472 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:25.473 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:25.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:25.811 INFO:teuthology.orchestra.run.smithi012.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:27:25.815 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/038 2023-07-07T18:27:25.815 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/038 2023-07-07T18:27:25.815 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:25.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:25.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:25.844 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-07-07T18:27:26.056 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:26.060 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:26.061 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:26.062 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:26.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:26.418 INFO:teuthology.orchestra.run.smithi012.stdout:generic/039 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:26.422 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/039 2023-07-07T18:27:26.422 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/039 2023-07-07T18:27:26.422 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:26.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:26.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:26.450 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-07-07T18:27:26.674 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:26.678 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:26.679 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:26.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:27.037 INFO:teuthology.orchestra.run.smithi012.stdout:generic/040 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:27.041 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/040 2023-07-07T18:27:27.041 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/040 2023-07-07T18:27:27.042 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:27.043 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:27.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:27.067 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-07-07T18:27:27.289 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:27.293 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:27.294 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:27.295 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:27.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:27.646 INFO:teuthology.orchestra.run.smithi012.stdout:generic/041 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:27.650 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/041 2023-07-07T18:27:27.650 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/041 2023-07-07T18:27:27.650 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:27.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:27.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:27.678 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-07-07T18:27:27.900 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:27.904 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:27.905 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:27.906 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:27.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:28.390 INFO:teuthology.orchestra.run.smithi012.stdout:generic/042 [not run] ceph does not support shutdown 2023-07-07T18:27:28.410 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/042 2023-07-07T18:27:28.410 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/042 2023-07-07T18:27:28.411 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:28.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:28.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:28.432 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-07-07T18:27:28.644 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:28.649 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:28.649 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:28.650 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:29.147 INFO:teuthology.orchestra.run.smithi012.stdout:generic/043 [not run] ceph does not support shutdown 2023-07-07T18:27:29.163 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/043 2023-07-07T18:27:29.163 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/043 2023-07-07T18:27:29.163 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:29.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:29.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:29.184 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-07-07T18:27:29.405 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:29.409 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:29.409 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:29.410 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:29.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:29.900 INFO:teuthology.orchestra.run.smithi012.stdout:generic/044 [not run] ceph does not support shutdown 2023-07-07T18:27:29.919 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/044 2023-07-07T18:27:29.919 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/044 2023-07-07T18:27:29.919 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:29.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:29.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:29.952 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-07-07T18:27:30.176 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:30.180 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:30.180 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:30.181 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:30.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:30.676 INFO:teuthology.orchestra.run.smithi012.stdout:generic/045 [not run] ceph does not support shutdown 2023-07-07T18:27:30.692 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/045 2023-07-07T18:27:30.692 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/045 2023-07-07T18:27:30.693 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:30.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:30.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:30.716 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-07-07T18:27:30.940 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:30.944 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:30.945 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:30.946 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:30.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:31.443 INFO:teuthology.orchestra.run.smithi012.stdout:generic/046 [not run] ceph does not support shutdown 2023-07-07T18:27:31.462 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/046 2023-07-07T18:27:31.462 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/046 2023-07-07T18:27:31.462 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:31.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:31.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:31.484 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-07-07T18:27:31.705 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:31.709 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:31.709 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:31.710 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:32.201 INFO:teuthology.orchestra.run.smithi012.stdout:generic/047 [not run] ceph does not support shutdown 2023-07-07T18:27:32.223 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/047 2023-07-07T18:27:32.223 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/047 2023-07-07T18:27:32.223 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:32.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:32.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:32.256 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-07-07T18:27:32.469 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:32.473 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:32.474 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:32.475 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:32.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:32.955 INFO:teuthology.orchestra.run.smithi012.stdout:generic/048 [not run] ceph does not support shutdown 2023-07-07T18:27:32.976 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/048 2023-07-07T18:27:32.976 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/048 2023-07-07T18:27:32.976 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:32.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:33.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:33.005 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-07-07T18:27:33.229 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:33.233 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:33.233 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:33.234 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:33.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:33.738 INFO:teuthology.orchestra.run.smithi012.stdout:generic/049 [not run] ceph does not support shutdown 2023-07-07T18:27:33.753 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/049 2023-07-07T18:27:33.753 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/049 2023-07-07T18:27:33.754 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:33.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:33.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:33.779 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-07-07T18:27:34.001 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:34.005 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:34.006 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:34.007 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:34.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:34.508 INFO:teuthology.orchestra.run.smithi012.stdout:generic/050 [not run] ceph does not support shutdown 2023-07-07T18:27:34.521 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/050 2023-07-07T18:27:34.521 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/050 2023-07-07T18:27:34.521 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:34.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:34.543 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-07-07T18:27:34.765 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:34.769 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:34.770 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:34.771 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:34.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:35.279 INFO:teuthology.orchestra.run.smithi012.stdout:generic/051 [not run] ceph does not support shutdown 2023-07-07T18:27:35.283 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/051 2023-07-07T18:27:35.283 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/051 2023-07-07T18:27:35.284 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:35.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:35.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:35.307 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-07-07T18:27:35.519 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:35.523 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:35.524 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:35.525 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:35.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:36.153 INFO:teuthology.orchestra.run.smithi012.stdout:generic/052 [not run] ceph does not support shutdown 2023-07-07T18:27:36.171 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/052 2023-07-07T18:27:36.171 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/052 2023-07-07T18:27:36.171 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:36.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:36.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:36.194 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-07-07T18:27:36.870 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:36.875 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:36.875 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:36.876 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:36.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:37.851 INFO:teuthology.orchestra.run.smithi012.stdout:generic/053 0s 2023-07-07T18:27:37.862 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/053 2023-07-07T18:27:37.862 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:37.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:37.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:37.875 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-07-07T18:27:38.099 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:38.103 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:38.103 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:38.104 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:38.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:38.614 INFO:teuthology.orchestra.run.smithi012.stdout:generic/054 [not run] ceph does not support shutdown 2023-07-07T18:27:38.630 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/054 2023-07-07T18:27:38.630 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/054 2023-07-07T18:27:38.630 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:38.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:38.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:38.656 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-07-07T18:27:38.862 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:38.866 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:38.867 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:38.868 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:38.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:39.380 INFO:teuthology.orchestra.run.smithi012.stdout:generic/055 [not run] ceph does not support shutdown 2023-07-07T18:27:39.403 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/055 2023-07-07T18:27:39.403 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/055 2023-07-07T18:27:39.404 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:39.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:39.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:39.428 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-07-07T18:27:39.643 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:39.647 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:39.648 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:39.649 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:39.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:40.026 INFO:teuthology.orchestra.run.smithi012.stdout:generic/056 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:40.030 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/056 2023-07-07T18:27:40.030 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/056 2023-07-07T18:27:40.030 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:40.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:40.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:40.055 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-07-07T18:27:40.278 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:40.282 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:40.282 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:40.283 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:40.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:40.647 INFO:teuthology.orchestra.run.smithi012.stdout:generic/057 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:40.651 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/057 2023-07-07T18:27:40.651 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/057 2023-07-07T18:27:40.651 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:40.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:40.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:40.674 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-07-07T18:27:40.896 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:40.901 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:40.901 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:40.902 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:40.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:41.337 INFO:teuthology.orchestra.run.smithi012.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:27:41.341 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/058 2023-07-07T18:27:41.342 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/058 2023-07-07T18:27:41.342 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:41.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:41.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:41.699 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-07-07T18:27:42.004 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:42.008 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:42.008 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:42.009 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:42.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:42.365 INFO:teuthology.orchestra.run.smithi012.stdout:generic/059 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:42.369 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/059 2023-07-07T18:27:42.369 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/059 2023-07-07T18:27:42.370 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:42.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:42.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:42.404 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-07-07T18:27:42.620 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:42.624 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:42.625 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:42.625 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:42.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:43.071 INFO:teuthology.orchestra.run.smithi012.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:27:43.075 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/060 2023-07-07T18:27:43.075 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/060 2023-07-07T18:27:43.075 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:43.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:43.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:43.434 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-07-07T18:27:43.667 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:43.671 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:43.672 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:43.673 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:43.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:44.091 INFO:teuthology.orchestra.run.smithi012.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:27:44.095 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/061 2023-07-07T18:27:44.096 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/061 2023-07-07T18:27:44.096 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:44.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:44.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:44.449 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-07-07T18:27:44.676 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:44.680 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:44.681 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:44.682 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:44.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:46.645 INFO:teuthology.orchestra.run.smithi012.stdout:generic/062 2s 2023-07-07T18:27:46.654 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/062 2023-07-07T18:27:46.654 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:46.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:46.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:46.666 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-07-07T18:27:46.886 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:46.890 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:46.890 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:46.891 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:46.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:47.352 INFO:teuthology.orchestra.run.smithi012.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:27:47.356 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/063 2023-07-07T18:27:47.356 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/063 2023-07-07T18:27:47.357 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:47.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:47.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:47.665 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-07-07T18:27:48.100 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:48.105 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:48.105 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:48.106 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:48.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:48.453 INFO:teuthology.orchestra.run.smithi012.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-07T18:27:48.457 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/064 2023-07-07T18:27:48.457 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/064 2023-07-07T18:27:48.457 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:48.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:48.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:48.485 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-07-07T18:27:48.703 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:48.707 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:48.708 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:48.709 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:48.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:49.068 INFO:teuthology.orchestra.run.smithi012.stdout:generic/065 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:49.072 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/065 2023-07-07T18:27:49.073 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/065 2023-07-07T18:27:49.073 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:49.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:49.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:49.098 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-07-07T18:27:49.323 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:49.327 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:49.327 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:49.328 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:49.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:49.663 INFO:teuthology.orchestra.run.smithi012.stdout:generic/066 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:49.668 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/066 2023-07-07T18:27:49.668 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/066 2023-07-07T18:27:49.668 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:49.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:49.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:27:49.701 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:27:49.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:49.703 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-07-07T18:27:49.965 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:49.969 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:49.970 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:49.971 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:49.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:50.366 INFO:teuthology.orchestra.run.smithi012.stdout:generic/067 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:27:50.370 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/067 2023-07-07T18:27:50.370 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/067 2023-07-07T18:27:50.371 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:50.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:50.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:50.399 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-07-07T18:27:50.620 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:50.624 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:50.625 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:50.626 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:50.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:50.964 INFO:teuthology.orchestra.run.smithi012.stdout:generic/068 [not run] ceph does not support freezing 2023-07-07T18:27:50.968 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/068 2023-07-07T18:27:50.969 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/068 2023-07-07T18:27:50.969 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:50.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:50.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:50.991 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-07-07T18:27:51.212 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:51.217 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:51.217 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:51.218 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:51.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:58.113 INFO:teuthology.orchestra.run.smithi012.stdout:generic/069 7s 2023-07-07T18:27:58.131 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/069 2023-07-07T18:27:58.132 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:27:58.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:27:58.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:27:58.150 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-07-07T18:27:58.371 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:27:58.375 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:27:58.376 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:27:58.377 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:27:58.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:19.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:28:19.780 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:28:27.152 INFO:teuthology.orchestra.run.smithi012.stdout:generic/070 29s 2023-07-07T18:28:27.168 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/070 2023-07-07T18:28:27.168 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:28:27.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:27.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:28:27.582 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-07-07T18:28:28.057 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:28:28.069 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:28:28.070 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:28:28.072 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:28:28.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:28.642 INFO:teuthology.orchestra.run.smithi012.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-07T18:28:28.661 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/071 2023-07-07T18:28:28.661 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/071 2023-07-07T18:28:28.662 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:28:28.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:28.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:28:28.705 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-07-07T18:28:29.100 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:28:29.104 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:28:29.105 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:28:29.106 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:28:29.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:29.729 INFO:teuthology.orchestra.run.smithi012.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-07T18:28:29.737 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/072 2023-07-07T18:28:29.737 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/072 2023-07-07T18:28:29.738 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:28:29.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:29.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:28:29.779 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-07-07T18:28:30.176 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:28:30.180 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:28:30.181 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:28:30.182 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:28:30.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:30.798 INFO:teuthology.orchestra.run.smithi012.stdout:generic/073 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:28:30.804 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/073 2023-07-07T18:28:30.804 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/073 2023-07-07T18:28:30.804 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:28:30.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:30.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:28:30.848 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-07-07T18:28:31.202 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:28:31.209 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:28:31.210 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:28:31.211 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:28:31.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:49.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:28:49.956 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:28:50.038 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T18:28:50.036+0000 7f23f6e45700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 238213) UID: 0 2023-07-07T18:28:50.039 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T18:28:50.036+0000 7ff6efcfe700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 238213) UID: 0 2023-07-07T18:28:51.834 INFO:teuthology.orchestra.run.smithi012.stdout:generic/074 20s 2023-07-07T18:28:51.881 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/074 2023-07-07T18:28:51.881 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:28:51.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:28:53.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:28:53.068 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-07-07T18:28:53.689 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:28:53.708 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:28:53.708 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:28:53.715 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:28:53.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:31.083 INFO:teuthology.orchestra.run.smithi012.stdout:generic/075 37s 2023-07-07T18:29:31.095 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/075 2023-07-07T18:29:31.095 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:29:31.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:31.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:29:31.611 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-07-07T18:29:32.225 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:29:32.231 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:29:32.231 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:29:32.232 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:29:32.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:32.809 INFO:teuthology.orchestra.run.smithi012.stdout:generic/076 [not run] require 172.21.15.12:6789:/scratch to be local device 2023-07-07T18:29:32.814 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/076 2023-07-07T18:29:32.815 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/076 2023-07-07T18:29:32.815 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:29:32.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:32.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:29:32.848 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-07-07T18:29:33.291 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:29:33.297 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:29:33.297 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:29:33.298 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:29:33.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:45.293 INFO:teuthology.orchestra.run.smithi012.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T18:29:45.300 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/077 2023-07-07T18:29:45.300 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/077 2023-07-07T18:29:45.300 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:29:45.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:45.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:29:45.741 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-07-07T18:29:46.611 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:29:46.634 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:29:46.634 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:29:46.637 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:29:46.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:47.349 INFO:teuthology.orchestra.run.smithi012.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-07T18:29:47.356 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/078 2023-07-07T18:29:47.356 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/078 2023-07-07T18:29:47.356 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:29:47.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:47.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:29:47.666 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-07-07T18:29:48.247 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:29:48.253 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:29:48.253 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:29:48.254 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:29:48.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:48.967 INFO:teuthology.orchestra.run.smithi012.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-07T18:29:48.973 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/079 2023-07-07T18:29:48.973 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/079 2023-07-07T18:29:48.973 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:29:48.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:49.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:29:49.028 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-07-07T18:29:49.521 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:29:49.537 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:29:49.550 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:29:49.551 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:29:49.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:52.220 INFO:teuthology.orchestra.run.smithi012.stdout:generic/080 3s 2023-07-07T18:29:52.244 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/080 2023-07-07T18:29:52.244 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:29:52.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:52.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:29:52.321 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-07-07T18:29:52.804 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:29:52.811 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:29:52.816 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:29:52.817 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:29:52.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:53.454 INFO:teuthology.orchestra.run.smithi012.stdout:generic/081 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:29:53.462 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/081 2023-07-07T18:29:53.462 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/081 2023-07-07T18:29:53.462 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:29:53.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:53.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:29:53.499 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-07-07T18:29:54.040 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:29:54.047 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:29:54.047 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:29:54.048 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:29:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:54.697 INFO:teuthology.orchestra.run.smithi012.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T18:29:54.709 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/082 2023-07-07T18:29:54.709 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/082 2023-07-07T18:29:54.709 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:29:54.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:54.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:29:54.744 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-07-07T18:29:55.193 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:29:55.197 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:29:55.198 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:29:55.199 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:29:55.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:55.964 INFO:teuthology.orchestra.run.smithi012.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T18:29:55.972 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/083 2023-07-07T18:29:55.972 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/083 2023-07-07T18:29:55.972 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:29:55.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:29:56.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:29:56.023 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-07-07T18:29:56.532 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:29:56.539 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:29:56.540 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:29:56.543 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:29:56.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:07.787 INFO:teuthology.orchestra.run.smithi012.stdout:generic/084 11s 2023-07-07T18:30:07.820 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/084 2023-07-07T18:30:07.820 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:30:07.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:07.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:30:07.841 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-07-07T18:30:08.443 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:30:08.455 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:30:08.456 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:30:08.457 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:30:08.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:09.158 INFO:teuthology.orchestra.run.smithi012.stdout:generic/085 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:30:09.167 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/085 2023-07-07T18:30:09.167 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/085 2023-07-07T18:30:09.167 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:30:09.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:09.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:30:09.215 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-07-07T18:30:09.715 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:30:09.726 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:30:09.726 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:30:09.727 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:30:09.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:10.350 INFO:teuthology.orchestra.run.smithi012.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:30:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/086 2023-07-07T18:30:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/086 2023-07-07T18:30:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:30:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:10.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:30:10.410 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-07-07T18:30:10.961 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:30:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:30:10.968 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:30:10.970 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:30:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:11.780 INFO:teuthology.orchestra.run.smithi012.stdout:generic/087 0s 2023-07-07T18:30:11.797 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/087 2023-07-07T18:30:11.798 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:30:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:12.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:30:12.214 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-07-07T18:30:12.777 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:30:12.786 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:30:12.789 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:30:12.790 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:30:12.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:13.438 INFO:teuthology.orchestra.run.smithi012.stdout:generic/088 0s 2023-07-07T18:30:13.447 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/088 2023-07-07T18:30:13.447 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:30:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:30:13.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:30:13.825 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-07-07T18:30:14.452 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:30:14.471 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:30:14.471 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:30:14.472 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:30:14.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:32:17.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:32:17.164 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:32:48.713 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:32:48.716 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:33:18.809 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:33:18.811 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:33:49.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:33:49.206 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:34:19.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:34:19.301 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:34:19.404 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T18:34:19.403+0000 7f23f6e45700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 247499) UID: 0 2023-07-07T18:34:19.404 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T18:34:19.403+0000 7ff6efcfe700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 247499) UID: 0 2023-07-07T18:37:17.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:37:17.326 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:37:48.279 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:37:48.281 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:38:18.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:38:18.617 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:38:18.654 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T18:38:18.654+0000 7f23f6e45700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 249615) UID: 0 2023-07-07T18:38:18.655 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T18:38:18.654+0000 7ff6efcfe700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 249615) UID: 0 2023-07-07T18:38:37.850 INFO:teuthology.orchestra.run.smithi012.stdout:generic/089 503s 2023-07-07T18:38:37.864 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/089 2023-07-07T18:38:37.864 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:38:37.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:38:38.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:38:38.446 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-07-07T18:38:38.937 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:38:38.941 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:38:38.941 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:38:38.942 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:38:38.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:38:39.352 INFO:teuthology.orchestra.run.smithi012.stdout:generic/090 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:38:39.356 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/090 2023-07-07T18:38:39.356 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/090 2023-07-07T18:38:39.356 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:38:39.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:38:39.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:38:39.384 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-07-07T18:38:39.612 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:38:39.616 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:38:39.617 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:38:39.618 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:38:39.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:18.308 INFO:teuthology.orchestra.run.smithi012.stdout:generic/091 99s 2023-07-07T18:40:18.313 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/091 2023-07-07T18:40:18.313 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:18.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:18.765 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-07-07T18:40:19.002 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:19.006 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:19.007 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:19.007 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:19.360 INFO:teuthology.orchestra.run.smithi012.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:40:19.364 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/092 2023-07-07T18:40:19.365 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/092 2023-07-07T18:40:19.365 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:19.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:19.397 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-07-07T18:40:19.624 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:19.629 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:19.629 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:19.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:20.288 INFO:teuthology.orchestra.run.smithi012.stdout:generic/093 1s 2023-07-07T18:40:20.293 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/093 2023-07-07T18:40:20.293 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:20.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:20.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:20.410 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-07-07T18:40:20.943 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:20.947 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:20.948 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:20.949 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:20.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:21.346 INFO:teuthology.orchestra.run.smithi012.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-07T18:40:21.350 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/094 2023-07-07T18:40:21.350 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/094 2023-07-07T18:40:21.350 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:21.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:21.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:21.676 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-07-07T18:40:22.006 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:22.010 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:22.010 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:22.011 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:22.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:36.194 INFO:teuthology.orchestra.run.smithi012.stdout:generic/095 14s 2023-07-07T18:40:36.199 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/095 2023-07-07T18:40:36.199 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:36.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:36.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:36.210 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-07-07T18:40:36.431 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:36.435 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:36.435 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:36.436 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:36.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:36.872 INFO:teuthology.orchestra.run.smithi012.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-07T18:40:36.876 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/096 2023-07-07T18:40:36.876 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/096 2023-07-07T18:40:36.876 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:36.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:36.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:36.913 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-07-07T18:40:37.132 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:37.136 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:37.137 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:37.138 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:37.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:38.015 INFO:teuthology.orchestra.run.smithi012.stdout:generic/097 1s 2023-07-07T18:40:38.020 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/097 2023-07-07T18:40:38.021 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:38.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:38.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:38.059 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-07-07T18:40:38.279 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:38.284 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:38.285 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:38.286 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:38.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:40.853 INFO:teuthology.orchestra.run.smithi012.stdout:generic/098 2s 2023-07-07T18:40:40.858 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/098 2023-07-07T18:40:40.858 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:40.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:40.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:40.869 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-07-07T18:40:41.090 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:41.094 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:41.095 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:41.096 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:41.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:42.014 INFO:teuthology.orchestra.run.smithi012.stdout:generic/099 1s 2023-07-07T18:40:42.019 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/099 2023-07-07T18:40:42.019 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:42.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:42.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:42.249 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-07-07T18:40:42.665 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:42.670 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:42.670 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:42.671 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:42.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:54.590 INFO:teuthology.orchestra.run.smithi012.stdout:generic/100 12s 2023-07-07T18:40:54.595 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/100 2023-07-07T18:40:54.595 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:54.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:58.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:58.695 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-07-07T18:40:59.083 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:59.087 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:59.087 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:59.088 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:59.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:59.434 INFO:teuthology.orchestra.run.smithi012.stdout:generic/101 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:40:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/101 2023-07-07T18:40:59.438 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/101 2023-07-07T18:40:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:40:59.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:40:59.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:40:59.467 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-07-07T18:40:59.691 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:40:59.695 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:40:59.695 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:40:59.696 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:40:59.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:00.031 INFO:teuthology.orchestra.run.smithi012.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T18:41:00.035 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/102 2023-07-07T18:41:00.036 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/102 2023-07-07T18:41:00.036 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:00.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:00.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:00.057 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-07-07T18:41:00.278 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:00.282 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:00.282 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:00.283 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:00.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:00.637 INFO:teuthology.orchestra.run.smithi012.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T18:41:00.641 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/103 2023-07-07T18:41:00.642 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/103 2023-07-07T18:41:00.642 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:00.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:00.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:00.705 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-07-07T18:41:01.280 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:01.284 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:01.285 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:01.286 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:01.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:01.640 INFO:teuthology.orchestra.run.smithi012.stdout:generic/104 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:41:01.644 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/104 2023-07-07T18:41:01.645 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/104 2023-07-07T18:41:01.645 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:01.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:01.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:01.671 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-07-07T18:41:01.892 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:01.896 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:01.896 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:01.897 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:01.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:02.795 INFO:teuthology.orchestra.run.smithi012.stdout:generic/105 0s 2023-07-07T18:41:02.809 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/105 2023-07-07T18:41:02.809 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:02.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:02.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:02.917 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-07-07T18:41:03.146 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:03.150 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:03.151 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:03.152 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:03.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:03.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:41:03.216 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:41:03.522 INFO:teuthology.orchestra.run.smithi012.stdout:generic/106 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:41:03.526 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/106 2023-07-07T18:41:03.527 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/106 2023-07-07T18:41:03.527 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:03.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:03.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:03.560 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-07-07T18:41:03.783 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:03.787 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:03.788 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:03.789 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:03.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:04.140 INFO:teuthology.orchestra.run.smithi012.stdout:generic/107 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:41:04.144 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/107 2023-07-07T18:41:04.144 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/107 2023-07-07T18:41:04.145 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:04.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:04.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:04.173 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-07-07T18:41:04.394 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:04.399 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:04.399 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:04.400 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:04.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:04.878 INFO:teuthology.orchestra.run.smithi012.stdout:generic/108 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T18:41:04.882 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/108 2023-07-07T18:41:04.882 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/108 2023-07-07T18:41:04.882 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:04.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:04.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:04.906 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-07-07T18:41:05.128 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:05.132 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:05.132 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:05.133 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:05.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:15.510 INFO:teuthology.orchestra.run.smithi012.stdout:generic/109 10s 2023-07-07T18:41:15.524 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/109 2023-07-07T18:41:15.524 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:15.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:15.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:15.554 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-07-07T18:41:16.590 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:16.594 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:16.595 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:16.595 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:16.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:33.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:41:33.312 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:41:37.361 INFO:teuthology.orchestra.run.smithi012.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T18:41:37.387 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/110 2023-07-07T18:41:37.387 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/110 2023-07-07T18:41:37.387 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:37.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:37.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:37.932 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-07-07T18:41:38.257 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:38.261 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:38.262 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:38.263 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:38.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:38.622 INFO:teuthology.orchestra.run.smithi012.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T18:41:38.626 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/111 2023-07-07T18:41:38.626 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/111 2023-07-07T18:41:38.627 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:38.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:39.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:39.028 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-07-07T18:41:39.261 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:39.265 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:39.266 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:39.267 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:39.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:54.517 INFO:teuthology.orchestra.run.smithi012.stdout:generic/112 15s 2023-07-07T18:41:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/112 2023-07-07T18:41:54.522 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:41:54.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:41:54.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:41:54.931 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-07-07T18:41:55.182 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:41:55.186 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:41:55.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:03.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:42:03.612 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:42:11.951 INFO:teuthology.orchestra.run.smithi012.stdout:generic/113 16s 2023-07-07T18:42:11.956 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/113 2023-07-07T18:42:11.956 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:12.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:12.097 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-07-07T18:42:12.578 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:12.583 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:13.175 INFO:teuthology.orchestra.run.smithi012.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-07-07T18:42:13.179 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/114 2023-07-07T18:42:13.180 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/114 2023-07-07T18:42:13.180 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:13.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:13.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:13.207 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-07-07T18:42:13.430 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:13.434 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:13.435 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:13.436 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:13.800 INFO:teuthology.orchestra.run.smithi012.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T18:42:13.805 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/115 2023-07-07T18:42:13.805 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/115 2023-07-07T18:42:13.805 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:13.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:14.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:14.043 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-07-07T18:42:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:14.436 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:14.436 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:14.437 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:14.802 INFO:teuthology.orchestra.run.smithi012.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T18:42:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/116 2023-07-07T18:42:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/116 2023-07-07T18:42:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:15.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:15.193 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-07-07T18:42:15.452 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:15.456 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:15.456 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:15.457 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:31.404 INFO:teuthology.orchestra.run.smithi012.stdout:generic/117 16s 2023-07-07T18:42:31.408 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/117 2023-07-07T18:42:31.409 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:31.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:31.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:31.419 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-07-07T18:42:31.644 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:31.648 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:31.649 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:31.650 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:31.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:32.489 INFO:teuthology.orchestra.run.smithi012.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T18:42:32.493 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/118 2023-07-07T18:42:32.493 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/118 2023-07-07T18:42:32.494 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:32.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:32.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:32.899 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-07-07T18:42:33.125 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:33.129 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:33.129 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:33.130 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:33.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:33.493 INFO:teuthology.orchestra.run.smithi012.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T18:42:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/119 2023-07-07T18:42:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/119 2023-07-07T18:42:33.497 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:33.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:33.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:33.574 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-07-07T18:42:34.113 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:34.118 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:34.118 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:34.119 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:34.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:34.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:42:34.192 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:42:34.451 INFO:teuthology.orchestra.run.smithi012.stdout:generic/120 [not run] atime not maintained by ceph 2023-07-07T18:42:34.455 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/120 2023-07-07T18:42:34.455 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/120 2023-07-07T18:42:34.455 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:34.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:34.480 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-07-07T18:42:34.699 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:34.703 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:34.703 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:34.704 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:34.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:35.064 INFO:teuthology.orchestra.run.smithi012.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-07T18:42:35.068 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/121 2023-07-07T18:42:35.068 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/121 2023-07-07T18:42:35.068 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:35.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:35.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:35.429 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-07-07T18:42:35.690 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:35.694 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:35.694 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:35.695 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:35.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:36.067 INFO:teuthology.orchestra.run.smithi012.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-07T18:42:36.071 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/122 2023-07-07T18:42:36.071 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/122 2023-07-07T18:42:36.071 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:36.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:36.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:36.474 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-07-07T18:42:36.707 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:36.711 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:36.712 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:36.713 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:36.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:37.225 INFO:teuthology.orchestra.run.smithi012.stdout:generic/123 1s 2023-07-07T18:42:37.229 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/123 2023-07-07T18:42:37.230 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:37.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:37.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:37.626 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-07-07T18:42:37.868 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:37.872 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:37.873 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:37.874 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:37.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:40.189 INFO:teuthology.orchestra.run.smithi012.stdout:generic/124 2s 2023-07-07T18:42:40.200 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/124 2023-07-07T18:42:40.201 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:42:40.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:42:40.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:42:40.590 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-07-07T18:42:41.073 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:42:41.078 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:42:41.078 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:42:41.079 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:42:41.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:43:04.247 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:43:04.251 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:43:34.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:43:34.364 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:43:42.677 INFO:teuthology.orchestra.run.smithi012.stdout:generic/125 61s 2023-07-07T18:43:42.683 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/125 2023-07-07T18:43:42.683 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:43:42.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:43:43.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:43:43.003 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-07-07T18:43:43.290 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:43:43.294 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:43:43.295 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:43:43.296 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:43:43.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:43:43.826 INFO:teuthology.orchestra.run.smithi012.stdout:generic/126 0s 2023-07-07T18:43:43.831 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/126 2023-07-07T18:43:43.831 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:43:43.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:43:44.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:43:44.130 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-07-07T18:43:44.517 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:43:44.521 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:43:44.522 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:43:44.522 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:43:44.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:44:04.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:44:04.495 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:44:34.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:44:34.561 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:45:04.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:45:04.696 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:45:34.823 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:45:34.826 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:46:04.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:46:04.947 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:46:35.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:46:35.294 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:47:05.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:47:05.442 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:47:35.688 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:47:35.690 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:48:05.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:48:05.785 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:48:35.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:48:35.857 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:49:05.959 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:49:05.962 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:49:36.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:49:36.067 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:50:06.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:50:06.155 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:50:36.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:50:36.528 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:51:06.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:51:06.625 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:51:36.793 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:51:36.797 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:52:06.924 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:52:06.927 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:52:37.112 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:52:37.114 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:53:07.226 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:53:07.228 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:53:35.694 INFO:teuthology.orchestra.run.smithi012.stdout:generic/127 591s 2023-07-07T18:53:35.698 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/127 2023-07-07T18:53:35.698 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:53:35.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:53:35.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:53:35.965 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-07-07T18:53:36.318 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:53:36.322 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:53:36.322 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:53:36.323 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:53:36.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:53:37.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:53:37.356 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:53:37.439 INFO:teuthology.orchestra.run.smithi012.stdout:generic/128 1s 2023-07-07T18:53:37.446 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/128 2023-07-07T18:53:37.446 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T18:53:37.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:53:37.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T18:53:37.457 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-07-07T18:53:37.685 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T18:53:37.689 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T18:53:37.690 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T18:53:37.690 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T18:53:37.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T18:54:07.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:54:07.489 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:54:38.125 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:54:38.129 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:55:08.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:55:08.249 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:55:38.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:55:38.383 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:56:08.528 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:56:08.531 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:56:38.730 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:56:38.737 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:57:09.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:57:09.179 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:57:39.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:57:39.271 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T18:57:39.543 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T18:57:39.538+0000 7f93a9f18700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113504) UID: 0 2023-07-07T18:57:39.544 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T18:57:39.538+0000 7fa834dc8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113504) UID: 0 2023-07-07T18:57:39.544 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T18:57:39.543+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113504) UID: 0 2023-07-07T18:57:39.546 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T18:57:39.539+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113504) UID: 0 2023-07-07T19:02:02.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:02:02.511 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:02:03.073 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T19:02:03.012+0000 7efe5fde0700 -1 received signal: Hangup from (PID: 290337) UID: 0 2023-07-07T19:02:03.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T19:02:03.011+0000 7fb626ecc700 -1 received signal: Hangup from (PID: 290337) UID: 0 2023-07-07T19:02:03.080 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T19:02:03.011+0000 7f5317f46700 -1 received signal: Hangup from (PID: 290337) UID: 0 2023-07-07T19:02:03.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T19:02:03.012+0000 7f18a8cee700 -1 received signal: Hangup from (PID: 290337) UID: 0 2023-07-07T19:07:45.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:07:45.895 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:07:45.993 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T19:07:45.992+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113654) UID: 0 2023-07-07T19:07:45.994 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T19:07:45.992+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113654) UID: 0 2023-07-07T19:07:45.994 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T19:07:45.992+0000 7fa834dc8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113654) UID: 0 2023-07-07T19:07:45.995 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T19:07:45.992+0000 7f93a9f18700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113654) UID: 0 2023-07-07T19:07:46.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T19:07:46.051+0000 7fb626ecc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290410) UID: 0 2023-07-07T19:07:46.063 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T19:07:46.057+0000 7f5317f46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290410) UID: 0 2023-07-07T19:07:46.064 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T19:07:46.056+0000 7efe5fde0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290410) UID: 0 2023-07-07T19:07:46.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T19:07:46.051+0000 7f18a8cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 290410) UID: 0 2023-07-07T19:10:02.291 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T19:10:02.267+0000 7f93a9f18700 -1 received signal: Hangup from (PID: 113681) UID: 0 2023-07-07T19:10:02.292 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T19:10:02.266+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113681) UID: 0 2023-07-07T19:10:02.293 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T19:10:02.266+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113681) UID: 0 2023-07-07T19:10:02.293 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T19:10:02.267+0000 7fa834dc8700 -1 received signal: Hangup from (PID: 113681) UID: 0 2023-07-07T19:14:17.349 INFO:teuthology.orchestra.run.smithi012.stdout:generic/129 1239s 2023-07-07T19:14:17.602 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/129 2023-07-07T19:14:17.602 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:14:17.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:14:17.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:14:17.690 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-07-07T19:14:18.820 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:14:18.823 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:14:18.824 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:14:18.824 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:14:18.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:14:31.497 INFO:teuthology.orchestra.run.smithi012.stdout:generic/130 12s 2023-07-07T19:14:31.503 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/130 2023-07-07T19:14:31.503 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:14:31.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:14:31.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:14:31.512 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-07-07T19:14:31.742 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:14:31.746 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:14:31.747 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:14:31.747 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:14:31.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:14:33.361 INFO:teuthology.orchestra.run.smithi012.stdout:generic/131 2s 2023-07-07T19:14:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/131 2023-07-07T19:14:33.379 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:14:33.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:14:33.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:14:33.872 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-07-07T19:14:34.445 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:14:34.449 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:14:34.449 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:14:34.456 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:14:34.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:14:49.278 INFO:teuthology.orchestra.run.smithi012.stdout:generic/132 15s 2023-07-07T19:14:49.288 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/132 2023-07-07T19:14:49.289 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:14:49.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:14:49.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:14:49.295 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-07-07T19:14:49.520 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:14:49.534 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:14:49.534 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:14:49.536 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:14:49.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:18:52.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:18:52.777 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:19:16.606 INFO:teuthology.orchestra.run.smithi012.stdout:generic/133 267s 2023-07-07T19:19:16.610 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/133 2023-07-07T19:19:16.610 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:16.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:16.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:16.972 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-07-07T19:19:17.247 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:17.251 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:17.252 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:17.253 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:17.833 INFO:teuthology.orchestra.run.smithi012.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:17.837 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/134 2023-07-07T19:19:17.837 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/134 2023-07-07T19:19:17.837 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:17.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:18.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:18.102 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-07-07T19:19:18.475 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:18.479 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:18.480 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:18.481 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:19.598 INFO:teuthology.orchestra.run.smithi012.stdout:generic/135 1s 2023-07-07T19:19:19.603 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/135 2023-07-07T19:19:19.603 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:19.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:19.614 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-07-07T19:19:19.847 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:19.851 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:19.851 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:19.852 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:19.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:20.228 INFO:teuthology.orchestra.run.smithi012.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-07T19:19:20.232 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/136 2023-07-07T19:19:20.232 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/136 2023-07-07T19:19:20.233 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:20.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:20.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:20.475 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-07-07T19:19:20.879 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:20.883 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:20.884 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:20.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:21.255 INFO:teuthology.orchestra.run.smithi012.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:21.259 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/137 2023-07-07T19:19:21.259 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/137 2023-07-07T19:19:21.259 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:21.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:21.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:21.675 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-07-07T19:19:21.910 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:21.914 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:21.915 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:21.916 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:21.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:22.292 INFO:teuthology.orchestra.run.smithi012.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:22.296 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/138 2023-07-07T19:19:22.296 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/138 2023-07-07T19:19:22.296 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:22.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:22.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:22.606 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-07-07T19:19:22.953 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:22.958 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:22.958 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:22.959 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:22.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:23.331 INFO:teuthology.orchestra.run.smithi012.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:23.335 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/139 2023-07-07T19:19:23.335 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/139 2023-07-07T19:19:23.335 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:23.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:19:23.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:23.340 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:19:23.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:23.750 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-07-07T19:19:23.992 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:23.997 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:23.997 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:23.998 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:23.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:24.372 INFO:teuthology.orchestra.run.smithi012.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:24.376 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/140 2023-07-07T19:19:24.377 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/140 2023-07-07T19:19:24.377 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:24.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:24.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:24.771 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-07-07T19:19:25.013 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:25.017 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:25.017 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:25.018 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:25.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:25.596 INFO:teuthology.orchestra.run.smithi012.stdout:generic/141 0s 2023-07-07T19:19:25.604 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/141 2023-07-07T19:19:25.605 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:25.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:25.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:25.615 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-07-07T19:19:25.851 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:25.856 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:25.857 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:25.858 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:25.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:26.426 INFO:teuthology.orchestra.run.smithi012.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:26.448 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/142 2023-07-07T19:19:26.448 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/142 2023-07-07T19:19:26.448 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:26.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:26.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:26.776 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-07-07T19:19:27.080 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:27.084 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:27.085 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:27.086 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:27.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:27.453 INFO:teuthology.orchestra.run.smithi012.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/143 2023-07-07T19:19:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/143 2023-07-07T19:19:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:27.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:27.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:27.787 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-07-07T19:19:28.097 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:28.101 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:28.101 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:28.102 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:28.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:28.475 INFO:teuthology.orchestra.run.smithi012.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:28.479 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/144 2023-07-07T19:19:28.479 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/144 2023-07-07T19:19:28.480 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:28.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:28.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:28.817 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-07-07T19:19:29.139 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:29.143 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:29.144 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:29.144 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:29.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:29.520 INFO:teuthology.orchestra.run.smithi012.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:29.524 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/145 2023-07-07T19:19:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/145 2023-07-07T19:19:29.525 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:29.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:29.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:29.895 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-07-07T19:19:30.169 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:30.173 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:30.173 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:30.174 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:30.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:30.544 INFO:teuthology.orchestra.run.smithi012.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:30.548 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/146 2023-07-07T19:19:30.548 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/146 2023-07-07T19:19:30.548 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:30.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:30.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:30.655 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-07-07T19:19:31.186 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:31.190 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:31.192 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:31.192 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:31.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:31.560 INFO:teuthology.orchestra.run.smithi012.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:31.564 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/147 2023-07-07T19:19:31.564 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/147 2023-07-07T19:19:31.564 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:31.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:31.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:31.960 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-07-07T19:19:32.204 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:32.208 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:32.209 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:32.210 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:32.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:32.579 INFO:teuthology.orchestra.run.smithi012.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:32.583 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/148 2023-07-07T19:19:32.584 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/148 2023-07-07T19:19:32.584 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:32.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:32.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:32.936 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-07-07T19:19:33.241 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:33.245 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:33.245 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:33.246 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:33.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:33.618 INFO:teuthology.orchestra.run.smithi012.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:33.622 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/149 2023-07-07T19:19:33.622 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/149 2023-07-07T19:19:33.623 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:33.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:33.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:33.984 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-07-07T19:19:34.272 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:34.276 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:34.277 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:34.277 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:34.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:34.647 INFO:teuthology.orchestra.run.smithi012.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:34.651 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/150 2023-07-07T19:19:34.651 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/150 2023-07-07T19:19:34.652 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:34.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:34.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:34.872 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-07-07T19:19:35.277 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:35.282 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:35.282 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:35.283 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:35.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:35.650 INFO:teuthology.orchestra.run.smithi012.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:35.653 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/151 2023-07-07T19:19:35.654 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/151 2023-07-07T19:19:35.654 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:35.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:36.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:36.026 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-07-07T19:19:36.331 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:36.335 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:36.335 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:36.336 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:36.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:36.697 INFO:teuthology.orchestra.run.smithi012.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:36.701 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/152 2023-07-07T19:19:36.702 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/152 2023-07-07T19:19:36.702 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:36.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:36.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:36.827 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-07-07T19:19:37.362 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:37.366 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:37.367 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:37.368 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:37.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:37.736 INFO:teuthology.orchestra.run.smithi012.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:37.740 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/153 2023-07-07T19:19:37.740 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/153 2023-07-07T19:19:37.740 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:37.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:37.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:37.935 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-07-07T19:19:38.381 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:38.388 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:38.388 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:38.388 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:38.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:38.756 INFO:teuthology.orchestra.run.smithi012.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:38.760 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/154 2023-07-07T19:19:38.760 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/154 2023-07-07T19:19:38.761 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:38.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:39.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:39.189 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-07-07T19:19:39.419 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:39.424 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:39.425 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:39.425 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:39.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:39.799 INFO:teuthology.orchestra.run.smithi012.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:39.803 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/155 2023-07-07T19:19:39.803 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/155 2023-07-07T19:19:39.803 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:39.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:40.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:40.210 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-07-07T19:19:40.464 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:40.469 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:40.469 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:40.470 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:40.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:40.833 INFO:teuthology.orchestra.run.smithi012.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:40.837 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/156 2023-07-07T19:19:40.838 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/156 2023-07-07T19:19:40.838 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:40.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:41.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:41.058 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-07-07T19:19:41.484 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:41.488 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:41.489 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:41.489 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:41.859 INFO:teuthology.orchestra.run.smithi012.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:19:41.863 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/157 2023-07-07T19:19:41.863 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/157 2023-07-07T19:19:41.863 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:41.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:42.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:42.288 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-07-07T19:19:42.516 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:42.521 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:42.521 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:42.522 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:42.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:42.887 INFO:teuthology.orchestra.run.smithi012.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-07T19:19:42.892 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/158 2023-07-07T19:19:42.892 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/158 2023-07-07T19:19:42.892 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:42.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:43.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:43.018 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-07-07T19:19:43.534 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:43.539 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:43.539 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:43.540 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:43.917 INFO:teuthology.orchestra.run.smithi012.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-07-07T19:19:43.921 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/159 2023-07-07T19:19:43.921 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/159 2023-07-07T19:19:43.921 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:43.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:43.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:43.957 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-07-07T19:19:44.178 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:44.182 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:44.183 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:44.184 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:44.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:44.544 INFO:teuthology.orchestra.run.smithi012.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-07-07T19:19:44.548 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/160 2023-07-07T19:19:44.549 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/160 2023-07-07T19:19:44.549 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:44.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:44.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:44.585 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-07-07T19:19:44.807 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:44.812 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:44.812 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:44.813 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:44.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:45.657 INFO:teuthology.orchestra.run.smithi012.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:19:45.712 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/161 2023-07-07T19:19:45.712 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/161 2023-07-07T19:19:45.713 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:45.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:45.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:45.780 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-07-07T19:19:46.000 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:46.005 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:46.005 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:46.006 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:46.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:46.539 INFO:teuthology.orchestra.run.smithi012.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-07T19:19:46.745 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/162 2023-07-07T19:19:46.745 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/162 2023-07-07T19:19:46.745 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:46.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:46.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:46.972 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-07-07T19:19:47.208 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:47.212 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:47.212 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:47.213 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:47.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:47.765 INFO:teuthology.orchestra.run.smithi012.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-07T19:19:47.842 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/163 2023-07-07T19:19:47.842 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/163 2023-07-07T19:19:47.842 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:47.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:48.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:48.193 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-07-07T19:19:48.427 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:48.432 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:48.432 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:48.433 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:48.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:49.194 INFO:teuthology.orchestra.run.smithi012.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:19:49.225 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/164 2023-07-07T19:19:49.225 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/164 2023-07-07T19:19:49.225 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:49.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:49.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:49.411 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-07-07T19:19:49.641 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:49.645 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:49.645 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:49.646 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:49.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:50.470 INFO:teuthology.orchestra.run.smithi012.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:19:50.480 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/165 2023-07-07T19:19:50.480 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/165 2023-07-07T19:19:50.480 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:50.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:50.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:50.630 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-07-07T19:19:50.855 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:50.859 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:50.859 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:50.860 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:50.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:51.658 INFO:teuthology.orchestra.run.smithi012.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:19:51.693 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/166 2023-07-07T19:19:51.693 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/166 2023-07-07T19:19:51.693 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:51.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:51.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:51.843 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-07-07T19:19:52.068 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:52.072 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:52.072 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:52.073 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:52.074 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:53.022 INFO:teuthology.orchestra.run.smithi012.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:19:53.030 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/167 2023-07-07T19:19:53.030 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/167 2023-07-07T19:19:53.031 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:53.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:53.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:53.059 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-07-07T19:19:53.277 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:53.281 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:53.282 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:53.283 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:53.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:53.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:19:53.434 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:19:54.037 INFO:teuthology.orchestra.run.smithi012.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:19:54.190 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/168 2023-07-07T19:19:54.191 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/168 2023-07-07T19:19:54.191 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:54.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:54.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:54.267 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-07-07T19:19:54.493 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:54.497 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:54.498 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:54.498 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:54.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:55.326 INFO:teuthology.orchestra.run.smithi012.stdout:generic/169 1s 2023-07-07T19:19:55.331 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/169 2023-07-07T19:19:55.331 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:55.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:55.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:55.342 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-07-07T19:19:55.570 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:55.574 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:55.575 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:55.576 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:55.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:56.504 INFO:teuthology.orchestra.run.smithi012.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:19:56.527 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/170 2023-07-07T19:19:56.527 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/170 2023-07-07T19:19:56.527 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:56.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:56.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:56.571 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-07-07T19:19:56.790 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:56.794 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:56.794 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:56.795 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:56.795 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:57.743 INFO:teuthology.orchestra.run.smithi012.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:19:57.749 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/171 2023-07-07T19:19:57.749 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/171 2023-07-07T19:19:57.750 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:57.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:57.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:57.785 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-07-07T19:19:58.006 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:58.010 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:58.011 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:58.011 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:58.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:58.840 INFO:teuthology.orchestra.run.smithi012.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:19:58.851 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/172 2023-07-07T19:19:58.851 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/172 2023-07-07T19:19:58.851 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:19:58.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:19:59.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:19:59.061 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-07-07T19:19:59.282 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:19:59.286 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:19:59.287 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:19:59.288 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:19:59.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:00.239 INFO:teuthology.orchestra.run.smithi012.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:00.300 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/173 2023-07-07T19:20:00.300 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/173 2023-07-07T19:20:00.301 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:00.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:00.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:00.402 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-07-07T19:20:00.632 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:00.636 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:00.637 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:00.638 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:00.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:01.574 INFO:teuthology.orchestra.run.smithi012.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:01.591 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/174 2023-07-07T19:20:01.592 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/174 2023-07-07T19:20:01.592 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:01.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:01.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:01.626 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-07-07T19:20:01.850 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:01.854 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:01.855 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:01.856 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:01.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:02.804 INFO:teuthology.orchestra.run.smithi012.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:02.818 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/175 2023-07-07T19:20:02.819 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/175 2023-07-07T19:20:02.819 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:02.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:02.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:02.848 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-07-07T19:20:03.073 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:03.077 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:03.078 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:03.078 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:03.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:04.011 INFO:teuthology.orchestra.run.smithi012.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:04.040 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/176 2023-07-07T19:20:04.040 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/176 2023-07-07T19:20:04.040 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:04.043 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:04.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:04.071 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-07-07T19:20:04.296 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:04.300 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:04.301 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:04.301 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:04.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:04.823 INFO:teuthology.orchestra.run.smithi012.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-07T19:20:04.827 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/177 2023-07-07T19:20:04.827 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/177 2023-07-07T19:20:04.828 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:04.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:05.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:05.184 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-07-07T19:20:05.484 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:05.488 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:05.489 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:05.489 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:05.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:05.865 INFO:teuthology.orchestra.run.smithi012.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:20:05.869 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/178 2023-07-07T19:20:05.869 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/178 2023-07-07T19:20:05.869 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:05.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:06.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:06.127 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-07-07T19:20:06.524 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:06.528 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:06.529 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:06.529 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:06.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:06.893 INFO:teuthology.orchestra.run.smithi012.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:20:06.897 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/179 2023-07-07T19:20:06.897 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/179 2023-07-07T19:20:06.897 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:06.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:07.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:07.271 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-07-07T19:20:07.546 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:07.550 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:07.551 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:07.551 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:07.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:07.915 INFO:teuthology.orchestra.run.smithi012.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:20:07.919 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/180 2023-07-07T19:20:07.920 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/180 2023-07-07T19:20:07.920 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:07.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:08.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:08.255 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-07-07T19:20:08.577 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:08.581 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:08.581 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:08.582 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:08.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:08.951 INFO:teuthology.orchestra.run.smithi012.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:20:08.955 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/181 2023-07-07T19:20:08.955 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/181 2023-07-07T19:20:08.955 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:08.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:09.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:09.280 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-07-07T19:20:09.614 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:09.618 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:09.619 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:09.620 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:09.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:09.988 INFO:teuthology.orchestra.run.smithi012.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-07T19:20:09.992 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/182 2023-07-07T19:20:09.992 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/182 2023-07-07T19:20:09.992 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:09.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:10.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:10.236 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-07-07T19:20:10.658 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:10.663 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:10.663 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:10.664 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:11.591 INFO:teuthology.orchestra.run.smithi012.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:11.609 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/183 2023-07-07T19:20:11.609 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/183 2023-07-07T19:20:11.609 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:11.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:11.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:11.642 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-07-07T19:20:11.869 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:11.873 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:11.873 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:11.874 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:11.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:12.245 INFO:teuthology.orchestra.run.smithi012.stdout:generic/184 0s 2023-07-07T19:20:12.250 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/184 2023-07-07T19:20:12.251 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:12.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:12.281 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-07-07T19:20:12.508 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:12.513 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:12.513 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:12.514 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:13.332 INFO:teuthology.orchestra.run.smithi012.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:13.347 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/185 2023-07-07T19:20:13.347 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/185 2023-07-07T19:20:13.347 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:13.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:13.481 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-07-07T19:20:13.701 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:13.705 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:13.705 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:13.707 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:14.598 INFO:teuthology.orchestra.run.smithi012.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:14.643 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/186 2023-07-07T19:20:14.644 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/186 2023-07-07T19:20:14.644 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:14.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:14.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:14.682 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-07-07T19:20:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:14.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:15.880 INFO:teuthology.orchestra.run.smithi012.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:15.886 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/187 2023-07-07T19:20:15.886 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/187 2023-07-07T19:20:15.886 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:15.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:15.908 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-07-07T19:20:16.136 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:16.141 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:16.141 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:16.142 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:16.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:17.049 INFO:teuthology.orchestra.run.smithi012.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:17.079 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/188 2023-07-07T19:20:17.079 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/188 2023-07-07T19:20:17.079 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:17.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:17.122 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-07-07T19:20:17.347 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:17.352 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:17.353 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:17.353 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:17.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:18.215 INFO:teuthology.orchestra.run.smithi012.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:18.265 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/189 2023-07-07T19:20:18.266 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/189 2023-07-07T19:20:18.266 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:18.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:18.322 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-07-07T19:20:18.544 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:18.549 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:18.549 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:18.550 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:18.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:19.448 INFO:teuthology.orchestra.run.smithi012.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:19.497 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/190 2023-07-07T19:20:19.497 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/190 2023-07-07T19:20:19.498 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:19.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:19.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:19.538 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-07-07T19:20:19.758 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:19.762 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:19.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:20.614 INFO:teuthology.orchestra.run.smithi012.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:20.672 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/191 2023-07-07T19:20:20.673 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/191 2023-07-07T19:20:20.673 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:20.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:20.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:20.732 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-07-07T19:20:20.959 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:20.963 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:20.964 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:20.965 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:20.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:21.317 INFO:teuthology.orchestra.run.smithi012.stdout:generic/192 [not run] atime not maintained by ceph 2023-07-07T19:20:21.321 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/192 2023-07-07T19:20:21.321 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/192 2023-07-07T19:20:21.321 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:21.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:21.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:21.345 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-07-07T19:20:21.571 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:21.575 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:21.576 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:21.577 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:21.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:22.434 INFO:teuthology.orchestra.run.smithi012.stdout:generic/193 1s 2023-07-07T19:20:22.438 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/193 2023-07-07T19:20:22.438 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:22.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:22.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:22.675 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-07-07T19:20:23.100 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:23.104 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:23.104 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:23.105 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:23.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:23.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:20:23.523 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:20:23.775 INFO:teuthology.orchestra.run.smithi012.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:23.827 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/194 2023-07-07T19:20:23.828 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/194 2023-07-07T19:20:23.828 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:23.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:23.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:23.961 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-07-07T19:20:24.277 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:24.282 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:24.283 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:24.283 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:24.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:25.115 INFO:teuthology.orchestra.run.smithi012.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:25.237 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/195 2023-07-07T19:20:25.238 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/195 2023-07-07T19:20:25.238 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:25.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:25.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:25.264 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-07-07T19:20:25.491 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:25.496 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:25.497 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:25.497 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:25.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:26.439 INFO:teuthology.orchestra.run.smithi012.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:26.460 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/196 2023-07-07T19:20:26.460 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/196 2023-07-07T19:20:26.461 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:26.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:26.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:26.499 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-07-07T19:20:26.718 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:26.722 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:26.722 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:26.723 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:26.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:27.644 INFO:teuthology.orchestra.run.smithi012.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:27.672 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/197 2023-07-07T19:20:27.673 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/197 2023-07-07T19:20:27.673 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:27.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:27.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:27.706 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-07-07T19:20:27.929 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:27.933 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:27.933 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:27.934 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:27.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:28.677 INFO:teuthology.orchestra.run.smithi012.stdout:generic/198 0s 2023-07-07T19:20:28.682 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/198 2023-07-07T19:20:28.682 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:28.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:29.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:29.015 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-07-07T19:20:29.319 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:29.323 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:29.323 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:29.324 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:29.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:30.153 INFO:teuthology.orchestra.run.smithi012.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:30.196 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/199 2023-07-07T19:20:30.197 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/199 2023-07-07T19:20:30.197 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:30.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:30.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:30.373 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-07-07T19:20:30.598 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:30.602 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:30.602 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:30.603 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:30.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:31.540 INFO:teuthology.orchestra.run.smithi012.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:31.588 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/200 2023-07-07T19:20:31.589 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/200 2023-07-07T19:20:31.589 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:31.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:31.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:31.629 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-07-07T19:20:31.852 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:31.856 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:31.856 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:31.857 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:31.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:32.740 INFO:teuthology.orchestra.run.smithi012.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:32.752 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/201 2023-07-07T19:20:32.753 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/201 2023-07-07T19:20:32.753 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:32.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:32.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:32.912 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-07-07T19:20:33.134 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:33.139 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:33.140 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:33.140 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:33.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:34.049 INFO:teuthology.orchestra.run.smithi012.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:34.119 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/202 2023-07-07T19:20:34.120 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/202 2023-07-07T19:20:34.120 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:34.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:34.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:34.144 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-07-07T19:20:34.372 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:34.376 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:34.377 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:34.378 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:34.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:35.234 INFO:teuthology.orchestra.run.smithi012.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/203 2023-07-07T19:20:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/203 2023-07-07T19:20:35.243 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:35.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:35.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:35.354 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-07-07T19:20:35.584 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:35.589 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:35.589 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:35.590 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:35.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:36.543 INFO:teuthology.orchestra.run.smithi012.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:20:36.548 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/204 2023-07-07T19:20:36.548 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/204 2023-07-07T19:20:36.549 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:36.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:36.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:36.576 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-07-07T19:20:36.808 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:36.812 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:36.813 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:36.814 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:36.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:37.687 INFO:teuthology.orchestra.run.smithi012.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:37.759 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/205 2023-07-07T19:20:37.760 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/205 2023-07-07T19:20:37.760 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:37.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:37.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:37.814 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-07-07T19:20:38.045 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:38.049 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:38.050 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:38.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:38.890 INFO:teuthology.orchestra.run.smithi012.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:20:38.957 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/206 2023-07-07T19:20:38.957 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/206 2023-07-07T19:20:38.958 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:38.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:39.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:39.033 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-07-07T19:20:39.254 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:39.259 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:39.259 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:39.260 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:39.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:48.335 INFO:teuthology.orchestra.run.smithi012.stdout:generic/207 9s 2023-07-07T19:20:48.340 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/207 2023-07-07T19:20:48.340 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:20:48.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:48.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:20:48.681 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-07-07T19:20:48.994 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:20:48.998 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:20:48.998 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:20:49.000 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:20:49.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:20:53.682 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:20:53.684 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:21:23.756 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:21:23.759 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:21:53.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:21:53.991 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:22:24.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:22:24.239 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:22:54.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:22:54.311 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:23:24.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:23:24.858 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:23:54.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:23:54.922 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:24:09.444 INFO:teuthology.orchestra.run.smithi012.stdout:generic/208 200s 2023-07-07T19:24:09.448 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/208 2023-07-07T19:24:09.449 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:09.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:09.819 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-07-07T19:24:10.107 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:10.112 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:10.112 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:10.112 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:10.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:25.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:24:25.093 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:24:50.289 INFO:teuthology.orchestra.run.smithi012.stdout:generic/209 40s 2023-07-07T19:24:50.294 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/209 2023-07-07T19:24:50.295 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:50.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:50.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:50.726 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-07-07T19:24:50.956 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:50.960 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:50.961 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:50.962 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:50.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:51.428 INFO:teuthology.orchestra.run.smithi012.stdout:generic/210 0s 2023-07-07T19:24:51.433 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/210 2023-07-07T19:24:51.433 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:51.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:51.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:51.615 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-07-07T19:24:52.065 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:52.069 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:52.070 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:52.071 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:52.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:52.580 INFO:teuthology.orchestra.run.smithi012.stdout:generic/211 0s 2023-07-07T19:24:52.585 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/211 2023-07-07T19:24:52.585 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:52.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:52.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:52.618 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-07-07T19:24:52.848 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:52.852 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:52.853 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:52.853 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:52.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:53.285 INFO:teuthology.orchestra.run.smithi012.stdout:generic/212 0s 2023-07-07T19:24:53.290 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/212 2023-07-07T19:24:53.290 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:53.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:53.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:53.324 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-07-07T19:24:53.544 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:53.548 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:53.549 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:53.550 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:53.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:53.905 INFO:teuthology.orchestra.run.smithi012.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:24:53.909 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/213 2023-07-07T19:24:53.909 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/213 2023-07-07T19:24:53.909 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:53.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:53.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:53.956 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-07-07T19:24:54.177 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:54.181 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:54.182 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:54.183 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:54.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:54.537 INFO:teuthology.orchestra.run.smithi012.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:24:54.541 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/214 2023-07-07T19:24:54.541 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/214 2023-07-07T19:24:54.541 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:54.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:54.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:54.577 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-07-07T19:24:54.805 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:54.810 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:54.811 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:54.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:55.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:24:55.516 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:24:57.215 INFO:teuthology.orchestra.run.smithi012.stdout:generic/215 2s 2023-07-07T19:24:57.220 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/215 2023-07-07T19:24:57.221 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:57.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:57.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:57.266 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-07-07T19:24:57.498 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:57.502 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:57.502 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:57.503 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:57.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:58.397 INFO:teuthology.orchestra.run.smithi012.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:24:58.421 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/216 2023-07-07T19:24:58.421 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/216 2023-07-07T19:24:58.421 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:58.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:58.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:58.503 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-07-07T19:24:58.728 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:58.732 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:58.733 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:58.734 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:58.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:59.671 INFO:teuthology.orchestra.run.smithi012.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:24:59.698 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/217 2023-07-07T19:24:59.698 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/217 2023-07-07T19:24:59.698 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:24:59.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:24:59.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:24:59.736 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-07-07T19:24:59.967 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:24:59.971 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:24:59.971 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:24:59.972 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:24:59.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:00.803 INFO:teuthology.orchestra.run.smithi012.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:25:00.814 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/218 2023-07-07T19:25:00.814 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/218 2023-07-07T19:25:00.815 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:00.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:00.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:00.952 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-07-07T19:25:01.185 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:01.189 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:01.189 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:01.190 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:01.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:01.536 INFO:teuthology.orchestra.run.smithi012.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:25:01.540 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/219 2023-07-07T19:25:01.540 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/219 2023-07-07T19:25:01.540 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:01.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:01.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:01.562 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-07-07T19:25:01.794 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:01.798 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:01.799 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:01.800 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:01.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:02.646 INFO:teuthology.orchestra.run.smithi012.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:25:02.664 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/220 2023-07-07T19:25:02.665 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/220 2023-07-07T19:25:02.665 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:02.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:02.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:02.809 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-07-07T19:25:03.038 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:03.043 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:03.043 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:03.044 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:03.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:04.418 INFO:teuthology.orchestra.run.smithi012.stdout:generic/221 1s 2023-07-07T19:25:04.424 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/221 2023-07-07T19:25:04.424 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:04.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:04.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:04.463 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-07-07T19:25:04.704 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:04.708 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:04.708 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:04.709 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:04.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:05.575 INFO:teuthology.orchestra.run.smithi012.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:25:05.662 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/222 2023-07-07T19:25:05.663 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/222 2023-07-07T19:25:05.663 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:05.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:05.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:05.694 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-07-07T19:25:05.918 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:05.922 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:05.922 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:05.923 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:05.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:06.287 INFO:teuthology.orchestra.run.smithi012.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:25:06.291 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/223 2023-07-07T19:25:06.291 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/223 2023-07-07T19:25:06.292 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:06.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:06.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:06.315 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-07-07T19:25:06.536 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:06.540 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:06.540 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:06.541 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:06.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:06.888 INFO:teuthology.orchestra.run.smithi012.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:25:06.892 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/224 2023-07-07T19:25:06.893 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/224 2023-07-07T19:25:06.893 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:06.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:06.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:06.924 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-07-07T19:25:07.146 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:07.150 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:07.151 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:07.151 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:07.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:07.546 INFO:teuthology.orchestra.run.smithi012.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-07T19:25:07.550 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/225 2023-07-07T19:25:07.551 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/225 2023-07-07T19:25:07.551 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:07.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:07.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:07.962 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-07-07T19:25:08.201 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:08.205 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:08.206 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:08.207 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:08.590 INFO:teuthology.orchestra.run.smithi012.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:25:08.594 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/226 2023-07-07T19:25:08.594 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/226 2023-07-07T19:25:08.595 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:08.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:08.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:08.623 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-07-07T19:25:08.849 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:08.853 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:08.853 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:08.854 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:08.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:09.657 INFO:teuthology.orchestra.run.smithi012.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:25:09.777 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/227 2023-07-07T19:25:09.777 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/227 2023-07-07T19:25:09.777 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:09.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:09.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:09.873 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-07-07T19:25:10.098 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:10.102 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:10.102 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:10.103 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:10.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:10.471 INFO:teuthology.orchestra.run.smithi012.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:25:10.475 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/228 2023-07-07T19:25:10.475 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/228 2023-07-07T19:25:10.475 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:10.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:10.510 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-07-07T19:25:10.743 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:10.747 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:10.747 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:10.748 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:11.390 INFO:teuthology.orchestra.run.smithi012.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:25:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/229 2023-07-07T19:25:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/229 2023-07-07T19:25:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:11.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:11.732 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-07-07T19:25:11.954 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:11.959 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:11.960 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:12.296 INFO:teuthology.orchestra.run.smithi012.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:25:12.300 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/230 2023-07-07T19:25:12.300 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/230 2023-07-07T19:25:12.300 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:12.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:12.326 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-07-07T19:25:12.553 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:12.558 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:12.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:12.908 INFO:teuthology.orchestra.run.smithi012.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:25:12.912 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/231 2023-07-07T19:25:12.912 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/231 2023-07-07T19:25:12.912 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:12.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:12.940 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-07-07T19:25:13.159 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:13.163 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:13.165 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:13.496 INFO:teuthology.orchestra.run.smithi012.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:25:13.499 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/232 2023-07-07T19:25:13.500 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/232 2023-07-07T19:25:13.500 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:13.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:13.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:13.529 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-07-07T19:25:13.754 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:13.758 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:13.759 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:13.760 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:13.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:14.099 INFO:teuthology.orchestra.run.smithi012.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:25:14.103 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/233 2023-07-07T19:25:14.103 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/233 2023-07-07T19:25:14.103 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:14.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:14.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:14.134 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-07-07T19:25:14.358 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:14.362 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:14.362 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:14.364 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:14.704 INFO:teuthology.orchestra.run.smithi012.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:25:14.708 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/234 2023-07-07T19:25:14.708 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/234 2023-07-07T19:25:14.709 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:14.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:14.741 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-07-07T19:25:14.960 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:14.964 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:14.965 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:14.965 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:15.306 INFO:teuthology.orchestra.run.smithi012.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:25:15.309 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/235 2023-07-07T19:25:15.310 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/235 2023-07-07T19:25:15.310 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:15.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:15.342 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-07-07T19:25:15.569 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:15.574 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:15.574 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:15.575 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:16.986 INFO:teuthology.orchestra.run.smithi012.stdout:generic/236 1s 2023-07-07T19:25:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/236 2023-07-07T19:25:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:17.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:17.423 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-07-07T19:25:17.654 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:17.659 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:17.659 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:17.660 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:18.097 INFO:teuthology.orchestra.run.smithi012.stdout:generic/237 1s 2023-07-07T19:25:18.102 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/237 2023-07-07T19:25:18.102 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:18.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:18.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:18.363 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-07-07T19:25:18.758 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:18.763 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:18.763 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:18.764 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:18.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:19.704 INFO:teuthology.orchestra.run.smithi012.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:25:19.747 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/238 2023-07-07T19:25:19.747 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/238 2023-07-07T19:25:19.747 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:25:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:19.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:25:19.777 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-07-07T19:25:20.002 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:25:20.006 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:25:20.007 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:25:20.008 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:25:20.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:25:25.584 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:25:25.619 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:25:55.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:25:55.729 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:26:25.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:26:25.846 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:26:26.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T19:26:26.055+0000 7f18a8cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 347732) UID: 0 2023-07-07T19:26:26.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T19:26:26.055+0000 7fb626ecc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 347732) UID: 0 2023-07-07T19:26:26.067 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T19:26:26.055+0000 7f5317f46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 347732) UID: 0 2023-07-07T19:26:26.067 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T19:26:26.055+0000 7efe5fde0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 347732) UID: 0 2023-07-07T19:27:28.309 INFO:teuthology.orchestra.run.smithi012.stdout:generic/239 128s 2023-07-07T19:27:28.326 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/239 2023-07-07T19:27:28.326 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:27:28.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:27:28.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:27:28.684 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-07-07T19:27:29.017 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:27:29.021 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:27:29.022 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:27:29.022 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:27:29.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:27:30.022 INFO:teuthology.orchestra.run.smithi012.stdout:generic/240 0s 2023-07-07T19:27:30.075 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/240 2023-07-07T19:27:30.075 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:27:30.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:27:30.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:27:30.324 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-07-07T19:27:30.794 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:27:30.799 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:27:30.799 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:27:30.800 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:27:30.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:44.141 INFO:teuthology.orchestra.run.smithi012.stdout:generic/241 73s 2023-07-07T19:28:44.146 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/241 2023-07-07T19:28:44.146 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:28:44.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:45.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:28:45.598 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-07-07T19:28:46.580 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:28:46.584 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:28:46.584 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:28:46.585 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:28:46.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:48.126 INFO:teuthology.orchestra.run.smithi012.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:28:48.210 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/242 2023-07-07T19:28:48.211 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/242 2023-07-07T19:28:48.211 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:28:48.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:48.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:28:48.412 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-07-07T19:28:48.633 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:28:48.637 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:28:48.638 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:28:48.638 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:28:48.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:49.953 INFO:teuthology.orchestra.run.smithi012.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:28:50.152 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/243 2023-07-07T19:28:50.152 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/243 2023-07-07T19:28:50.152 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:28:50.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:50.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:28:50.225 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-07-07T19:28:50.469 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:28:50.473 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:28:50.473 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:28:50.474 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:28:50.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:51.013 INFO:teuthology.orchestra.run.smithi012.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:28:51.016 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/244 2023-07-07T19:28:51.017 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/244 2023-07-07T19:28:51.017 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:28:51.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:51.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:28:51.039 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-07-07T19:28:51.264 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:28:51.268 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:28:51.269 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:28:51.270 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:28:51.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:51.754 INFO:teuthology.orchestra.run.smithi012.stdout:generic/245 0s 2023-07-07T19:28:51.787 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/245 2023-07-07T19:28:51.787 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:28:51.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:52.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:28:52.232 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-07-07T19:28:52.469 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:28:52.473 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:28:52.473 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:28:52.474 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:28:52.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:53.154 INFO:teuthology.orchestra.run.smithi012.stdout:generic/246 1s 2023-07-07T19:28:53.189 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/246 2023-07-07T19:28:53.189 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:28:53.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:28:53.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:28:53.458 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-07-07T19:28:53.956 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:28:53.959 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:28:53.960 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:28:53.961 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:28:53.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:03.499 INFO:teuthology.orchestra.run.smithi012.stdout:generic/247 9s 2023-07-07T19:29:03.520 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/247 2023-07-07T19:29:03.520 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:03.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:03.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:03.531 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-07-07T19:29:03.867 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:03.871 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:03.872 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:03.873 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:03.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:04.276 INFO:teuthology.orchestra.run.smithi012.stdout:generic/248 0s 2023-07-07T19:29:04.281 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/248 2023-07-07T19:29:04.281 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:04.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:04.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:04.315 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-07-07T19:29:04.558 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:04.562 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:04.563 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:04.564 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:04.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:05.147 INFO:teuthology.orchestra.run.smithi012.stdout:generic/249 1s 2023-07-07T19:29:05.152 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/249 2023-07-07T19:29:05.152 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:05.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:05.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:05.595 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-07-07T19:29:05.889 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:05.893 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:05.893 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:05.894 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:05.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:06.275 INFO:teuthology.orchestra.run.smithi012.stdout:generic/250 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:29:06.279 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/250 2023-07-07T19:29:06.279 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/250 2023-07-07T19:29:06.279 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:06.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:06.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:06.302 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-07-07T19:29:06.542 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:06.546 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:06.547 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:06.548 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:06.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:07.061 INFO:teuthology.orchestra.run.smithi012.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:07.083 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/251 2023-07-07T19:29:07.083 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/251 2023-07-07T19:29:07.083 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:07.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:07.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:07.105 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-07-07T19:29:07.331 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:07.336 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:07.336 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:07.337 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:07.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:07.713 INFO:teuthology.orchestra.run.smithi012.stdout:generic/252 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:29:07.717 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/252 2023-07-07T19:29:07.717 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/252 2023-07-07T19:29:07.717 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:07.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:07.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:07.741 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-07-07T19:29:07.972 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:07.977 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:07.977 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:07.978 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:07.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:08.733 INFO:teuthology.orchestra.run.smithi012.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:29:08.829 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/253 2023-07-07T19:29:08.829 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/253 2023-07-07T19:29:08.830 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:08.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:08.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:08.950 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-07-07T19:29:09.206 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:09.210 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:09.210 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:09.211 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:09.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:10.057 INFO:teuthology.orchestra.run.smithi012.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:29:10.071 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/254 2023-07-07T19:29:10.071 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/254 2023-07-07T19:29:10.072 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:10.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:10.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:10.201 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-07-07T19:29:10.445 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:10.449 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:10.451 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:10.907 INFO:teuthology.orchestra.run.smithi012.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:29:10.911 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/255 2023-07-07T19:29:10.911 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/255 2023-07-07T19:29:10.912 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:11.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:11.299 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-07-07T19:29:11.609 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:11.613 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:11.613 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:11.614 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:29:12.295 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/256 2023-07-07T19:29:12.295 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/256 2023-07-07T19:29:12.295 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:12.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:12.328 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-07-07T19:29:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:12.561 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:12.562 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:12.563 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:13.453 INFO:teuthology.orchestra.run.smithi012.stdout:generic/257 1s 2023-07-07T19:29:13.458 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/257 2023-07-07T19:29:13.458 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:14.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:14.034 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-07-07T19:29:14.408 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:14.412 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:14.412 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:14.413 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:14.742 INFO:teuthology.orchestra.run.smithi012.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-07-07T19:29:14.746 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/258 2023-07-07T19:29:14.746 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/258 2023-07-07T19:29:14.746 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:14.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:14.769 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-07-07T19:29:14.996 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:15.000 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:15.001 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:15.002 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:15.874 INFO:teuthology.orchestra.run.smithi012.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:29:15.930 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/259 2023-07-07T19:29:15.930 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/259 2023-07-07T19:29:15.930 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:15.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:15.976 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-07-07T19:29:16.216 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:16.220 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:16.221 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:16.221 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:16.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:16.732 INFO:teuthology.orchestra.run.smithi012.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:16.753 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/260 2023-07-07T19:29:16.753 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/260 2023-07-07T19:29:16.753 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:16.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:16.778 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-07-07T19:29:17.014 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:17.018 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:17.019 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:17.020 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:17.753 INFO:teuthology.orchestra.run.smithi012.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:29:17.761 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/261 2023-07-07T19:29:17.762 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/261 2023-07-07T19:29:17.762 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:17.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:17.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:17.985 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-07-07T19:29:18.220 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:18.224 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:18.225 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:18.226 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:19.161 INFO:teuthology.orchestra.run.smithi012.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:29:19.206 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/262 2023-07-07T19:29:19.207 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/262 2023-07-07T19:29:19.207 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:19.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:19.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:19.236 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-07-07T19:29:19.465 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:19.469 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:19.470 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:19.471 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:58.742 INFO:teuthology.orchestra.run.smithi012.stdout:generic/263 39s 2023-07-07T19:29:58.747 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/263 2023-07-07T19:29:58.747 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:29:58.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:29:58.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:29:58.872 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-07-07T19:29:59.416 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:29:59.420 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:29:59.421 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:29:59.422 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:29:59.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:00.229 INFO:teuthology.orchestra.run.smithi012.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:00.236 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/264 2023-07-07T19:30:00.237 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/264 2023-07-07T19:30:00.237 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:00.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:00.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:00.411 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-07-07T19:30:00.645 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:00.649 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:00.649 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:00.650 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:00.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:01.590 INFO:teuthology.orchestra.run.smithi012.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:01.612 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/265 2023-07-07T19:30:01.613 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/265 2023-07-07T19:30:01.613 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:01.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:01.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:01.645 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-07-07T19:30:01.877 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:01.881 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:01.882 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:01.883 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:01.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:02.852 INFO:teuthology.orchestra.run.smithi012.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:02.868 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/266 2023-07-07T19:30:02.868 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/266 2023-07-07T19:30:02.868 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:02.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:02.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:02.904 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-07-07T19:30:03.140 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:03.144 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:03.145 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:03.146 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:03.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:04.072 INFO:teuthology.orchestra.run.smithi012.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:04.081 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/267 2023-07-07T19:30:04.082 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/267 2023-07-07T19:30:04.082 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:04.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:04.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:04.141 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-07-07T19:30:04.370 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:04.375 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:04.375 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:04.376 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:04.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:04.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:30:04.418 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:30:04.483 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T19:30:04.482+0000 7f23f6e45700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 363945) UID: 0 2023-07-07T19:30:04.483 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T19:30:04.482+0000 7ff6efcfe700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 363945) UID: 0 2023-07-07T19:30:05.294 INFO:teuthology.orchestra.run.smithi012.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:05.385 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/268 2023-07-07T19:30:05.385 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/268 2023-07-07T19:30:05.386 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:05.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:05.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:05.434 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-07-07T19:30:05.662 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:05.666 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:05.667 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:05.667 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:05.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:06.047 INFO:teuthology.orchestra.run.smithi012.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:30:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/269 2023-07-07T19:30:06.051 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/269 2023-07-07T19:30:06.052 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:06.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:06.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:06.087 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-07-07T19:30:06.312 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:06.316 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:06.316 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:06.317 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:06.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:06.665 INFO:teuthology.orchestra.run.smithi012.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:30:06.669 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/270 2023-07-07T19:30:06.669 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/270 2023-07-07T19:30:06.669 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:06.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:06.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:06.697 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-07-07T19:30:06.932 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:06.936 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:06.937 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:06.938 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:06.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:08.070 INFO:teuthology.orchestra.run.smithi012.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:08.076 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/271 2023-07-07T19:30:08.076 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/271 2023-07-07T19:30:08.076 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:08.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:08.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:08.104 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-07-07T19:30:08.342 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:08.346 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:08.346 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:08.347 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:09.368 INFO:teuthology.orchestra.run.smithi012.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:09.399 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/272 2023-07-07T19:30:09.400 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/272 2023-07-07T19:30:09.400 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:09.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:09.435 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-07-07T19:30:09.683 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:09.687 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:09.687 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:09.688 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:09.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:10.071 INFO:teuthology.orchestra.run.smithi012.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:30:10.075 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/273 2023-07-07T19:30:10.075 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/273 2023-07-07T19:30:10.075 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:10.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:10.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:10.107 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-07-07T19:30:10.332 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:10.336 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:10.336 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:10.337 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:10.713 INFO:teuthology.orchestra.run.smithi012.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-07T19:30:10.717 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/274 2023-07-07T19:30:10.717 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/274 2023-07-07T19:30:10.717 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:10.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:10.748 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-07-07T19:30:10.974 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:10.978 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:10.979 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:10.980 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:11.334 INFO:teuthology.orchestra.run.smithi012.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:30:11.338 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/275 2023-07-07T19:30:11.338 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/275 2023-07-07T19:30:11.338 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:11.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:11.361 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-07-07T19:30:11.590 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:11.594 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:11.594 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:11.595 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:11.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:12.583 INFO:teuthology.orchestra.run.smithi012.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:12.594 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/276 2023-07-07T19:30:12.594 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/276 2023-07-07T19:30:12.594 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:12.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:12.628 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-07-07T19:30:12.854 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:12.858 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:12.858 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:12.859 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:13.272 INFO:teuthology.orchestra.run.smithi012.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-07-07T19:30:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/277 2023-07-07T19:30:13.276 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/277 2023-07-07T19:30:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:13.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:13.319 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-07-07T19:30:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:13.547 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:13.548 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:13.549 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:14.489 INFO:teuthology.orchestra.run.smithi012.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/278 2023-07-07T19:30:14.549 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/278 2023-07-07T19:30:14.549 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:14.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:14.596 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-07-07T19:30:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:14.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:15.834 INFO:teuthology.orchestra.run.smithi012.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:15.854 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/279 2023-07-07T19:30:15.854 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/279 2023-07-07T19:30:15.855 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:15.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:15.892 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-07-07T19:30:16.117 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:16.121 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:16.122 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:16.123 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:16.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:16.524 INFO:teuthology.orchestra.run.smithi012.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:30:16.528 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/280 2023-07-07T19:30:16.528 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/280 2023-07-07T19:30:16.528 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:16.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:16.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:16.553 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-07-07T19:30:16.794 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:16.798 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:16.798 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:16.799 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:16.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:17.783 INFO:teuthology.orchestra.run.smithi012.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/281 2023-07-07T19:30:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/281 2023-07-07T19:30:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:17.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:17.840 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-07-07T19:30:18.095 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:18.099 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:18.100 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:18.101 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:18.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:18.947 INFO:teuthology.orchestra.run.smithi012.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:18.955 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/282 2023-07-07T19:30:18.955 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/282 2023-07-07T19:30:18.955 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:19.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:19.134 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-07-07T19:30:19.366 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:19.370 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:19.371 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:19.371 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:19.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:20.408 INFO:teuthology.orchestra.run.smithi012.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:20.436 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/283 2023-07-07T19:30:20.436 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/283 2023-07-07T19:30:20.436 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:20.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:20.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:20.463 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-07-07T19:30:20.697 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:20.701 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:20.702 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:20.703 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:20.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:21.559 INFO:teuthology.orchestra.run.smithi012.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:21.566 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/284 2023-07-07T19:30:21.566 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/284 2023-07-07T19:30:21.566 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:21.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:21.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:21.738 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-07-07T19:30:21.978 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:21.982 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:21.983 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:21.984 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:21.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:23.341 INFO:teuthology.orchestra.run.smithi012.stdout:generic/285 1s 2023-07-07T19:30:23.347 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/285 2023-07-07T19:30:23.347 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:23.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:23.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:23.867 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-07-07T19:30:24.584 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:24.590 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:24.591 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:24.594 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:24.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:25.233 INFO:teuthology.orchestra.run.smithi012.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:30:25.243 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/286 2023-07-07T19:30:25.243 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/286 2023-07-07T19:30:25.243 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:25.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:25.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:25.298 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-07-07T19:30:25.795 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:25.811 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:25.812 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:25.817 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:25.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:27.138 INFO:teuthology.orchestra.run.smithi012.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:27.148 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/287 2023-07-07T19:30:27.148 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/287 2023-07-07T19:30:27.148 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:27.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:27.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:27.281 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-07-07T19:30:27.739 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:27.749 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:27.750 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:27.760 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:27.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:28.717 INFO:teuthology.orchestra.run.smithi012.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:28.756 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/288 2023-07-07T19:30:28.757 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/288 2023-07-07T19:30:28.757 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:28.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:28.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:28.795 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-07-07T19:30:29.367 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:29.374 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:29.374 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:29.376 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:30.489 INFO:teuthology.orchestra.run.smithi012.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:30.503 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/289 2023-07-07T19:30:30.503 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/289 2023-07-07T19:30:30.504 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:30.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:30.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:30.695 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-07-07T19:30:30.924 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:30.929 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:30.929 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:30.930 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:30.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:31.886 INFO:teuthology.orchestra.run.smithi012.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:31.893 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/290 2023-07-07T19:30:31.893 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/290 2023-07-07T19:30:31.893 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:31.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:31.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:31.955 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-07-07T19:30:32.203 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:32.207 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:32.208 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:32.208 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:32.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:33.184 INFO:teuthology.orchestra.run.smithi012.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:33.213 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/291 2023-07-07T19:30:33.213 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/291 2023-07-07T19:30:33.214 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:33.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:33.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:33.247 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-07-07T19:30:33.470 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:33.474 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:33.475 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:33.476 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:33.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:34.450 INFO:teuthology.orchestra.run.smithi012.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:34.495 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/292 2023-07-07T19:30:34.495 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/292 2023-07-07T19:30:34.495 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:34.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:34.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:34.541 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-07-07T19:30:34.779 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:34.783 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:34.784 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:34.785 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:34.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:35.938 INFO:teuthology.orchestra.run.smithi012.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:35.975 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/293 2023-07-07T19:30:35.975 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/293 2023-07-07T19:30:35.975 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:35.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:36.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:36.012 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-07-07T19:30:36.235 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:36.239 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:36.239 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:36.240 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:36.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:37.661 INFO:teuthology.orchestra.run.smithi012.stdout:generic/294 1s 2023-07-07T19:30:37.691 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/294 2023-07-07T19:30:37.691 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:37.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:37.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:37.702 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-07-07T19:30:37.969 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:37.973 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:37.973 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:37.974 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:37.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:38.946 INFO:teuthology.orchestra.run.smithi012.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:39.010 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/295 2023-07-07T19:30:39.011 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/295 2023-07-07T19:30:39.011 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:39.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:39.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:39.055 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-07-07T19:30:39.287 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:39.291 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:39.292 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:39.293 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:39.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:40.035 INFO:teuthology.orchestra.run.smithi012.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:40.054 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/296 2023-07-07T19:30:40.054 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/296 2023-07-07T19:30:40.054 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:40.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:40.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:40.322 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-07-07T19:30:40.545 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:40.549 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:40.550 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:40.551 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:40.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:41.415 INFO:teuthology.orchestra.run.smithi012.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:41.421 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/297 2023-07-07T19:30:41.421 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/297 2023-07-07T19:30:41.422 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:41.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:41.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:41.533 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-07-07T19:30:41.792 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:41.796 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:41.796 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:41.797 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:41.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:42.746 INFO:teuthology.orchestra.run.smithi012.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:42.812 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/298 2023-07-07T19:30:42.813 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/298 2023-07-07T19:30:42.813 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:42.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:42.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:42.877 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-07-07T19:30:43.110 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:43.114 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:43.114 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:43.115 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:43.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:43.571 INFO:teuthology.orchestra.run.smithi012.stdout:generic/299 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:30:43.575 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/299 2023-07-07T19:30:43.575 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/299 2023-07-07T19:30:43.576 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:43.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:43.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:43.608 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-07-07T19:30:43.841 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:43.845 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:43.846 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:43.847 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:43.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:44.281 INFO:teuthology.orchestra.run.smithi012.stdout:generic/300 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:30:44.285 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/300 2023-07-07T19:30:44.285 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/300 2023-07-07T19:30:44.285 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:44.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:44.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:44.316 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-07-07T19:30:44.544 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:44.548 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:44.548 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:44.549 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:44.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:45.530 INFO:teuthology.orchestra.run.smithi012.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:45.540 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/301 2023-07-07T19:30:45.541 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/301 2023-07-07T19:30:45.541 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:45.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:45.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:45.593 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-07-07T19:30:45.833 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:45.837 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:45.837 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:45.838 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:45.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:46.476 INFO:teuthology.orchestra.run.smithi012.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:46.701 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/302 2023-07-07T19:30:46.701 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/302 2023-07-07T19:30:46.702 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:46.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:46.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:46.823 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-07-07T19:30:47.060 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:47.064 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:47.065 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:47.066 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:47.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:47.447 INFO:teuthology.orchestra.run.smithi012.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:30:47.451 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/303 2023-07-07T19:30:47.451 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/303 2023-07-07T19:30:47.451 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:47.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:47.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:47.896 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-07-07T19:30:48.156 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:48.160 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:48.161 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:48.162 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:48.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:48.529 INFO:teuthology.orchestra.run.smithi012.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-07T19:30:48.532 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/304 2023-07-07T19:30:48.532 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/304 2023-07-07T19:30:48.532 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:48.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:48.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:48.913 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-07-07T19:30:49.199 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:49.204 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:49.204 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:49.205 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:49.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:50.121 INFO:teuthology.orchestra.run.smithi012.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:30:50.146 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/305 2023-07-07T19:30:50.146 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/305 2023-07-07T19:30:50.146 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:50.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:50.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:50.207 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-07-07T19:30:50.439 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:50.443 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:50.443 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:50.444 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:50.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:51.537 INFO:teuthology.orchestra.run.smithi012.stdout:generic/306 1s 2023-07-07T19:30:51.546 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/306 2023-07-07T19:30:51.546 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:51.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:51.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:51.899 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-07-07T19:30:52.236 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:52.241 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:52.241 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:52.242 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:52.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:54.058 INFO:teuthology.orchestra.run.smithi012.stdout:generic/307 2s 2023-07-07T19:30:54.063 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/307 2023-07-07T19:30:54.063 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:54.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:54.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:54.074 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-07-07T19:30:54.301 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:54.305 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:54.306 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:54.307 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:54.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:54.722 INFO:teuthology.orchestra.run.smithi012.stdout:generic/308 0s 2023-07-07T19:30:54.727 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/308 2023-07-07T19:30:54.727 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:54.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:54.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:54.752 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-07-07T19:30:54.977 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:54.981 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:54.982 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:54.983 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:54.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:56.385 INFO:teuthology.orchestra.run.smithi012.stdout:generic/309 1s 2023-07-07T19:30:56.391 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/309 2023-07-07T19:30:56.391 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:30:56.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:30:56.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:30:56.758 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-07-07T19:30:57.046 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:30:57.051 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:30:57.051 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:30:57.052 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:30:57.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:14.155 INFO:teuthology.orchestra.run.smithi012.stdout:generic/310 77s 2023-07-07T19:32:14.230 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/310 2023-07-07T19:32:14.230 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:14.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:14.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:14.742 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-07-07T19:32:15.054 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:15.058 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:15.059 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:15.059 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:15.675 INFO:teuthology.orchestra.run.smithi012.stdout:generic/311 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:32:15.679 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/311 2023-07-07T19:32:15.679 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/311 2023-07-07T19:32:15.680 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:15.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:15.714 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-07-07T19:32:15.941 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:15.945 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:15.945 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:15.946 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:16.321 INFO:teuthology.orchestra.run.smithi012.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:32:16.325 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/312 2023-07-07T19:32:16.325 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/312 2023-07-07T19:32:16.325 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:16.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:16.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:16.357 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-07-07T19:32:16.588 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:16.592 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:16.592 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:16.593 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:16.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:21.006 INFO:teuthology.orchestra.run.smithi012.stdout:generic/313 4s 2023-07-07T19:32:21.050 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/313 2023-07-07T19:32:21.050 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:21.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:21.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:21.090 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-07-07T19:32:21.315 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:21.320 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:21.320 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:21.321 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:21.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:24.555 INFO:teuthology.orchestra.run.smithi012.stdout:generic/314 3s 2023-07-07T19:32:24.560 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/314 2023-07-07T19:32:24.560 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:24.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:24.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:24.597 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-07-07T19:32:24.822 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:24.827 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:24.827 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:24.828 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:24.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:25.195 INFO:teuthology.orchestra.run.smithi012.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-07T19:32:25.198 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/315 2023-07-07T19:32:25.199 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/315 2023-07-07T19:32:25.199 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:25.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:25.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:25.225 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-07-07T19:32:25.456 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:25.460 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:25.460 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:25.461 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:25.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:25.974 INFO:teuthology.orchestra.run.smithi012.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-07T19:32:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/316 2023-07-07T19:32:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/316 2023-07-07T19:32:25.978 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:25.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:26.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:26.407 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-07-07T19:32:26.661 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:26.665 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:26.665 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:26.666 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:26.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:27.745 INFO:teuthology.orchestra.run.smithi012.stdout:generic/317 1s 2023-07-07T19:32:27.750 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/317 2023-07-07T19:32:27.750 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:27.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:27.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:27.761 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-07-07T19:32:27.989 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:27.993 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:27.994 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:27.995 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:27.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:28.922 INFO:teuthology.orchestra.run.smithi012.stdout:generic/318 0s 2023-07-07T19:32:28.927 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/318 2023-07-07T19:32:28.927 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:28.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:28.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:28.938 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-07-07T19:32:29.160 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:29.164 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:29.164 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:29.165 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:29.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:29.791 INFO:teuthology.orchestra.run.smithi012.stdout:generic/319 0s 2023-07-07T19:32:29.796 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/319 2023-07-07T19:32:29.796 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:29.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:29.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:29.808 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-07-07T19:32:30.035 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:30.039 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:30.039 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:30.040 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:30.040 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:30.397 INFO:teuthology.orchestra.run.smithi012.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:32:30.401 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/320 2023-07-07T19:32:30.401 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/320 2023-07-07T19:32:30.401 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:30.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:30.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:30.425 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-07-07T19:32:30.648 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:30.652 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:30.653 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:30.653 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:30.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:31.036 INFO:teuthology.orchestra.run.smithi012.stdout:generic/321 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:32:31.040 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/321 2023-07-07T19:32:31.041 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/321 2023-07-07T19:32:31.041 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:31.043 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:31.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:31.070 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-07-07T19:32:31.312 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:31.316 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:31.316 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:31.317 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:31.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:31.678 INFO:teuthology.orchestra.run.smithi012.stdout:generic/322 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:32:31.682 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/322 2023-07-07T19:32:31.682 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/322 2023-07-07T19:32:31.682 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:32:31.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:32:31.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:32:31.704 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-07-07T19:32:31.932 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:32:31.936 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:32:31.936 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:32:31.937 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:32:31.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:33:44.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:33:44.850 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:33:44.910 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T19:33:44.909+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115920) UID: 0 2023-07-07T19:33:44.911 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T19:33:44.909+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115920) UID: 0 2023-07-07T19:33:44.911 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T19:33:44.909+0000 7f93a9f18700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115920) UID: 0 2023-07-07T19:33:44.912 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T19:33:44.909+0000 7fa834dc8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115920) UID: 0 2023-07-07T19:34:33.635 INFO:teuthology.orchestra.run.smithi012.stdout:generic/323 121s 2023-07-07T19:34:33.641 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/323 2023-07-07T19:34:33.641 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:33.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:34.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:34.013 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-07-07T19:34:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:34.291 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:34.292 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:34.293 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:34.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:34.657 INFO:teuthology.orchestra.run.smithi012.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-07-07T19:34:34.661 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/324 2023-07-07T19:34:34.662 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/324 2023-07-07T19:34:34.662 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:34.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:34.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:34.685 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-07-07T19:34:34.906 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:34.910 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:34.910 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:34.911 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:34.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:35.300 INFO:teuthology.orchestra.run.smithi012.stdout:generic/325 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:34:35.304 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/325 2023-07-07T19:34:35.304 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/325 2023-07-07T19:34:35.305 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:35.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:35.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:35.334 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-07-07T19:34:35.570 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:35.574 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:35.574 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:35.575 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:35.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:36.551 INFO:teuthology.orchestra.run.smithi012.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:34:36.557 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/326 2023-07-07T19:34:36.557 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/326 2023-07-07T19:34:36.558 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:36.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:36.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:36.586 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-07-07T19:34:36.817 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:36.822 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:36.822 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:36.823 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:36.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:37.677 INFO:teuthology.orchestra.run.smithi012.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:34:37.705 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/327 2023-07-07T19:34:37.705 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/327 2023-07-07T19:34:37.705 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:37.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:37.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:37.806 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-07-07T19:34:38.042 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:38.046 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:38.047 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:38.048 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:38.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:38.910 INFO:teuthology.orchestra.run.smithi012.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:34:39.017 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/328 2023-07-07T19:34:39.017 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/328 2023-07-07T19:34:39.018 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:39.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:39.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:39.055 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-07-07T19:34:39.283 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:39.287 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:39.288 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:39.288 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:39.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:40.152 INFO:teuthology.orchestra.run.smithi012.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:34:40.166 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/329 2023-07-07T19:34:40.167 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/329 2023-07-07T19:34:40.167 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:40.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:40.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:40.352 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-07-07T19:34:40.591 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:40.595 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:40.596 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:40.597 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:40.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:34:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/330 2023-07-07T19:34:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/330 2023-07-07T19:34:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:41.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:41.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:41.621 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-07-07T19:34:41.855 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:41.860 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:41.860 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:41.861 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:41.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:42.879 INFO:teuthology.orchestra.run.smithi012.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:34:42.901 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/331 2023-07-07T19:34:42.901 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/331 2023-07-07T19:34:42.902 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:42.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:42.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:42.941 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-07-07T19:34:43.179 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:43.183 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:43.183 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:43.184 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:43.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:44.053 INFO:teuthology.orchestra.run.smithi012.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:34:44.159 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/332 2023-07-07T19:34:44.159 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/332 2023-07-07T19:34:44.159 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:44.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:44.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:44.200 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-07-07T19:34:44.427 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:44.431 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:44.432 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:44.433 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:44.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:45.247 INFO:teuthology.orchestra.run.smithi012.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:34:45.352 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/333 2023-07-07T19:34:45.353 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/333 2023-07-07T19:34:45.353 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:45.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:45.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:45.440 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-07-07T19:34:45.664 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:45.668 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:45.668 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:45.669 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:45.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:46.355 INFO:teuthology.orchestra.run.smithi012.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:34:46.543 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/334 2023-07-07T19:34:46.544 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/334 2023-07-07T19:34:46.544 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:46.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:46.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:46.665 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-07-07T19:34:46.892 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:46.896 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:46.897 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:46.897 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:46.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:47.269 INFO:teuthology.orchestra.run.smithi012.stdout:generic/335 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:34:47.273 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/335 2023-07-07T19:34:47.273 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/335 2023-07-07T19:34:47.273 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:47.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:47.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:47.299 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-07-07T19:34:47.535 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:47.540 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:47.540 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:47.541 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:47.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:47.909 INFO:teuthology.orchestra.run.smithi012.stdout:generic/336 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:34:47.913 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/336 2023-07-07T19:34:47.913 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/336 2023-07-07T19:34:47.913 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:47.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:47.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:47.940 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-07-07T19:34:48.161 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:48.166 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:48.166 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:48.167 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:48.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:48.789 INFO:teuthology.orchestra.run.smithi012.stdout:generic/337 0s 2023-07-07T19:34:48.794 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/337 2023-07-07T19:34:48.794 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:48.796 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:48.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:48.805 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-07-07T19:34:49.031 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:49.036 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:49.036 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:49.037 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:49.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:49.396 INFO:teuthology.orchestra.run.smithi012.stdout:generic/338 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:34:49.400 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/338 2023-07-07T19:34:49.401 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/338 2023-07-07T19:34:49.401 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:34:49.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:34:49.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:34:49.431 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-07-07T19:34:49.656 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:34:49.661 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:34:49.661 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:34:49.662 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:34:49.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:44.276 INFO:teuthology.orchestra.run.smithi012.stdout:generic/339 55s 2023-07-07T19:35:44.281 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/339 2023-07-07T19:35:44.281 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:35:44.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:44.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:35:44.293 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-07-07T19:35:44.530 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:35:44.534 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:35:44.534 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:35:44.535 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:35:44.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:47.824 INFO:teuthology.orchestra.run.smithi012.stdout:generic/340 3s 2023-07-07T19:35:47.875 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/340 2023-07-07T19:35:47.875 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:35:47.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:47.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:35:47.905 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-07-07T19:35:48.335 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:35:48.352 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:35:48.354 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:35:48.357 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:35:48.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:48.728 INFO:teuthology.orchestra.run.smithi012.stdout:generic/341 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:35:48.733 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/341 2023-07-07T19:35:48.733 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/341 2023-07-07T19:35:48.733 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:35:48.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:48.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:35:48.764 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-07-07T19:35:48.988 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:35:48.993 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:35:48.993 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:35:48.994 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:35:48.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:49.354 INFO:teuthology.orchestra.run.smithi012.stdout:generic/342 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:35:49.358 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/342 2023-07-07T19:35:49.358 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/342 2023-07-07T19:35:49.358 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:35:49.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:49.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:35:49.388 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-07-07T19:35:49.617 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:35:49.621 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:35:49.622 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:35:49.623 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:35:49.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:49.997 INFO:teuthology.orchestra.run.smithi012.stdout:generic/343 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:35:50.001 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/343 2023-07-07T19:35:50.001 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/343 2023-07-07T19:35:50.001 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:35:50.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:50.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:35:50.030 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-07-07T19:35:50.263 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:35:50.268 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:35:50.268 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:35:50.269 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:35:50.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:55.734 INFO:teuthology.orchestra.run.smithi012.stdout:generic/344 5s 2023-07-07T19:35:55.770 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/344 2023-07-07T19:35:55.770 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:35:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:35:55.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:35:55.787 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-07-07T19:35:56.209 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:35:56.214 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:35:56.214 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:35:56.215 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:35:56.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:02.002 INFO:teuthology.orchestra.run.smithi012.stdout:generic/345 5s 2023-07-07T19:36:02.009 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/345 2023-07-07T19:36:02.009 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:02.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:02.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:02.020 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-07-07T19:36:02.253 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:02.258 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:02.258 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:02.259 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:02.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:05.681 INFO:teuthology.orchestra.run.smithi012.stdout:generic/346 3s 2023-07-07T19:36:05.691 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/346 2023-07-07T19:36:05.691 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:05.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:05.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:05.717 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-07-07T19:36:06.145 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:06.160 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:06.161 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:06.162 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:06.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:06.648 INFO:teuthology.orchestra.run.smithi012.stdout:generic/347 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:36:06.652 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/347 2023-07-07T19:36:06.652 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/347 2023-07-07T19:36:06.653 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:06.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:06.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:06.680 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-07-07T19:36:06.914 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:06.918 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:06.918 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:06.920 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:06.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:07.297 INFO:teuthology.orchestra.run.smithi012.stdout:generic/348 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:36:07.301 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/348 2023-07-07T19:36:07.301 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/348 2023-07-07T19:36:07.301 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:07.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:07.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:07.339 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-07-07T19:36:07.571 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:07.576 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:07.576 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:07.577 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:07.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:08.169 INFO:teuthology.orchestra.run.smithi012.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-07T19:36:08.173 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/349 2023-07-07T19:36:08.174 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/349 2023-07-07T19:36:08.174 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:08.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:08.210 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-07-07T19:36:08.438 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:08.442 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:08.443 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:08.444 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:09.847 INFO:teuthology.orchestra.run.smithi012.stdout:generic/350 1s 2023-07-07T19:36:09.853 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/350 2023-07-07T19:36:09.853 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:09.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:09.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:09.864 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-07-07T19:36:10.094 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:10.098 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:10.098 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:10.099 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:10.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:10.466 INFO:teuthology.orchestra.run.smithi012.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:36:10.470 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/351 2023-07-07T19:36:10.470 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/351 2023-07-07T19:36:10.470 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:10.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:10.508 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-07-07T19:36:10.745 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:10.749 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:10.749 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:10.750 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:11.464 INFO:teuthology.orchestra.run.smithi012.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:36:11.590 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/352 2023-07-07T19:36:11.591 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/352 2023-07-07T19:36:11.591 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:11.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:11.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:11.763 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-07-07T19:36:11.984 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:11.988 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:11.988 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:11.989 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:12.515 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:36:12.517 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:36:12.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T19:36:12.556+0000 7fb626ecc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 411693) UID: 0 2023-07-07T19:36:12.558 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T19:36:12.556+0000 7f18a8cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 411693) UID: 0 2023-07-07T19:36:12.558 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T19:36:12.556+0000 7f5317f46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 411693) UID: 0 2023-07-07T19:36:12.559 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T19:36:12.556+0000 7efe5fde0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 411693) UID: 0 2023-07-07T19:36:12.834 INFO:teuthology.orchestra.run.smithi012.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:36:12.931 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/353 2023-07-07T19:36:12.932 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/353 2023-07-07T19:36:12.932 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:13.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:13.019 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-07-07T19:36:13.305 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:13.309 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:13.310 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:13.310 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:13.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:18.469 INFO:teuthology.orchestra.run.smithi012.stdout:generic/354 5s 2023-07-07T19:36:18.518 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/354 2023-07-07T19:36:18.519 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:18.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:18.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:18.539 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-07-07T19:36:18.929 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:18.940 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:18.941 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:18.943 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:20.433 INFO:teuthology.orchestra.run.smithi012.stdout:generic/355 1s 2023-07-07T19:36:20.438 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/355 2023-07-07T19:36:20.438 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:20.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:20.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:20.878 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-07-07T19:36:21.139 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:21.143 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:21.143 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:21.144 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:21.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:21.836 INFO:teuthology.orchestra.run.smithi012.stdout:generic/356 [not run] swapfiles are not supported 2023-07-07T19:36:21.840 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/356 2023-07-07T19:36:21.840 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/356 2023-07-07T19:36:21.841 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:21.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:21.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:21.870 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-07-07T19:36:22.119 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:22.123 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:22.124 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:22.125 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:22.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:22.728 INFO:teuthology.orchestra.run.smithi012.stdout:generic/357 [not run] swapfiles are not supported 2023-07-07T19:36:22.732 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/357 2023-07-07T19:36:22.732 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/357 2023-07-07T19:36:22.732 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:22.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:22.766 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-07-07T19:36:22.995 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:22.999 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:22.999 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:23.000 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:23.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:23.911 INFO:teuthology.orchestra.run.smithi012.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:36:23.951 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/358 2023-07-07T19:36:23.952 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/358 2023-07-07T19:36:23.952 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:23.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:24.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:24.043 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-07-07T19:36:24.269 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:24.273 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:24.274 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:24.275 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:24.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:25.281 INFO:teuthology.orchestra.run.smithi012.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:36:25.292 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/359 2023-07-07T19:36:25.292 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/359 2023-07-07T19:36:25.292 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:25.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:25.327 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-07-07T19:36:25.574 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:25.578 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:25.578 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:25.579 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:25.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:26.335 INFO:teuthology.orchestra.run.smithi012.stdout:generic/360 1s 2023-07-07T19:36:26.354 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/360 2023-07-07T19:36:26.354 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:26.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:26.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:26.393 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-07-07T19:36:26.621 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:26.625 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:26.625 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:26.626 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:26.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:27.171 INFO:teuthology.orchestra.run.smithi012.stdout:generic/361 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:36:27.175 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/361 2023-07-07T19:36:27.175 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/361 2023-07-07T19:36:27.175 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:27.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:27.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:27.207 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-07-07T19:36:27.435 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:27.439 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:27.440 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:27.441 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:27.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:27.820 INFO:teuthology.orchestra.run.smithi012.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-07T19:36:27.824 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/362 2023-07-07T19:36:27.824 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/362 2023-07-07T19:36:27.824 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:27.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:27.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:27.854 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-07-07T19:36:28.088 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:28.092 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:28.093 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:28.094 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:28.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:28.455 INFO:teuthology.orchestra.run.smithi012.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-07T19:36:28.459 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/363 2023-07-07T19:36:28.459 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/363 2023-07-07T19:36:28.459 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:28.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:28.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:28.485 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-07-07T19:36:28.710 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:28.715 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:28.715 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:28.716 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:28.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:29.079 INFO:teuthology.orchestra.run.smithi012.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-07T19:36:29.083 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/364 2023-07-07T19:36:29.083 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/364 2023-07-07T19:36:29.084 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:29.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:29.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:29.120 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-07-07T19:36:29.346 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:29.350 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:29.351 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:29.352 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:29.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:29.703 INFO:teuthology.orchestra.run.smithi012.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-07T19:36:29.707 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/365 2023-07-07T19:36:29.707 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/365 2023-07-07T19:36:29.707 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:29.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:29.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:29.739 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-07-07T19:36:29.974 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:29.978 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:29.979 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:29.980 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:29.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:30.342 INFO:teuthology.orchestra.run.smithi012.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-07T19:36:30.346 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/366 2023-07-07T19:36:30.346 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/366 2023-07-07T19:36:30.346 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:30.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:30.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:30.378 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-07-07T19:36:30.618 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:30.622 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:30.623 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:30.623 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:30.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:30.971 INFO:teuthology.orchestra.run.smithi012.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-07T19:36:30.975 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/367 2023-07-07T19:36:30.975 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/367 2023-07-07T19:36:30.975 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:30.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:31.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:31.000 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-07-07T19:36:31.226 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:31.230 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:31.230 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:31.231 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:31.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:31.559 INFO:teuthology.orchestra.run.smithi012.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-07T19:36:31.563 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/368 2023-07-07T19:36:31.563 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/368 2023-07-07T19:36:31.563 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:31.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:31.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:31.588 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-07-07T19:36:31.818 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:31.822 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:31.822 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:31.823 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:31.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:32.171 INFO:teuthology.orchestra.run.smithi012.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-07T19:36:32.175 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/369 2023-07-07T19:36:32.175 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/369 2023-07-07T19:36:32.175 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:32.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:32.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:32.200 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-07-07T19:36:32.430 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:32.436 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:32.436 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:32.437 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:32.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:32.797 INFO:teuthology.orchestra.run.smithi012.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-07T19:36:32.801 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/370 2023-07-07T19:36:32.801 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/370 2023-07-07T19:36:32.801 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:32.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:32.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:32.827 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-07-07T19:36:33.050 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:33.054 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:33.054 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:33.055 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:33.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:33.419 INFO:teuthology.orchestra.run.smithi012.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:36:33.423 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/371 2023-07-07T19:36:33.423 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/371 2023-07-07T19:36:33.423 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:33.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:33.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:33.453 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-07-07T19:36:33.684 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:33.688 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:33.688 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:33.689 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:33.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:34.514 INFO:teuthology.orchestra.run.smithi012.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:36:34.692 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/372 2023-07-07T19:36:34.692 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/372 2023-07-07T19:36:34.693 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:34.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:34.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:34.726 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-07-07T19:36:34.953 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:34.958 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:34.958 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:34.959 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:34.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:35.979 INFO:teuthology.orchestra.run.smithi012.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:36:35.994 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/373 2023-07-07T19:36:35.994 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/373 2023-07-07T19:36:35.995 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:35.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:36.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:36.036 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-07-07T19:36:36.287 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:36.291 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:36.292 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:36.293 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:36.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:36.859 INFO:teuthology.orchestra.run.smithi012.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-07T19:36:37.280 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/374 2023-07-07T19:36:37.281 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/374 2023-07-07T19:36:37.281 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:37.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:37.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:37.343 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-07-07T19:36:37.574 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:37.578 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:37.578 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:37.579 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:37.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:38.056 INFO:teuthology.orchestra.run.smithi012.stdout:generic/375 1s 2023-07-07T19:36:38.061 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/375 2023-07-07T19:36:38.061 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:38.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:38.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:38.475 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-07-07T19:36:38.750 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:38.754 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:38.754 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:38.755 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:38.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:39.111 INFO:teuthology.orchestra.run.smithi012.stdout:generic/376 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:36:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/376 2023-07-07T19:36:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/376 2023-07-07T19:36:39.115 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:39.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:39.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:39.147 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-07-07T19:36:39.374 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:39.378 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:39.378 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:39.379 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:39.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:40.059 INFO:teuthology.orchestra.run.smithi012.stdout:generic/377 1s 2023-07-07T19:36:40.064 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/377 2023-07-07T19:36:40.064 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:40.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:40.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:40.075 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-07-07T19:36:40.327 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:40.331 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:40.331 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:40.332 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:40.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:40.883 INFO:teuthology.orchestra.run.smithi012.stdout:generic/378 0s 2023-07-07T19:36:40.888 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/378 2023-07-07T19:36:40.888 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:40.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:41.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:41.325 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-07-07T19:36:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:41.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:41.960 INFO:teuthology.orchestra.run.smithi012.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:36:41.964 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/379 2023-07-07T19:36:41.964 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/379 2023-07-07T19:36:41.965 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:41.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:41.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:41.996 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-07-07T19:36:42.233 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:42.237 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:42.237 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:42.238 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:42.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:42.587 INFO:teuthology.orchestra.run.smithi012.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:36:42.591 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/380 2023-07-07T19:36:42.591 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/380 2023-07-07T19:36:42.591 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:42.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:42.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:42.615 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-07-07T19:36:42.856 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:42.860 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:42.860 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:42.861 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:42.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:43.221 INFO:teuthology.orchestra.run.smithi012.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:36:43.225 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/381 2023-07-07T19:36:43.225 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/381 2023-07-07T19:36:43.225 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:43.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:43.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:43.250 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-07-07T19:36:43.498 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:43.502 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:43.503 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:43.504 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:43.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:43.849 INFO:teuthology.orchestra.run.smithi012.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:36:43.852 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/382 2023-07-07T19:36:43.853 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/382 2023-07-07T19:36:43.853 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:43.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:43.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:43.887 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-07-07T19:36:44.113 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:44.117 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:44.118 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:44.119 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:44.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:44.497 INFO:teuthology.orchestra.run.smithi012.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:36:44.501 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/383 2023-07-07T19:36:44.501 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/383 2023-07-07T19:36:44.501 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:44.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:44.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:44.532 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-07-07T19:36:44.761 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:44.765 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:44.766 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:44.766 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:45.104 INFO:teuthology.orchestra.run.smithi012.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:36:45.108 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/384 2023-07-07T19:36:45.108 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/384 2023-07-07T19:36:45.109 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:45.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:45.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:45.138 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-07-07T19:36:45.370 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:45.374 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:45.375 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:45.375 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:45.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:45.742 INFO:teuthology.orchestra.run.smithi012.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:36:45.746 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/385 2023-07-07T19:36:45.746 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/385 2023-07-07T19:36:45.746 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:45.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:45.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:45.770 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-07-07T19:36:45.996 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:46.000 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:46.001 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:46.002 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:46.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:46.355 INFO:teuthology.orchestra.run.smithi012.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:36:46.359 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/386 2023-07-07T19:36:46.359 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/386 2023-07-07T19:36:46.359 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:46.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:46.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:46.393 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-07-07T19:36:46.618 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:46.621 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:46.622 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:46.623 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:46.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:47.462 INFO:teuthology.orchestra.run.smithi012.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:36:47.592 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/387 2023-07-07T19:36:47.593 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/387 2023-07-07T19:36:47.593 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:47.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:47.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:47.647 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-07-07T19:36:47.877 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:47.881 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:47.882 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:47.883 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:47.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:48.259 INFO:teuthology.orchestra.run.smithi012.stdout:generic/388 [not run] require 172.21.15.12:6789:/scratch to be local device 2023-07-07T19:36:48.263 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/388 2023-07-07T19:36:48.263 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/388 2023-07-07T19:36:48.263 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:48.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:48.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:48.286 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-07-07T19:36:48.516 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:48.520 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:48.520 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:48.521 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:48.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:48.859 INFO:teuthology.orchestra.run.smithi012.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-07-07T19:36:48.864 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/389 2023-07-07T19:36:48.864 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/389 2023-07-07T19:36:48.864 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:48.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:48.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:48.889 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-07-07T19:36:49.116 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:49.120 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:49.120 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:49.121 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:49.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:49.479 INFO:teuthology.orchestra.run.smithi012.stdout:generic/390 [not run] ceph does not support freezing 2023-07-07T19:36:49.483 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/390 2023-07-07T19:36:49.483 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/390 2023-07-07T19:36:49.483 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:49.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:49.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:49.512 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-07-07T19:36:49.744 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:49.748 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:49.748 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:49.749 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:49.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:50.103 INFO:teuthology.orchestra.run.smithi012.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:36:50.107 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/391 2023-07-07T19:36:50.108 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/391 2023-07-07T19:36:50.108 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:50.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:50.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:50.139 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-07-07T19:36:50.361 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:50.365 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:50.365 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:50.366 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:50.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:50.932 INFO:teuthology.orchestra.run.smithi012.stdout:generic/392 [not run] ceph does not support shutdown 2023-07-07T19:36:50.951 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/392 2023-07-07T19:36:50.951 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/392 2023-07-07T19:36:50.951 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:50.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:50.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:50.976 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-07-07T19:36:51.212 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:51.216 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:51.216 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:51.217 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:51.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:52.396 INFO:teuthology.orchestra.run.smithi012.stdout:generic/393 1s 2023-07-07T19:36:52.401 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/393 2023-07-07T19:36:52.402 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:52.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:52.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:52.412 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-07-07T19:36:52.646 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:52.650 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:52.650 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:52.651 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:52.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:53.065 INFO:teuthology.orchestra.run.smithi012.stdout:generic/394 1s 2023-07-07T19:36:53.070 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/394 2023-07-07T19:36:53.070 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:53.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:53.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:53.369 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-07-07T19:36:53.854 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:53.864 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:53.864 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:53.865 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:53.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:54.880 INFO:teuthology.orchestra.run.smithi012.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-07-07T19:36:54.911 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/395 2023-07-07T19:36:54.911 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/395 2023-07-07T19:36:54.911 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:54.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:54.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:54.951 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-07-07T19:36:55.414 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:55.418 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:55.419 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:55.420 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:55.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:56.027 INFO:teuthology.orchestra.run.smithi012.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-07-07T19:36:56.048 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/396 2023-07-07T19:36:56.048 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/396 2023-07-07T19:36:56.048 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:56.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:56.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:56.076 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-07-07T19:36:56.301 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:56.305 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:56.305 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:56.306 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:56.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:56.954 INFO:teuthology.orchestra.run.smithi012.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-07-07T19:36:56.971 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/397 2023-07-07T19:36:56.971 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/397 2023-07-07T19:36:56.972 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:56.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:57.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:57.001 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-07-07T19:36:57.229 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:57.233 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:57.234 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:57.235 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:57.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:57.816 INFO:teuthology.orchestra.run.smithi012.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-07-07T19:36:57.836 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/398 2023-07-07T19:36:57.837 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/398 2023-07-07T19:36:57.837 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:57.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:57.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:57.864 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-07-07T19:36:58.103 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:58.107 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:58.108 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:58.108 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:58.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:58.705 INFO:teuthology.orchestra.run.smithi012.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-07-07T19:36:58.727 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/399 2023-07-07T19:36:58.727 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/399 2023-07-07T19:36:58.727 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:58.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:58.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:58.750 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-07-07T19:36:58.987 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:58.991 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:58.992 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:58.993 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:58.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:59.487 INFO:teuthology.orchestra.run.smithi012.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T19:36:59.491 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/400 2023-07-07T19:36:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/400 2023-07-07T19:36:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:36:59.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:36:59.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:36:59.518 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-07-07T19:36:59.772 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:36:59.776 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:36:59.777 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:36:59.778 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:36:59.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:01.394 INFO:teuthology.orchestra.run.smithi012.stdout:generic/401 2s 2023-07-07T19:37:01.403 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/401 2023-07-07T19:37:01.403 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:01.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:01.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:01.415 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-07-07T19:37:01.643 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:01.647 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:01.648 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:01.649 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:01.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:02.224 INFO:teuthology.orchestra.run.smithi012.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-07-07T19:37:02.247 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/402 2023-07-07T19:37:02.247 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/402 2023-07-07T19:37:02.247 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:02.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:02.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:02.281 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-07-07T19:37:02.531 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:02.535 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:02.536 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:02.537 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:02.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:03.395 INFO:teuthology.orchestra.run.smithi012.stdout:generic/403 1s 2023-07-07T19:37:03.400 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/403 2023-07-07T19:37:03.401 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:03.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:03.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:03.412 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-07-07T19:37:03.638 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:03.642 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:03.643 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:03.644 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:03.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:04.004 INFO:teuthology.orchestra.run.smithi012.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:37:04.008 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/404 2023-07-07T19:37:04.008 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/404 2023-07-07T19:37:04.008 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:04.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:04.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:04.039 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-07-07T19:37:04.273 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:04.278 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:04.278 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:04.279 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:04.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:04.728 INFO:teuthology.orchestra.run.smithi012.stdout:generic/405 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:37:04.732 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/405 2023-07-07T19:37:04.732 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/405 2023-07-07T19:37:04.732 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:04.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:04.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:04.763 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-07-07T19:37:04.984 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:04.988 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:04.989 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:04.990 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:04.990 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:06.859 INFO:teuthology.orchestra.run.smithi012.stdout:generic/406 1s 2023-07-07T19:37:06.864 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/406 2023-07-07T19:37:06.864 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:06.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:06.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:06.875 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-07-07T19:37:07.099 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:07.103 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:07.104 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:07.105 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:07.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:07.514 INFO:teuthology.orchestra.run.smithi012.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:37:07.518 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/407 2023-07-07T19:37:07.518 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/407 2023-07-07T19:37:07.518 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:07.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:08.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:08.027 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-07-07T19:37:08.355 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:08.359 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:08.359 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:08.360 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:08.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:08.736 INFO:teuthology.orchestra.run.smithi012.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-07T19:37:08.740 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/408 2023-07-07T19:37:08.740 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/408 2023-07-07T19:37:08.740 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:08.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:09.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:09.197 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-07-07T19:37:09.431 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:09.435 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:09.436 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:09.437 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:09.801 INFO:teuthology.orchestra.run.smithi012.stdout:generic/409 [not run] require 172.21.15.12:6789:/scratch to be local device 2023-07-07T19:37:09.805 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/409 2023-07-07T19:37:09.806 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/409 2023-07-07T19:37:09.806 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:09.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:09.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:09.826 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-07-07T19:37:10.060 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:10.064 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:10.064 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:10.065 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:10.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:10.419 INFO:teuthology.orchestra.run.smithi012.stdout:generic/410 [not run] require 172.21.15.12:6789:/scratch to be local device 2023-07-07T19:37:10.423 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/410 2023-07-07T19:37:10.423 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/410 2023-07-07T19:37:10.423 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:10.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:10.450 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-07-07T19:37:10.671 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:10.675 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:10.676 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:10.677 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:11.038 INFO:teuthology.orchestra.run.smithi012.stdout:generic/411 [not run] require 172.21.15.12:6789:/scratch to be local device 2023-07-07T19:37:11.042 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/411 2023-07-07T19:37:11.042 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/411 2023-07-07T19:37:11.042 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:11.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:11.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:11.071 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-07-07T19:37:11.302 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:11.306 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:11.307 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:11.308 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:11.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:12.085 INFO:teuthology.orchestra.run.smithi012.stdout:generic/412 1s 2023-07-07T19:37:12.090 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/412 2023-07-07T19:37:12.090 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:12.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:12.100 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-07-07T19:37:12.322 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:12.326 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:12.327 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:12.328 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:12.821 INFO:teuthology.orchestra.run.smithi012.stdout:generic/413 [not run] mount 172.21.15.12:6789:/scratch with dax failed 2023-07-07T19:37:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/413 2023-07-07T19:37:12.825 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/413 2023-07-07T19:37:12.826 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:12.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:12.852 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-07-07T19:37:13.087 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:13.091 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:13.091 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:13.092 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:14.087 INFO:teuthology.orchestra.run.smithi012.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:37:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/414 2023-07-07T19:37:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/414 2023-07-07T19:37:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:14.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:14.152 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-07-07T19:37:14.384 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:14.388 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:14.389 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:14.390 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:15.338 INFO:teuthology.orchestra.run.smithi012.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:37:15.387 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/415 2023-07-07T19:37:15.388 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/415 2023-07-07T19:37:15.388 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:15.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:15.439 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-07-07T19:37:15.672 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:15.676 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:15.677 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:15.678 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:15.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:16.066 INFO:teuthology.orchestra.run.smithi012.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:37:16.070 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/416 2023-07-07T19:37:16.071 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/416 2023-07-07T19:37:16.071 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:16.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:16.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:16.092 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-07-07T19:37:16.319 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:16.323 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:16.324 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:16.325 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:16.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:generic/417 [not run] ceph does not support shutdown 2023-07-07T19:37:16.863 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/417 2023-07-07T19:37:16.863 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/417 2023-07-07T19:37:16.863 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:16.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:16.886 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-07-07T19:37:17.129 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:17.134 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:17.134 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:17.135 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:17.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:17.513 INFO:teuthology.orchestra.run.smithi012.stdout:generic/418 [not run] require 172.21.15.12:6789:/test to be valid block disk 2023-07-07T19:37:17.517 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/418 2023-07-07T19:37:17.517 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/418 2023-07-07T19:37:17.517 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:17.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:17.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:17.549 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-07-07T19:37:17.778 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:17.782 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:17.782 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:17.783 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:18.355 INFO:teuthology.orchestra.run.smithi012.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-07-07T19:37:18.376 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/419 2023-07-07T19:37:18.376 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/419 2023-07-07T19:37:18.377 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:18.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:18.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:18.398 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-07-07T19:37:18.629 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:18.633 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:18.633 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:18.634 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:18.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:19.186 INFO:teuthology.orchestra.run.smithi012.stdout:generic/420 1s 2023-07-07T19:37:19.348 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/420 2023-07-07T19:37:19.348 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:19.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:19.697 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-07-07T19:37:20.174 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:20.178 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:20.179 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:20.180 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:20.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:20.757 INFO:teuthology.orchestra.run.smithi012.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-07-07T19:37:20.777 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/421 2023-07-07T19:37:20.777 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/421 2023-07-07T19:37:20.777 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:20.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:20.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:20.800 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-07-07T19:37:21.032 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:21.036 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:21.037 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:21.038 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:21.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:21.406 INFO:teuthology.orchestra.run.smithi012.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-07T19:37:21.410 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/422 2023-07-07T19:37:21.411 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/422 2023-07-07T19:37:21.411 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:21.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:21.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:21.442 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-07-07T19:37:21.677 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:21.681 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:21.682 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:21.682 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:21.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:22.166 INFO:teuthology.orchestra.run.smithi012.stdout:generic/423 1s 2023-07-07T19:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/423 2023-07-07T19:37:22.171 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:22.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:22.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:22.492 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-07-07T19:37:22.894 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:22.899 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:23.293 INFO:teuthology.orchestra.run.smithi012.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-07-07T19:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/424 2023-07-07T19:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/424 2023-07-07T19:37:23.297 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:23.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:23.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:23.326 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-07-07T19:37:23.552 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:23.556 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:23.556 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:23.557 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:23.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:23.965 INFO:teuthology.orchestra.run.smithi012.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-07-07T19:37:23.969 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/425 2023-07-07T19:37:23.969 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/425 2023-07-07T19:37:23.969 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:37:23.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:37:24.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:37:24.459 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-07-07T19:37:24.698 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:37:24.702 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:37:24.702 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:37:24.703 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:37:24.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:32.705 INFO:teuthology.orchestra.run.smithi012.stdout:generic/426 67s 2023-07-07T19:38:33.166 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/426 2023-07-07T19:38:33.166 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:33.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:34.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:34.159 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-07-07T19:38:40.867 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:40.871 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:40.872 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:40.873 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:40.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:41.785 INFO:teuthology.orchestra.run.smithi012.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:38:41.789 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/427 2023-07-07T19:38:41.790 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/427 2023-07-07T19:38:41.790 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:41.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:41.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:41.827 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-07-07T19:38:42.076 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:42.080 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:42.081 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:42.081 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:42.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:42.505 INFO:teuthology.orchestra.run.smithi012.stdout:generic/428 0s 2023-07-07T19:38:42.510 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/428 2023-07-07T19:38:42.511 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:42.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:42.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:42.544 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-07-07T19:38:42.772 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:42.776 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:42.777 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:42.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:43.436 INFO:teuthology.orchestra.run.smithi012.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-07-07T19:38:43.459 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/429 2023-07-07T19:38:43.459 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/429 2023-07-07T19:38:43.459 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:43.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:43.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:43.484 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-07-07T19:38:43.714 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:43.718 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:43.718 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:43.719 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:43.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:44.293 INFO:teuthology.orchestra.run.smithi012.stdout:generic/430 1s 2023-07-07T19:38:44.298 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/430 2023-07-07T19:38:44.298 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:44.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:44.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:44.785 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-07-07T19:38:45.065 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:45.069 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:45.070 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:45.071 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:45.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:45.560 INFO:teuthology.orchestra.run.smithi012.stdout:generic/431 0s 2023-07-07T19:38:45.566 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/431 2023-07-07T19:38:45.566 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:45.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:46.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:46.015 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-07-07T19:38:46.283 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:46.288 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:46.288 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:46.289 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:46.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:46.745 INFO:teuthology.orchestra.run.smithi012.stdout:generic/432 0s 2023-07-07T19:38:46.750 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/432 2023-07-07T19:38:46.750 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:46.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:47.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:47.137 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-07-07T19:38:47.465 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:47.469 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:47.469 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:47.470 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:47.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:47.883 INFO:teuthology.orchestra.run.smithi012.stdout:generic/433 0s 2023-07-07T19:38:47.888 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/433 2023-07-07T19:38:47.888 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:47.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:48.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:48.118 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-07-07T19:38:48.585 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:48.589 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:48.590 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:48.591 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:48.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:49.066 INFO:teuthology.orchestra.run.smithi012.stdout:generic/434 1s 2023-07-07T19:38:49.071 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/434 2023-07-07T19:38:49.071 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:49.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:49.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:49.318 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-07-07T19:38:49.768 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:49.772 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:49.773 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:49.774 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:49.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:50.361 INFO:teuthology.orchestra.run.smithi012.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-07-07T19:38:50.381 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/435 2023-07-07T19:38:50.381 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/435 2023-07-07T19:38:50.382 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:50.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:50.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:50.406 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-07-07T19:38:50.632 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:50.636 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:50.637 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:50.638 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:50.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:51.276 INFO:teuthology.orchestra.run.smithi012.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:38:51.280 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/436 2023-07-07T19:38:51.280 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/436 2023-07-07T19:38:51.280 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:51.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:51.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:51.690 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-07-07T19:38:51.980 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:51.984 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:51.984 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:51.986 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:51.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:52.969 INFO:teuthology.orchestra.run.smithi012.stdout:generic/437 0s 2023-07-07T19:38:52.974 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/437 2023-07-07T19:38:52.974 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:38:52.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:38:53.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:38:53.004 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-07-07T19:38:53.271 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:38:53.276 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:38:53.276 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:38:53.277 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:38:53.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:39:26.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:39:26.409 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:39:56.740 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:39:56.742 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:39:58.400 INFO:teuthology.orchestra.run.smithi012.stdout:generic/438 65s 2023-07-07T19:39:58.405 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/438 2023-07-07T19:39:58.406 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:39:58.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:39:58.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:39:58.442 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-07-07T19:39:58.672 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:39:58.676 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:39:58.676 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:39:58.677 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:39:58.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:39:59.888 INFO:teuthology.orchestra.run.smithi012.stdout:generic/439 1s 2023-07-07T19:39:59.893 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/439 2023-07-07T19:39:59.893 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:39:59.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:39:59.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:39:59.929 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-07-07T19:40:00.167 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:00.172 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:00.172 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:00.173 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:00.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:00.751 INFO:teuthology.orchestra.run.smithi012.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-07-07T19:40:00.766 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/440 2023-07-07T19:40:00.766 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/440 2023-07-07T19:40:00.766 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:00.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:00.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:00.792 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-07-07T19:40:01.021 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:01.025 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:01.026 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:01.027 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:01.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:01.493 INFO:teuthology.orchestra.run.smithi012.stdout:generic/441 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:40:01.498 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/441 2023-07-07T19:40:01.498 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/441 2023-07-07T19:40:01.499 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:01.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:01.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:01.527 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-07-07T19:40:01.755 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:01.759 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:01.760 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:01.761 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:01.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:02.110 INFO:teuthology.orchestra.run.smithi012.stdout:generic/442 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:40:02.114 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/442 2023-07-07T19:40:02.114 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/442 2023-07-07T19:40:02.115 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:02.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:02.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:02.144 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-07-07T19:40:02.369 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:02.373 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:02.373 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:02.374 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:02.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:02.742 INFO:teuthology.orchestra.run.smithi012.stdout:generic/443 0s 2023-07-07T19:40:02.747 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/443 2023-07-07T19:40:02.747 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:02.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:02.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:02.779 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-07-07T19:40:03.009 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:03.013 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:03.014 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:03.015 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:03.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:03.438 INFO:teuthology.orchestra.run.smithi012.stdout:generic/444 0s 2023-07-07T19:40:03.443 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/444 2023-07-07T19:40:03.443 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:03.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:03.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:03.483 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-07-07T19:40:03.709 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:03.713 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:03.713 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:03.714 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:03.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:04.363 INFO:teuthology.orchestra.run.smithi012.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:40:04.367 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/445 2023-07-07T19:40:04.367 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/445 2023-07-07T19:40:04.367 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:04.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:04.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:04.757 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-07-07T19:40:05.023 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:05.027 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:05.028 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:05.029 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:05.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:26.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:40:26.817 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:40:27.675 INFO:teuthology.orchestra.run.smithi012.stdout:generic/446 22s 2023-07-07T19:40:27.698 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/446 2023-07-07T19:40:27.699 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:27.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:27.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:27.713 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-07-07T19:40:27.934 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:27.939 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:27.939 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:27.940 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:27.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:28.869 INFO:teuthology.orchestra.run.smithi012.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:40:28.889 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/447 2023-07-07T19:40:28.889 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/447 2023-07-07T19:40:28.889 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:28.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:28.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:28.950 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-07-07T19:40:29.174 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:29.179 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:29.179 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:29.180 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:29.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:30.180 INFO:teuthology.orchestra.run.smithi012.stdout:generic/448 1s 2023-07-07T19:40:30.185 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/448 2023-07-07T19:40:30.185 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:30.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:30.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:30.329 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-07-07T19:40:30.843 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:30.847 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:30.847 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:30.848 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:30.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:31.251 INFO:teuthology.orchestra.run.smithi012.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T19:40:31.255 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/449 2023-07-07T19:40:31.255 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/449 2023-07-07T19:40:31.255 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:31.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:31.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:31.651 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-07-07T19:40:31.912 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:31.916 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:31.917 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:31.918 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:31.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:32.623 INFO:teuthology.orchestra.run.smithi012.stdout:generic/450 0s 2023-07-07T19:40:32.628 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/450 2023-07-07T19:40:32.628 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:40:32.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:32.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:40:32.964 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-07-07T19:40:33.299 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:40:33.303 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:40:33.304 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:40:33.305 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:40:33.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:40:56.989 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:40:56.991 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:41:03.786 INFO:teuthology.orchestra.run.smithi012.stdout:generic/451 30s 2023-07-07T19:41:03.791 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/451 2023-07-07T19:41:03.791 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:03.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:04.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:04.135 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-07-07T19:41:04.440 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:04.444 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:04.444 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:04.445 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:04.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:05.073 INFO:teuthology.orchestra.run.smithi012.stdout:generic/452 1s 2023-07-07T19:41:05.078 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/452 2023-07-07T19:41:05.078 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:05.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:05.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:05.089 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-07-07T19:41:05.314 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:05.318 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:05.318 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:05.319 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:05.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:05.662 INFO:teuthology.orchestra.run.smithi012.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-07-07T19:41:05.666 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/453 2023-07-07T19:41:05.666 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/453 2023-07-07T19:41:05.666 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:05.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:05.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:05.693 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-07-07T19:41:05.916 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:05.920 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:05.920 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:05.921 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:05.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:06.276 INFO:teuthology.orchestra.run.smithi012.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-07-07T19:41:06.280 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/454 2023-07-07T19:41:06.280 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/454 2023-07-07T19:41:06.281 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:06.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:06.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:06.314 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-07-07T19:41:06.539 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:06.543 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:06.543 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:06.544 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:06.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:06.964 INFO:teuthology.orchestra.run.smithi012.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-07-07T19:41:06.968 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/455 2023-07-07T19:41:06.968 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/455 2023-07-07T19:41:06.968 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:06.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:07.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:07.005 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-07-07T19:41:07.229 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:07.233 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:07.234 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:07.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:07.603 INFO:teuthology.orchestra.run.smithi012.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T19:41:07.607 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/456 2023-07-07T19:41:07.607 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/456 2023-07-07T19:41:07.607 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:07.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:07.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:07.649 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-07-07T19:41:07.873 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:07.877 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:07.877 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:07.878 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:07.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:08.869 INFO:teuthology.orchestra.run.smithi012.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:41:08.882 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/457 2023-07-07T19:41:08.882 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/457 2023-07-07T19:41:08.883 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:08.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:08.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:08.912 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-07-07T19:41:09.133 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:09.137 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:09.138 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:09.139 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:09.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:09.976 INFO:teuthology.orchestra.run.smithi012.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T19:41:09.994 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/458 2023-07-07T19:41:09.994 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/458 2023-07-07T19:41:09.994 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:10.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:10.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:10.137 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-07-07T19:41:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:10.365 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:10.365 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:10.366 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:11.471 INFO:teuthology.orchestra.run.smithi012.stdout:generic/459 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:41:11.476 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/459 2023-07-07T19:41:11.476 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/459 2023-07-07T19:41:11.476 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:11.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:11.508 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-07-07T19:41:11.749 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:11.754 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:11.754 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:11.755 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:11.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:13.828 INFO:teuthology.orchestra.run.smithi012.stdout:generic/460 2s 2023-07-07T19:41:13.833 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/460 2023-07-07T19:41:13.834 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:13.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:13.844 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-07-07T19:41:14.072 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:14.077 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:14.077 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:14.078 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:14.616 INFO:teuthology.orchestra.run.smithi012.stdout:generic/461 [not run] ceph does not support shutdown 2023-07-07T19:41:14.620 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/461 2023-07-07T19:41:14.621 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/461 2023-07-07T19:41:14.621 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:14.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:14.649 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-07-07T19:41:14.873 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:14.878 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:14.878 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:14.879 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:15.572 INFO:teuthology.orchestra.run.smithi012.stdout:generic/462 [not run] mount 172.21.15.12:6789:/scratch with dax failed 2023-07-07T19:41:15.576 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/462 2023-07-07T19:41:15.576 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/462 2023-07-07T19:41:15.577 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:15.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:15.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:15.607 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-07-07T19:41:15.831 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:15.835 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:15.835 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:15.836 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:16.226 INFO:teuthology.orchestra.run.smithi012.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T19:41:16.230 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/463 2023-07-07T19:41:16.230 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/463 2023-07-07T19:41:16.230 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:41:16.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:16.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:41:16.562 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-07-07T19:41:16.898 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:41:16.902 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:41:16.902 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:41:16.904 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:41:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:41:27.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:41:27.074 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:41:57.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:41:57.227 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:42:13.938 INFO:teuthology.orchestra.run.smithi012.stdout:generic/464 56s 2023-07-07T19:42:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/464 2023-07-07T19:42:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:42:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:42:13.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:42:13.954 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-07-07T19:42:14.177 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:42:14.181 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:42:14.182 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:42:14.183 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:42:14.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:42:18.836 INFO:teuthology.orchestra.run.smithi012.stdout:generic/465 4s 2023-07-07T19:42:18.867 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/465 2023-07-07T19:42:18.867 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:42:18.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:42:18.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:42:18.896 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-07-07T19:42:19.156 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:42:19.160 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:42:19.161 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:42:19.162 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:42:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:42:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:generic/466 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:42:19.505 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/466 2023-07-07T19:42:19.505 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/466 2023-07-07T19:42:19.505 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:42:19.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:42:19.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:42:19.536 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-07-07T19:42:19.758 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:42:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:42:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:42:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:42:19.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:42:27.309 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:42:27.312 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:42:57.786 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:42:57.810 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:43:19.219 INFO:teuthology.orchestra.run.smithi012.stdout:generic/467 60s 2023-07-07T19:43:19.301 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/467 2023-07-07T19:43:19.302 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:43:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:19.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:43:19.835 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-07-07T19:43:20.865 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:43:20.869 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:43:20.870 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:43:20.870 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:43:20.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:21.462 INFO:teuthology.orchestra.run.smithi012.stdout:generic/468 [not run] ceph does not support shutdown 2023-07-07T19:43:21.488 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/468 2023-07-07T19:43:21.489 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/468 2023-07-07T19:43:21.489 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:43:21.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:21.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:43:21.517 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-07-07T19:43:21.757 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:43:21.761 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:43:21.762 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:43:21.763 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:43:21.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:22.143 INFO:teuthology.orchestra.run.smithi012.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-07T19:43:22.147 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/469 2023-07-07T19:43:22.148 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/469 2023-07-07T19:43:22.148 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:43:22.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:22.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:43:22.181 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-07-07T19:43:22.408 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:43:22.412 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:43:22.412 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:43:22.413 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:43:22.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:22.831 INFO:teuthology.orchestra.run.smithi012.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-07-07T19:43:22.835 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/470 2023-07-07T19:43:22.836 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/470 2023-07-07T19:43:22.836 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:43:22.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:22.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:43:22.864 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-07-07T19:43:23.089 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:43:23.093 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:43:23.094 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:43:23.095 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:43:23.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:23.519 INFO:teuthology.orchestra.run.smithi012.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-07-07T19:43:23.523 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/471 2023-07-07T19:43:23.523 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/471 2023-07-07T19:43:23.523 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:43:23.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:23.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:43:23.742 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-07-07T19:43:24.177 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:43:24.181 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:43:24.181 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:43:24.182 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:43:24.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:24.786 INFO:teuthology.orchestra.run.smithi012.stdout:generic/472 [not run] swapfiles are not supported 2023-07-07T19:43:24.791 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/472 2023-07-07T19:43:24.791 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/472 2023-07-07T19:43:24.791 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:43:24.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:24.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:43:24.827 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-07-07T19:43:25.056 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:43:25.060 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:43:25.061 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:43:25.061 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:43:25.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:25.453 INFO:teuthology.orchestra.run.smithi012.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-07T19:43:25.457 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/473 2023-07-07T19:43:25.457 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/473 2023-07-07T19:43:25.457 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:43:25.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:25.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:43:25.491 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-07-07T19:43:25.717 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:43:25.721 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:43:25.722 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:43:25.723 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:43:25.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:26.234 INFO:teuthology.orchestra.run.smithi012.stdout:generic/474 [not run] ceph does not support shutdown 2023-07-07T19:43:26.259 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/474 2023-07-07T19:43:26.260 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/474 2023-07-07T19:43:26.260 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:43:26.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:26.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:43:26.294 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-07-07T19:43:26.524 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:43:26.528 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:43:26.529 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:43:26.530 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:43:26.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:26.930 INFO:teuthology.orchestra.run.smithi012.stdout:generic/475 [not run] require 172.21.15.12:6789:/scratch to be valid block disk 2023-07-07T19:43:26.934 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/475 2023-07-07T19:43:26.934 INFO:teuthology.orchestra.run.smithi012.stdout:Not run: generic/475 2023-07-07T19:43:26.935 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T19:43:26.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:26.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T19:43:26.962 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-07-07T19:43:27.197 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T19:43:27.201 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T19:43:27.202 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T19:43:27.203 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T19:43:27.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T19:43:29.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:43:29.108 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:43:59.947 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:43:59.979 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:44:30.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:44:30.169 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:45:00.568 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:45:00.650 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:45:31.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:45:31.352 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:46:01.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:46:01.786 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:46:32.308 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:46:32.396 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:47:02.744 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:47:02.764 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:47:33.231 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:47:33.241 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:48:03.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:48:03.695 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:48:34.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:48:34.120 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:49:04.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:49:04.392 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:49:34.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:49:34.637 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:50:04.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:50:04.784 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:50:35.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:50:35.438 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:50:35.538 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T19:50:35.536+0000 7ff6efcfe700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 644931) UID: 0 2023-07-07T19:50:35.540 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T19:50:35.536+0000 7f23f6e45700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 644931) UID: 0 2023-07-07T19:54:58.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:54:58.536 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:54:58.617 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T19:54:58.614+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118203) UID: 0 2023-07-07T19:54:58.617 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T19:54:58.614+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118203) UID: 0 2023-07-07T19:54:58.618 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T19:54:58.614+0000 7fa834dc8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118203) UID: 0 2023-07-07T19:54:58.618 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T19:54:58.616+0000 7f93a9f18700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118203) UID: 0 2023-07-07T19:58:53.609 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:58:53.678 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T19:58:53.804 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T19:58:53.802+0000 7fa834dc8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118265) UID: 0 2023-07-07T19:58:53.804 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T19:58:53.802+0000 7f93a9f18700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118265) UID: 0 2023-07-07T19:58:53.808 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T19:58:53.802+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118265) UID: 0 2023-07-07T19:58:53.812 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T19:58:53.802+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118265) UID: 0 2023-07-07T20:02:57.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:02:57.173 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:02:57.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T20:02:57.299+0000 7f18a8cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645141) UID: 0 2023-07-07T20:02:57.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T20:02:57.299+0000 7fb626ecc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645141) UID: 0 2023-07-07T20:02:57.301 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T20:02:57.299+0000 7f5317f46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645141) UID: 0 2023-07-07T20:02:57.302 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T20:02:57.299+0000 7efe5fde0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645141) UID: 0 2023-07-07T20:15:49.265 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:15:49.268 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:15:49.317 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T20:15:49.315+0000 7f93a9f18700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118504) UID: 0 2023-07-07T20:15:49.318 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T20:15:49.315+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118504) UID: 0 2023-07-07T20:15:49.318 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T20:15:49.315+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118504) UID: 0 2023-07-07T20:15:49.319 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T20:15:49.315+0000 7fa834dc8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118504) UID: 0 2023-07-07T20:15:50.250 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T20:15:50.248+0000 7ff6efcfe700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 645299) UID: 0 2023-07-07T20:15:50.251 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T20:15:50.248+0000 7f23f6e45700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 645299) UID: 0 2023-07-07T20:22:08.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T20:22:08.046+0000 7f18a8cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645362) UID: 0 2023-07-07T20:22:08.050 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T20:22:08.046+0000 7f5317f46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645362) UID: 0 2023-07-07T20:22:08.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T20:22:08.046+0000 7fb626ecc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645362) UID: 0 2023-07-07T20:22:08.051 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T20:22:08.046+0000 7efe5fde0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645362) UID: 0 2023-07-07T20:27:51.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:27:52.070 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:28:23.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:28:23.414 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:28:23.762 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T20:28:23.759+0000 7efe5fde0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645481) UID: 0 2023-07-07T20:28:23.764 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T20:28:23.761+0000 7f5317f46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645481) UID: 0 2023-07-07T20:28:23.766 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T20:28:23.761+0000 7fb626ecc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645481) UID: 0 2023-07-07T20:28:23.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T20:28:23.761+0000 7f18a8cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 645481) UID: 0 2023-07-07T20:32:43.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:32:43.796 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:32:43.864 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T20:32:43.862+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118751) UID: 0 2023-07-07T20:32:43.865 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T20:32:43.862+0000 7fa834dc8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118751) UID: 0 2023-07-07T20:32:43.865 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T20:32:43.862+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118751) UID: 0 2023-07-07T20:32:43.866 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T20:32:43.864+0000 7f93a9f18700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118751) UID: 0 2023-07-07T20:32:44.078 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T20:32:44.074+0000 7f23f6e45700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 645552) UID: 0 2023-07-07T20:32:44.079 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T20:32:44.074+0000 7ff6efcfe700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 645552) UID: 0 2023-07-07T20:37:52.217 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:37:52.332 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:37:52.481 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T20:37:52.478+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118830) UID: 0 2023-07-07T20:37:52.482 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T20:37:52.478+0000 7f93a9f18700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118830) UID: 0 2023-07-07T20:37:52.482 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T20:37:52.478+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118830) UID: 0 2023-07-07T20:37:52.483 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T20:37:52.479+0000 7fa834dc8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118830) UID: 0 2023-07-07T20:41:30.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:41:30.727 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:42:00.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:42:00.881 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:42:30.985 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:42:30.988 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:43:01.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:43:01.176 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:43:01.373 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T20:43:01.371+0000 7f39bedbd700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118972) UID: 0 2023-07-07T20:43:01.373 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T20:43:01.372+0000 7f93a9f18700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118972) UID: 0 2023-07-07T20:43:01.377 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T20:43:01.371+0000 7f00d8e6d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118972) UID: 0 2023-07-07T20:43:01.377 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T20:43:01.371+0000 7fa834dc8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118972) UID: 0 2023-07-07T20:44:24.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T20:44:24.183+0000 7f189f0c5700 -1 bdev(0x55a3cfebe000 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-07-07T20:44:24.300 INFO:tasks.ceph.osd.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4477-g8e854f7d/rpm/el8/BUILD/ceph-18.0.0-4477-g8e854f7d/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f189f0c5700 time 2023-07-07T20:44:24.209435+0000 2023-07-07T20:44:24.300 INFO:tasks.ceph.osd.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4477-g8e854f7d/rpm/el8/BUILD/ceph-18.0.0-4477-g8e854f7d/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-07-07T20:44:24.301 INFO:tasks.ceph.osd.0.smithi012.stderr: ceph version 18.0.0-4477-g8e854f7d (8e854f7d61ef670caec08861f0f82587a7320e12) reef (dev) 2023-07-07T20:44:24.301 INFO:tasks.ceph.osd.0.smithi012.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55a3cbc30d03] 2023-07-07T20:44:24.301 INFO:tasks.ceph.osd.0.smithi012.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55a3cc843bb8] 2023-07-07T20:44:24.301 INFO:tasks.ceph.osd.0.smithi012.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a3cc846251] 2023-07-07T20:44:24.301 INFO:tasks.ceph.osd.0.smithi012.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f18b13eb1cf] 2023-07-07T20:44:24.301 INFO:tasks.ceph.osd.0.smithi012.stderr: 5: clone() 2023-07-07T20:44:24.301 INFO:tasks.ceph.osd.0.smithi012.stderr:*** Caught signal (Aborted) ** 2023-07-07T20:44:24.302 INFO:tasks.ceph.osd.0.smithi012.stderr: in thread 7f189f0c5700 thread_name:bstore_aio 2023-07-07T20:44:24.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T20:44:24.297+0000 7f189f0c5700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4477-g8e854f7d/rpm/el8/BUILD/ceph-18.0.0-4477-g8e854f7d/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f189f0c5700 time 2023-07-07T20:44:24.209435+0000 2023-07-07T20:44:24.302 INFO:tasks.ceph.osd.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4477-g8e854f7d/rpm/el8/BUILD/ceph-18.0.0-4477-g8e854f7d/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-07-07T20:44:24.302 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.302 INFO:tasks.ceph.osd.0.smithi012.stderr: ceph version 18.0.0-4477-g8e854f7d (8e854f7d61ef670caec08861f0f82587a7320e12) reef (dev) 2023-07-07T20:44:24.302 INFO:tasks.ceph.osd.0.smithi012.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55a3cbc30d03] 2023-07-07T20:44:24.302 INFO:tasks.ceph.osd.0.smithi012.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55a3cc843bb8] 2023-07-07T20:44:24.302 INFO:tasks.ceph.osd.0.smithi012.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a3cc846251] 2023-07-07T20:44:24.303 INFO:tasks.ceph.osd.0.smithi012.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f18b13eb1cf] 2023-07-07T20:44:24.303 INFO:tasks.ceph.osd.0.smithi012.stderr: 5: clone() 2023-07-07T20:44:24.303 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.319 INFO:tasks.ceph.osd.0.smithi012.stderr: ceph version 18.0.0-4477-g8e854f7d (8e854f7d61ef670caec08861f0f82587a7320e12) reef (dev) 2023-07-07T20:44:24.320 INFO:tasks.ceph.osd.0.smithi012.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f18b13f5ce0] 2023-07-07T20:44:24.320 INFO:tasks.ceph.osd.0.smithi012.stderr: 2: gsignal() 2023-07-07T20:44:24.320 INFO:tasks.ceph.osd.0.smithi012.stderr: 3: abort() 2023-07-07T20:44:24.320 INFO:tasks.ceph.osd.0.smithi012.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55a3cbc30dc3] 2023-07-07T20:44:24.320 INFO:tasks.ceph.osd.0.smithi012.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x55a3cc843bb8] 2023-07-07T20:44:24.320 INFO:tasks.ceph.osd.0.smithi012.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a3cc846251] 2023-07-07T20:44:24.321 INFO:tasks.ceph.osd.0.smithi012.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f18b13eb1cf] 2023-07-07T20:44:24.321 INFO:tasks.ceph.osd.0.smithi012.stderr: 8: clone() 2023-07-07T20:44:24.349 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-07-07T20:44:24.346+0000 7f189f0c5700 -1 *** Caught signal (Aborted) ** 2023-07-07T20:44:24.350 INFO:tasks.ceph.osd.0.smithi012.stderr: in thread 7f189f0c5700 thread_name:bstore_aio 2023-07-07T20:44:24.350 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.350 INFO:tasks.ceph.osd.0.smithi012.stderr: ceph version 18.0.0-4477-g8e854f7d (8e854f7d61ef670caec08861f0f82587a7320e12) reef (dev) 2023-07-07T20:44:24.350 INFO:tasks.ceph.osd.0.smithi012.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f18b13f5ce0] 2023-07-07T20:44:24.350 INFO:tasks.ceph.osd.0.smithi012.stderr: 2: gsignal() 2023-07-07T20:44:24.350 INFO:tasks.ceph.osd.0.smithi012.stderr: 3: abort() 2023-07-07T20:44:24.350 INFO:tasks.ceph.osd.0.smithi012.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55a3cbc30dc3] 2023-07-07T20:44:24.351 INFO:tasks.ceph.osd.0.smithi012.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x55a3cc843bb8] 2023-07-07T20:44:24.351 INFO:tasks.ceph.osd.0.smithi012.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a3cc846251] 2023-07-07T20:44:24.351 INFO:tasks.ceph.osd.0.smithi012.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f18b13eb1cf] 2023-07-07T20:44:24.351 INFO:tasks.ceph.osd.0.smithi012.stderr: 8: clone() 2023-07-07T20:44:24.351 INFO:tasks.ceph.osd.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-07T20:44:24.351 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.361 INFO:tasks.ceph.osd.0.smithi012.stderr: -5841> 2023-07-07T20:44:24.183+0000 7f189f0c5700 -1 bdev(0x55a3cfebe000 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-07-07T20:44:24.373 INFO:tasks.ceph.osd.0.smithi012.stderr: -1925> 2023-07-07T20:44:24.297+0000 7f189f0c5700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4477-g8e854f7d/rpm/el8/BUILD/ceph-18.0.0-4477-g8e854f7d/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f189f0c5700 time 2023-07-07T20:44:24.209435+0000 2023-07-07T20:44:24.373 INFO:tasks.ceph.osd.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4477-g8e854f7d/rpm/el8/BUILD/ceph-18.0.0-4477-g8e854f7d/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-07-07T20:44:24.374 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.374 INFO:tasks.ceph.osd.0.smithi012.stderr: ceph version 18.0.0-4477-g8e854f7d (8e854f7d61ef670caec08861f0f82587a7320e12) reef (dev) 2023-07-07T20:44:24.374 INFO:tasks.ceph.osd.0.smithi012.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55a3cbc30d03] 2023-07-07T20:44:24.374 INFO:tasks.ceph.osd.0.smithi012.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55a3cc843bb8] 2023-07-07T20:44:24.374 INFO:tasks.ceph.osd.0.smithi012.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a3cc846251] 2023-07-07T20:44:24.374 INFO:tasks.ceph.osd.0.smithi012.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f18b13eb1cf] 2023-07-07T20:44:24.374 INFO:tasks.ceph.osd.0.smithi012.stderr: 5: clone() 2023-07-07T20:44:24.375 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.375 INFO:tasks.ceph.osd.0.smithi012.stderr: 0> 2023-07-07T20:44:24.346+0000 7f189f0c5700 -1 *** Caught signal (Aborted) ** 2023-07-07T20:44:24.375 INFO:tasks.ceph.osd.0.smithi012.stderr: in thread 7f189f0c5700 thread_name:bstore_aio 2023-07-07T20:44:24.375 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.375 INFO:tasks.ceph.osd.0.smithi012.stderr: ceph version 18.0.0-4477-g8e854f7d (8e854f7d61ef670caec08861f0f82587a7320e12) reef (dev) 2023-07-07T20:44:24.375 INFO:tasks.ceph.osd.0.smithi012.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f18b13f5ce0] 2023-07-07T20:44:24.375 INFO:tasks.ceph.osd.0.smithi012.stderr: 2: gsignal() 2023-07-07T20:44:24.376 INFO:tasks.ceph.osd.0.smithi012.stderr: 3: abort() 2023-07-07T20:44:24.376 INFO:tasks.ceph.osd.0.smithi012.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55a3cbc30dc3] 2023-07-07T20:44:24.376 INFO:tasks.ceph.osd.0.smithi012.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x55a3cc843bb8] 2023-07-07T20:44:24.376 INFO:tasks.ceph.osd.0.smithi012.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a3cc846251] 2023-07-07T20:44:24.376 INFO:tasks.ceph.osd.0.smithi012.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f18b13eb1cf] 2023-07-07T20:44:24.376 INFO:tasks.ceph.osd.0.smithi012.stderr: 8: clone() 2023-07-07T20:44:24.376 INFO:tasks.ceph.osd.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-07T20:44:24.377 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.390 INFO:tasks.ceph.osd.0.smithi012.stderr: -6842> 2023-07-07T20:44:24.183+0000 7f189f0c5700 -1 bdev(0x55a3cfebe000 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-07-07T20:44:24.394 INFO:tasks.ceph.osd.0.smithi012.stderr: -2926> 2023-07-07T20:44:24.297+0000 7f189f0c5700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4477-g8e854f7d/rpm/el8/BUILD/ceph-18.0.0-4477-g8e854f7d/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f189f0c5700 time 2023-07-07T20:44:24.209435+0000 2023-07-07T20:44:24.394 INFO:tasks.ceph.osd.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4477-g8e854f7d/rpm/el8/BUILD/ceph-18.0.0-4477-g8e854f7d/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-07-07T20:44:24.395 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.395 INFO:tasks.ceph.osd.0.smithi012.stderr: ceph version 18.0.0-4477-g8e854f7d (8e854f7d61ef670caec08861f0f82587a7320e12) reef (dev) 2023-07-07T20:44:24.395 INFO:tasks.ceph.osd.0.smithi012.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55a3cbc30d03] 2023-07-07T20:44:24.395 INFO:tasks.ceph.osd.0.smithi012.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x55a3cc843bb8] 2023-07-07T20:44:24.395 INFO:tasks.ceph.osd.0.smithi012.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a3cc846251] 2023-07-07T20:44:24.395 INFO:tasks.ceph.osd.0.smithi012.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f18b13eb1cf] 2023-07-07T20:44:24.395 INFO:tasks.ceph.osd.0.smithi012.stderr: 5: clone() 2023-07-07T20:44:24.396 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.396 INFO:tasks.ceph.osd.0.smithi012.stderr: -1001> 2023-07-07T20:44:24.346+0000 7f189f0c5700 -1 *** Caught signal (Aborted) ** 2023-07-07T20:44:24.396 INFO:tasks.ceph.osd.0.smithi012.stderr: in thread 7f189f0c5700 thread_name:bstore_aio 2023-07-07T20:44:24.396 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.396 INFO:tasks.ceph.osd.0.smithi012.stderr: ceph version 18.0.0-4477-g8e854f7d (8e854f7d61ef670caec08861f0f82587a7320e12) reef (dev) 2023-07-07T20:44:24.397 INFO:tasks.ceph.osd.0.smithi012.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f18b13f5ce0] 2023-07-07T20:44:24.397 INFO:tasks.ceph.osd.0.smithi012.stderr: 2: gsignal() 2023-07-07T20:44:24.397 INFO:tasks.ceph.osd.0.smithi012.stderr: 3: abort() 2023-07-07T20:44:24.397 INFO:tasks.ceph.osd.0.smithi012.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55a3cbc30dc3] 2023-07-07T20:44:24.397 INFO:tasks.ceph.osd.0.smithi012.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x55a3cc843bb8] 2023-07-07T20:44:24.397 INFO:tasks.ceph.osd.0.smithi012.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a3cc846251] 2023-07-07T20:44:24.397 INFO:tasks.ceph.osd.0.smithi012.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f18b13eb1cf] 2023-07-07T20:44:24.397 INFO:tasks.ceph.osd.0.smithi012.stderr: 8: clone() 2023-07-07T20:44:24.398 INFO:tasks.ceph.osd.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-07T20:44:24.398 INFO:tasks.ceph.osd.0.smithi012.stderr: 2023-07-07T20:44:24.648 INFO:tasks.ceph.osd.0.smithi012.stderr:daemon-helper: command failed with exit status 5 2023-07-07T20:44:32.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-07-07T20:44:39.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~7s 2023-07-07T20:44:46.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~13s 2023-07-07T20:44:52.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-07-07T20:44:59.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~26s 2023-07-07T20:45:05.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~33s 2023-07-07T20:45:12.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2023-07-07T20:45:19.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2023-07-07T20:45:25.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2023-07-07T20:45:32.353 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2023-07-07T20:45:38.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~66s 2023-07-07T20:45:45.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~73s 2023-07-07T20:45:52.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~79s 2023-07-07T20:45:58.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~86s 2023-07-07T20:46:05.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2023-07-07T20:46:11.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2023-07-07T20:46:18.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2023-07-07T20:46:25.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~112s 2023-07-07T20:46:31.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~119s 2023-07-07T20:46:38.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~126s 2023-07-07T20:46:43.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:46:43.825 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:46:44.425 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T20:46:44.423+0000 7f23f6e45700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 645817) UID: 0 2023-07-07T20:46:44.426 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T20:46:44.423+0000 7ff6efcfe700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 645817) UID: 0 2023-07-07T20:46:45.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~132s 2023-07-07T20:46:51.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~139s 2023-07-07T20:46:58.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2023-07-07T20:47:04.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~152s 2023-07-07T20:47:11.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~159s 2023-07-07T20:47:18.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2023-07-07T20:47:24.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~172s 2023-07-07T20:47:31.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~178s 2023-07-07T20:47:37.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2023-07-07T20:47:44.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~192s 2023-07-07T20:47:51.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~198s 2023-07-07T20:47:57.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2023-07-07T20:48:04.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~211s 2023-07-07T20:48:05.691 INFO:teuthology.orchestra.run.smithi012.stdout:generic/476 3878s 2023-07-07T20:48:05.751 INFO:teuthology.orchestra.run.smithi012.stdout:Ran: generic/476 2023-07-07T20:48:05.751 INFO:teuthology.orchestra.run.smithi012.stdout:Passed all 1 tests 2023-07-07T20:48:05.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T20:48:05.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T20:48:05.778 DEBUG:teuthology.orchestra.run.smithi012:> (cd /tmp/tmp.XqO9xwZcsPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-07-07T20:48:10.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~218s 2023-07-07T20:48:17.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2023-07-07T20:48:18.494 INFO:teuthology.orchestra.run.smithi012.stdout:FSTYP -- ceph 2023-07-07T20:48:18.499 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM -- Linux/x86_64 smithi012 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T20:48:18.499 INFO:teuthology.orchestra.run.smithi012.stdout:MKFS_OPTIONS -- 172.21.15.12:6789:/scratch 2023-07-07T20:48:18.500 INFO:teuthology.orchestra.run.smithi012.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDaVahkRY9UFhAA8kq2j6OFa5euKxFSIe8Jqg== -o context=system_u:object_r:root_t:s0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch 2023-07-07T20:48:18.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T20:48:24.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~231s 2023-07-07T20:48:30.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~238s 2023-07-07T20:48:37.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~244s 2023-07-07T20:48:43.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~251s 2023-07-07T20:48:50.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~258s 2023-07-07T20:48:57.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~264s 2023-07-07T20:49:03.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~271s 2023-07-07T20:49:10.418 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~278s 2023-07-07T20:49:17.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~284s 2023-07-07T20:49:23.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~291s 2023-07-07T20:49:30.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~297s 2023-07-07T20:49:36.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~304s 2023-07-07T20:49:36.848 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-07-07T20:49:36.848 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T20:49:36.849 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T20:49:36.900 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T20:49:36.900 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T20:49:36.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T20:49:37.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.732+0000 7ff4f50da700 1 Processor -- start 2023-07-07T20:49:37.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.732+0000 7ff4f50da700 1 -- start start 2023-07-07T20:49:37.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.733+0000 7ff4f50da700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4f00ae6c0 0x7ff4f015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.733+0000 7ff4f50da700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 0x7ff4f00714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.733+0000 7ff4f50da700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f00af090 con 0x7ff4f00cddd0 2023-07-07T20:49:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.733+0000 7ff4f50da700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00cdc80 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.733+0000 7ff4f50da700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f015d6a0 con 0x7ff4f00aec10 2023-07-07T20:49:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.733+0000 7ff4eed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff4f00cddd0 0x7ff4f00ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37738/0 (socket says 172.21.15.12:37738) 2023-07-07T20:49:37.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.733+0000 7ff4eed9d700 1 -- 172.21.15.12:0/786245272 learned_addr learned my addr 172.21.15.12:0/786245272 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T20:49:37.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.733+0000 7ff4ee59c700 1 --2- 172.21.15.12:0/786245272 >> v2:172.21.15.12:3300/0 conn(0x7ff4f00ae6c0 0x7ff4f015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:37.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.733+0000 7ff4ef59e700 1 --2- 172.21.15.12:0/786245272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 0x7ff4f00714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:37.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.734+0000 7ff4ee59c700 1 -- 172.21.15.12:0/786245272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 msgr2=0x7ff4f00714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T20:49:37.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.734+0000 7ff4ee59c700 1 --2- 172.21.15.12:0/786245272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 0x7ff4f00714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:37.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.734+0000 7ff4ee59c700 1 -- 172.21.15.12:0/786245272 >> v1:172.21.15.12:6789/0 conn(0x7ff4f00cddd0 legacy=0x7ff4f00ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:37.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.734+0000 7ff4ee59c700 1 -- 172.21.15.12:0/786245272 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0159700 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.734+0000 7ff4edd9b700 1 -- 172.21.15.12:0/786245272 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068350601 0 0) 0x7ff4f00af090 con 0x7ff4f00cddd0 2023-07-07T20:49:37.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.743+0000 7ff4ee59c700 1 --2- 172.21.15.12:0/786245272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 0x7ff4f015a1e0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009840 tx=0x7ff4e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d00f4ca7f94908 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:37.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.745+0000 7ff4edd9b700 1 -- 172.21.15.12:0/786245272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011830 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.745+0000 7ff4edd9b700 1 -- 172.21.15.12:0/786245272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e4011990 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.745+0000 7ff4edd9b700 1 -- 172.21.15.12:0/786245272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011d20 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.746+0000 7ff4f50da700 1 -- 172.21.15.12:0/786245272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 msgr2=0x7ff4f015a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:37.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.746+0000 7ff4f50da700 1 --2- 172.21.15.12:0/786245272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 0x7ff4f015a1e0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009840 tx=0x7ff4e4009b50 comp rx=0 tx=0).stop 2023-07-07T20:49:37.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.746+0000 7ff4f50da700 1 -- 172.21.15.12:0/786245272 shutdown_connections 2023-07-07T20:49:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.746+0000 7ff4f50da700 1 --2- 172.21.15.12:0/786245272 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 0x7ff4f00714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.746+0000 7ff4f50da700 1 --2- 172.21.15.12:0/786245272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 0x7ff4f015a1e0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.746+0000 7ff4f50da700 1 -- 172.21.15.12:0/786245272 >> 172.21.15.12:0/786245272 conn(0x7ff4f006d4a0 msgr2=0x7ff4f006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:37.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.751+0000 7ff4f50da700 1 -- 172.21.15.12:0/786245272 shutdown_connections 2023-07-07T20:49:37.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.751+0000 7ff4f50da700 1 -- 172.21.15.12:0/786245272 wait complete. 2023-07-07T20:49:37.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.753+0000 7ff4f50da700 1 Processor -- start 2023-07-07T20:49:37.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.753+0000 7ff4f50da700 1 -- start start 2023-07-07T20:49:37.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.754+0000 7ff4f50da700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 0x7ff4f015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:37.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.754+0000 7ff4f50da700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 0x7ff4f015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:37.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.754+0000 7ff4f50da700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f00cddd0 0x7ff4f00b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:37.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.754+0000 7ff4f50da700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00b4320 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.754+0000 7ff4f50da700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c76f0 con 0x7ff4f00cddd0 2023-07-07T20:49:37.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.754+0000 7ff4f50da700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c7990 con 0x7ff4f00aec10 2023-07-07T20:49:37.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4eed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 0x7ff4f015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:37.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4ee59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 0x7ff4f015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4ee59c700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 0x7ff4f015b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:57870/0 (socket says 172.21.15.12:57870) 2023-07-07T20:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4eed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 0x7ff4f015b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40546/0 (socket says 172.21.15.12:40546) 2023-07-07T20:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4ee59c700 1 -- 172.21.15.12:0/2782827270 learned_addr learned my addr 172.21.15.12:0/2782827270 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T20:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4eed9d700 1 -- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 msgr2=0x7ff4f015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4eed9d700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 0x7ff4f015b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4eed9d700 1 -- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f00cddd0 msgr2=0x7ff4f00b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4eed9d700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f00cddd0 0x7ff4f00b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4eed9d700 1 -- 172.21.15.12:0/2782827270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e40094a0 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4eed9d700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 0x7ff4f015b080 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c4b0 tx=0x7ff4e000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4d77fe700 1 -- 172.21.15.12:0/2782827270 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0004c80 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.755+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f00c7c70 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.756+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f00c8230 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.756+0000 7ff4d77fe700 1 -- 172.21.15.12:0/2782827270 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e0004de0 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.756+0000 7ff4d77fe700 1 -- 172.21.15.12:0/2782827270 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00072d0 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.757+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d00052f0 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.758+0000 7ff4d77fe700 1 -- 172.21.15.12:0/2782827270 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4e0007430 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.759+0000 7ff4d77fe700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4dc06ace0 0x7ff4dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:37.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.759+0000 7ff4d77fe700 1 -- 172.21.15.12:0/2782827270 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff4e0089060 con 0x7ff4f00ae6c0 2023-07-07T20:49:37.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.759+0000 7ff4ee59c700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4dc06ace0 0x7ff4dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:37.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.760+0000 7ff4ee59c700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4dc06ace0 0x7ff4dc06d190 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009b90 tx=0x7ff4e401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:37.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:37.787+0000 7ff4d77fe700 1 -- 172.21.15.12:0/2782827270 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff4e0053fd0 con 0x7ff4f00ae6c0 2023-07-07T20:49:38.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.135+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4d0005870 con 0x7ff4f00ae6c0 2023-07-07T20:49:38.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.138+0000 7ff4d77fe700 1 -- 172.21.15.12:0/2782827270 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+18709 (secure 0 0 0) 0x7ff4e00575f0 con 0x7ff4f00ae6c0 2023-07-07T20:49:38.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-07-07T20:49:38.148 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":48,"fsid":"6f09c1a9-a759-4e94-bed7-68b16c28b7f9","created":"2023-07-07T18:14:20.906791+0000","modified":"2023-07-07T20:44:25.871097+0000","last_up_change":"2023-07-07T20:44:24.822984+0000","last_in_change":"2023-07-07T18:14:23.454825+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-07T18:14:32.644063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.690000057220459,"score_stable":7.690000057220459,"optimal_score":0.12999999523162842,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-07T18:14:39.443910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":0.75,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-07T18:16:07.998152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-07T18:16:09.313570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.1099998950958252,"score_stable":2.1099998950958252,"optimal_score":0.87999999523162842,"raw_score_acting":1.8600000143051147,"raw_score_stable":1.8600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f33734e-017d-4614-b88b-df0cb9c4af35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":47,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6809","nonce":1157853369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6811","nonce":1157853369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6815","nonce":1157853369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":1157853369},{"type":"v1","addr":"172.21.15.12:6813","nonce":1157853369}]},"public_addr":"172.21.15.12:6809/1157853369","cluster_addr":"172.21.15.12:6811/1157853369","heartbeat_back_addr":"172.21.15.12:6815/1157853369","heartbeat_front_addr":"172.21.15.12:6813/1157853369","state":["exists"]},{"osd":1,"uuid":"05872099-8d4c-4dff-9448-bda38b002ab7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6801","nonce":4008469182}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6803","nonce":4008469182}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6807","nonce":4008469182}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":4008469182},{"type":"v1","addr":"172.21.15.12:6805","nonce":4008469182}]},"public_addr":"172.21.15.12:6801/4008469182","cluster_addr":"172.21.15.12:6803/4008469182","heartbeat_back_addr":"172.21.15.12:6807/4008469182","heartbeat_front_addr":"172.21.15.12:6805/4008469182","state":["exists","up"]},{"osd":2,"uuid":"4d42dfd6-cf7c-4309-82e0-bba598ca05b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6817","nonce":2583051658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6819","nonce":2583051658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6826","nonce":2583051658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":2583051658},{"type":"v1","addr":"172.21.15.12:6823","nonce":2583051658}]},"public_addr":"172.21.15.12:6817/2583051658","cluster_addr":"172.21.15.12:6819/2583051658","heartbeat_back_addr":"172.21.15.12:6826/2583051658","heartbeat_front_addr":"172.21.15.12:6823/2583051658","state":["exists","up"]},{"osd":3,"uuid":"55dc08a3-2854-40d6-9e14-5c45ef4ec196","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6822","nonce":3873602064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6827","nonce":3873602064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6831","nonce":3873602064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":3873602064},{"type":"v1","addr":"172.21.15.12:6829","nonce":3873602064}]},"public_addr":"172.21.15.12:6822/3873602064","cluster_addr":"172.21.15.12:6827/3873602064","heartbeat_back_addr":"172.21.15.12:6831/3873602064","heartbeat_front_addr":"172.21.15.12:6829/3873602064","state":["exists","up"]},{"osd":4,"uuid":"19aa8797-5779-45f0-8cfe-b8c96521e2f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6817","nonce":3085703848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6819","nonce":3085703848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6823","nonce":3085703848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":3085703848},{"type":"v1","addr":"172.21.15.160:6821","nonce":3085703848}]},"public_addr":"172.21.15.160:6817/3085703848","cluster_addr":"172.21.15.160:6819/3085703848","heartbeat_back_addr":"172.21.15.160:6823/3085703848","heartbeat_front_addr":"172.21.15.160:6821/3085703848","state":["exists","up"]},{"osd":5,"uuid":"53b5cbc4-0849-45a7-9c3a-c4c841875a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6809","nonce":1176835465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6811","nonce":1176835465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6815","nonce":1176835465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":1176835465},{"type":"v1","addr":"172.21.15.160:6813","nonce":1176835465}]},"public_addr":"172.21.15.160:6809/1176835465","cluster_addr":"172.21.15.160:6811/1176835465","heartbeat_back_addr":"172.21.15.160:6815/1176835465","heartbeat_front_addr":"172.21.15.160:6813/1176835465","state":["exists","up"]},{"osd":6,"uuid":"fbf4e9fa-08da-4210-886f-edb3eeeb6d68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6801","nonce":458823933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6803","nonce":458823933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6807","nonce":458823933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":458823933},{"type":"v1","addr":"172.21.15.160:6805","nonce":458823933}]},"public_addr":"172.21.15.160:6801/458823933","cluster_addr":"172.21.15.160:6803/458823933","heartbeat_back_addr":"172.21.15.160:6807/458823933","heartbeat_front_addr":"172.21.15.160:6805/458823933","state":["exists","up"]},{"osd":7,"uuid":"c6a7c666-1fce-4dd2-934e-9fb7efa12276","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6825","nonce":3768638094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6827","nonce":3768638094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6831","nonce":3768638094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3768638094},{"type":"v1","addr":"172.21.15.160:6829","nonce":3768638094}]},"public_addr":"172.21.15.160:6825/3768638094","cluster_addr":"172.21.15.160:6827/3768638094","heartbeat_back_addr":"172.21.15.160:6831/3768638094","heartbeat_front_addr":"172.21.15.160:6829/3768638094","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.580698+0000","dead_epoch":47},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.347633+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.625985+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.622191+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.734605+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.608279+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.598283+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-07T18:14:28.761220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.2e","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T20:49:38.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4dc06ace0 msgr2=0x7ff4dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:38.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4dc06ace0 0x7ff4dc06d190 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4009b90 tx=0x7ff4e401c040 comp rx=0 tx=0).stop 2023-07-07T20:49:38.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 msgr2=0x7ff4f015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:38.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 0x7ff4f015b080 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c4b0 tx=0x7ff4e000c7c0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 shutdown_connections 2023-07-07T20:49:38.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7ff4dc06ace0 0x7ff4dc06d190 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4f00cddd0 0x7ff4f00b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4f00ae6c0 0x7ff4f015b080 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 --2- 172.21.15.12:0/2782827270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff4f00aec10 0x7ff4f015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.147+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 >> 172.21.15.12:0/2782827270 conn(0x7ff4f006d4a0 msgr2=0x7ff4f0155460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:38.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.148+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 shutdown_connections 2023-07-07T20:49:38.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.148+0000 7ff4f50da700 1 -- 172.21.15.12:0/2782827270 wait complete. 2023-07-07T20:49:38.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-07T18:14:32.644063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-07T18:14:39.443910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-07T18:16:07.998152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-07T18:16:09.313570+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.109999895095825, 'score_stable': 2.109999895095825, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.8600000143051147, 'raw_score_stable': 1.8600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-07T20:49:38.171 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T20:49:38.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.376+0000 7fac69e95700 1 Processor -- start 2023-07-07T20:49:38.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.376+0000 7fac69e95700 1 -- start start 2023-07-07T20:49:38.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac69e95700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac6406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:38.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac69e95700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fac6406aa00 0x7fac6406d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:38.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac69e95700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac64070510 con 0x7fac641587b0 2023-07-07T20:49:38.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac69e95700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac640710b0 con 0x7fac6406aa00 2023-07-07T20:49:38.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac69e95700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac640cb460 con 0x7fac640caef0 2023-07-07T20:49:38.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac62ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac6406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:38.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac63fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fac6406aa00 0x7fac6406d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:38.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac63fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fac6406aa00 0x7fac6406d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:36164/0 (socket says 172.21.15.12:36164) 2023-07-07T20:49:38.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac637fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fac641587b0 0x7fac640709a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:59224/0 (socket says 172.21.15.12:59224) 2023-07-07T20:49:38.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac62ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac6406cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:57878/0 (socket says 172.21.15.12:57878) 2023-07-07T20:49:38.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.377+0000 7fac63fff700 1 -- 172.21.15.12:0/3458548337 learned_addr learned my addr 172.21.15.12:0/3458548337 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T20:49:38.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.378+0000 7fac63fff700 1 -- 172.21.15.12:0/3458548337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 msgr2=0x7fac6406cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T20:49:38.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.378+0000 7fac63fff700 1 --2- 172.21.15.12:0/3458548337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac6406cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.378+0000 7fac63fff700 1 -- 172.21.15.12:0/3458548337 >> v1:172.21.15.160:6789/0 conn(0x7fac641587b0 legacy=0x7fac640709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:38.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.378+0000 7fac63fff700 1 -- 172.21.15.12:0/3458548337 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac640cb740 con 0x7fac6406aa00 2023-07-07T20:49:38.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.378+0000 7fac63fff700 1 --2- 172.21.15.12:0/3458548337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6406aa00 0x7fac6406d240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fac540098f0 tx=0x7fac54009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2e5f99b65377e25 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:38.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.382+0000 7fac627fc700 1 -- 172.21.15.12:0/3458548337 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54011830 con 0x7fac6406aa00 2023-07-07T20:49:38.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.382+0000 7fac627fc700 1 -- 172.21.15.12:0/3458548337 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac54011990 con 0x7fac6406aa00 2023-07-07T20:49:38.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.382+0000 7fac627fc700 1 -- 172.21.15.12:0/3458548337 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac54011d20 con 0x7fac6406aa00 2023-07-07T20:49:38.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.385+0000 7fac69e95700 1 -- 172.21.15.12:0/3458548337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6406aa00 msgr2=0x7fac6406d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:38.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.385+0000 7fac69e95700 1 --2- 172.21.15.12:0/3458548337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6406aa00 0x7fac6406d240 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fac540098f0 tx=0x7fac54009c00 comp rx=0 tx=0).stop 2023-07-07T20:49:38.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.385+0000 7fac69e95700 1 -- 172.21.15.12:0/3458548337 shutdown_connections 2023-07-07T20:49:38.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.385+0000 7fac69e95700 1 --2- 172.21.15.12:0/3458548337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6406aa00 0x7fac6406d240 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.386+0000 7fac69e95700 1 --2- 172.21.15.12:0/3458548337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac6406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.386+0000 7fac69e95700 1 -- 172.21.15.12:0/3458548337 >> 172.21.15.12:0/3458548337 conn(0x7fac64069ef0 msgr2=0x7fac6406a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:38.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.389+0000 7fac69e95700 1 -- 172.21.15.12:0/3458548337 shutdown_connections 2023-07-07T20:49:38.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.390+0000 7fac69e95700 1 -- 172.21.15.12:0/3458548337 wait complete. 2023-07-07T20:49:38.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.391+0000 7fac69e95700 1 Processor -- start 2023-07-07T20:49:38.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.392+0000 7fac69e95700 1 -- start start 2023-07-07T20:49:38.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.392+0000 7fac69e95700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac6406aa00 0x7fac64158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:38.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.392+0000 7fac69e95700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac641f3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:38.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.392+0000 7fac69e95700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac641587b0 0x7fac641f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:38.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.392+0000 7fac69e95700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac641f3bc0 con 0x7fac6406aa00 2023-07-07T20:49:38.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.392+0000 7fac69e95700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac641593c0 con 0x7fac641587b0 2023-07-07T20:49:38.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.392+0000 7fac69e95700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac641596a0 con 0x7fac640caef0 2023-07-07T20:49:38.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.393+0000 7fac62ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac641f3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:38.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.393+0000 7fac62ffd700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac641f3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.12:57882/0 (socket says 172.21.15.12:57882) 2023-07-07T20:49:38.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.393+0000 7fac62ffd700 1 -- 172.21.15.12:0/465454418 learned_addr learned my addr 172.21.15.12:0/465454418 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T20:49:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.393+0000 7fac62ffd700 1 -- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac641587b0 msgr2=0x7fac641f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.393+0000 7fac62ffd700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac641587b0 0x7fac641f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.393+0000 7fac62ffd700 1 -- 172.21.15.12:0/465454418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac6406aa00 msgr2=0x7fac64158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.393+0000 7fac62ffd700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac6406aa00 0x7fac64158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.393+0000 7fac62ffd700 1 -- 172.21.15.12:0/465454418 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac54009550 con 0x7fac640caef0 2023-07-07T20:49:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.394+0000 7fac62ffd700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac641f3680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac5800e960 tx=0x7fac5800ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.394+0000 7fac4bfff700 1 -- 172.21.15.12:0/465454418 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac58009690 con 0x7fac640caef0 2023-07-07T20:49:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.394+0000 7fac4bfff700 1 -- 172.21.15.12:0/465454418 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5800c7d0 con 0x7fac640caef0 2023-07-07T20:49:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.394+0000 7fac4bfff700 1 -- 172.21.15.12:0/465454418 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800cb40 con 0x7fac640caef0 2023-07-07T20:49:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.395+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac64159980 con 0x7fac640caef0 2023-07-07T20:49:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.395+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac64159f40 con 0x7fac640caef0 2023-07-07T20:49:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.396+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6415a160 con 0x7fac640caef0 2023-07-07T20:49:38.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.404+0000 7fac4bfff700 1 -- 172.21.15.12:0/465454418 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac5800cca0 con 0x7fac640caef0 2023-07-07T20:49:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.404+0000 7fac4bfff700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac5006ace0 0x7fac5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.404+0000 7fac4bfff700 1 -- 172.21.15.12:0/465454418 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fac58089d60 con 0x7fac640caef0 2023-07-07T20:49:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.405+0000 7fac637fe700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac5006ace0 0x7fac5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:38.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.405+0000 7fac637fe700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac5006ace0 0x7fac5006d190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0012e0 tx=0x7fac5c001640 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:38.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.411+0000 7fac4bfff700 1 -- 172.21.15.12:0/465454418 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fac58054d70 con 0x7fac640caef0 2023-07-07T20:49:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.733+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac6404ea20 con 0x7fac640caef0 2023-07-07T20:49:38.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.734+0000 7fac4bfff700 1 -- 172.21.15.12:0/465454418 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac58058390 con 0x7fac640caef0 2023-07-07T20:49:38.737 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-07-07T20:49:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac5006ace0 msgr2=0x7fac5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac5006ace0 0x7fac5006d190 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0012e0 tx=0x7fac5c001640 comp rx=0 tx=0).stop 2023-07-07T20:49:38.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 msgr2=0x7fac641f3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac641f3680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac5800e960 tx=0x7fac5800ed20 comp rx=0 tx=0).stop 2023-07-07T20:49:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 shutdown_connections 2023-07-07T20:49:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fac5006ace0 0x7fac5006d190 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac641587b0 0x7fac641f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac6406aa00 0x7fac64158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 --2- 172.21.15.12:0/465454418 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac640caef0 0x7fac641f3680 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fac5800e960 tx=0x7fac5800ed20 comp rx=0 tx=0).stop 2023-07-07T20:49:38.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.738+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 >> 172.21.15.12:0/465454418 conn(0x7fac64069ef0 msgr2=0x7fac640cc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.740+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 shutdown_connections 2023-07-07T20:49:38.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:38.740+0000 7fac69e95700 1 -- 172.21.15.12:0/465454418 wait complete. 2023-07-07T20:49:38.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T20:49:39.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.002+0000 7f75e3745700 1 Processor -- start 2023-07-07T20:49:39.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.002+0000 7f75e3745700 1 -- start start 2023-07-07T20:49:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.003+0000 7f75e3745700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f75dc06e4d0 0x7f75dc0ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.003+0000 7f75e3745700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc06e8f0 con 0x7f75dc0cd5e0 2023-07-07T20:49:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.003+0000 7f75e3745700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc06f0e0 con 0x7f75dc06e030 2023-07-07T20:49:39.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.003+0000 7f75e3745700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75dc0ce2c0 con 0x7f75dc06e4d0 2023-07-07T20:49:39.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.003+0000 7f75e14e1700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f75dc0cd5e0 0x7f75dc0cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37766/0 (socket says 172.21.15.12:37766) 2023-07-07T20:49:39.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.003+0000 7f75e14e1700 1 -- 172.21.15.12:0/296076151 learned_addr learned my addr 172.21.15.12:0/296076151 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T20:49:39.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.003+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724634611 0 0) 0x7f75dc06e8f0 con 0x7f75dc0cd5e0 2023-07-07T20:49:39.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.003+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75c80035b0 con 0x7f75dc0cd5e0 2023-07-07T20:49:39.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 <== mon.1 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891604071 0 0) 0x7f75dc06f0e0 con 0x7f75dc06e030 2023-07-07T20:49:39.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75dc06e8f0 con 0x7f75dc06e030 2023-07-07T20:49:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1046499977 0 0) 0x7f75c80035b0 con 0x7f75dc0cd5e0 2023-07-07T20:49:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 >> v2:172.21.15.160:3300/0 conn(0x7f75dc06e4d0 msgr2=0x7f75dc0ad640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-07T20:49:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 --2- 172.21.15.12:0/296076151 >> v2:172.21.15.160:3300/0 conn(0x7f75dc06e4d0 0x7f75dc0ad640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 >> v1:172.21.15.160:6789/0 conn(0x7f75dc06e030 legacy=0x7f75dc0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc06eb20 con 0x7f75dc0cd5e0 2023-07-07T20:49:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2044855800 0 0) 0x7f75cc0017f0 con 0x7f75dc0cd5e0 2023-07-07T20:49:39.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 >> v1:172.21.15.12:6789/0 conn(0x7f75dc0cd5e0 legacy=0x7f75dc0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c8003b90 0x7f75c8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c8004850 0x7f75c8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75c8005350 0x7f75c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0ce2c0 con 0x7f75c8004850 2023-07-07T20:49:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c800c280 con 0x7f75c8005350 2023-07-07T20:49:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c800c440 con 0x7f75c8003b90 2023-07-07T20:49:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75e0ce0700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c8004850 0x7f75c8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75e14e1700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c8003b90 0x7f75c8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75e0ce0700 1 -- 172.21.15.12:0/296076151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c8003b90 msgr2=0x7f75c8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T20:49:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75e0ce0700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c8003b90 0x7f75c8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75e0ce0700 1 -- 172.21.15.12:0/296076151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75c8005350 msgr2=0x7f75c800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T20:49:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75e0ce0700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75c8005350 0x7f75c800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.004+0000 7f75e0ce0700 1 -- 172.21.15.12:0/296076151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80035b0 con 0x7f75c8004850 2023-07-07T20:49:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.005+0000 7f75e0ce0700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c8004850 0x7f75c8004cc0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f75d80019c0 tx=0x7f75c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d14d7ff128f946f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.005+0000 7f75e1ce2700 1 -- 172.21.15.12:0/296076151 reap_dead start 2023-07-07T20:49:39.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.005+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8001480 con 0x7f75c8004850 2023-07-07T20:49:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.005+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d80052d0 con 0x7f75c8004850 2023-07-07T20:49:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.005+0000 7f75d3fff700 1 -- 172.21.15.12:0/296076151 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8006860 con 0x7f75c8004850 2023-07-07T20:49:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.006+0000 7f75e3745700 1 -- 172.21.15.12:0/296076151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c8004850 msgr2=0x7f75c8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.006+0000 7f75e3745700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c8004850 0x7f75c8004cc0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f75d80019c0 tx=0x7f75c8005880 comp rx=0 tx=0).stop 2023-07-07T20:49:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.006+0000 7f75e3745700 1 -- 172.21.15.12:0/296076151 shutdown_connections 2023-07-07T20:49:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.006+0000 7f75e3745700 1 --2- 172.21.15.12:0/296076151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75c8004850 0x7f75c8004cc0 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.006+0000 7f75e3745700 1 -- 172.21.15.12:0/296076151 >> 172.21.15.12:0/296076151 conn(0x7f75dc06b920 msgr2=0x7f75dc0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:39.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.006+0000 7f75e3745700 1 -- 172.21.15.12:0/296076151 shutdown_connections 2023-07-07T20:49:39.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.006+0000 7f75e3745700 1 -- 172.21.15.12:0/296076151 wait complete. 2023-07-07T20:49:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.008+0000 7f75e3745700 1 Processor -- start 2023-07-07T20:49:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.008+0000 7f75e3745700 1 -- start start 2023-07-07T20:49:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e3745700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c8004850 0x7f75dc1f00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e3745700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75dc0c3290 0x7f75dc0c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e3745700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75dc069ef0 0x7f75dc06a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e3745700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc06a8d0 con 0x7f75dc069ef0 2023-07-07T20:49:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e3745700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0c3020 con 0x7f75dc0c3290 2023-07-07T20:49:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e3745700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc1f1670 con 0x7f75c8004850 2023-07-07T20:49:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e1ce2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75dc069ef0 0x7f75dc06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e1ce2700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75dc069ef0 0x7f75dc06a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40582/0 (socket says 172.21.15.12:40582) 2023-07-07T20:49:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e1ce2700 1 -- 172.21.15.12:0/3682966654 learned_addr learned my addr 172.21.15.12:0/3682966654 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T20:49:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e0ce0700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75dc0c3290 0x7f75dc0c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e1ce2700 1 -- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c8004850 msgr2=0x7f75dc1f00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e1ce2700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c8004850 0x7f75dc1f00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e1ce2700 1 -- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75dc0c3290 msgr2=0x7f75dc0c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e1ce2700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75dc0c3290 0x7f75dc0c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e1ce2700 1 -- 172.21.15.12:0/3682966654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc1f0610 con 0x7f75dc069ef0 2023-07-07T20:49:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.010+0000 7f75e1ce2700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75dc069ef0 0x7f75dc06a390 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f75d400bb30 tx=0x7f75d400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.011+0000 7f75d1ffb700 1 -- 172.21.15.12:0/3682966654 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d400cd70 con 0x7f75dc069ef0 2023-07-07T20:49:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.011+0000 7f75d1ffb700 1 -- 172.21.15.12:0/3682966654 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4010070 con 0x7f75dc069ef0 2023-07-07T20:49:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.011+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc1f3d00 con 0x7f75dc069ef0 2023-07-07T20:49:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.011+0000 7f75d1ffb700 1 -- 172.21.15.12:0/3682966654 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d40052b0 con 0x7f75dc069ef0 2023-07-07T20:49:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.011+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc1f42c0 con 0x7f75dc069ef0 2023-07-07T20:49:39.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.012+0000 7f75d1ffb700 1 -- 172.21.15.12:0/3682966654 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75d4005410 con 0x7f75dc069ef0 2023-07-07T20:49:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.013+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc0ccd50 con 0x7f75dc069ef0 2023-07-07T20:49:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.013+0000 7f75d1ffb700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f75c006ace0 0x7f75c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.013+0000 7f75d1ffb700 1 -- 172.21.15.12:0/3682966654 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f75d4089240 con 0x7f75dc069ef0 2023-07-07T20:49:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.013+0000 7f75e14e1700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f75c006ace0 0x7f75c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.014+0000 7f75e14e1700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f75c006ace0 0x7f75c006d190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f75cc001230 tx=0x7f75cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:39.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.020+0000 7f75d1ffb700 1 -- 172.21.15.12:0/3682966654 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f75d4054200 con 0x7f75dc069ef0 2023-07-07T20:49:39.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.349+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f75dc04ea20 con 0x7f75dc069ef0 2023-07-07T20:49:39.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.351+0000 7f75d1ffb700 1 -- 172.21.15.12:0/3682966654 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7f75d401a020 con 0x7f75dc069ef0 2023-07-07T20:49:39.354 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 8 2023-07-07T20:49:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.355+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f75c006ace0 msgr2=0x7f75c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.355+0000 7f75e3745700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f75c006ace0 0x7f75c006d190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f75cc001230 tx=0x7f75cc009040 comp rx=0 tx=0).stop 2023-07-07T20:49:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.355+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75dc069ef0 msgr2=0x7f75dc06a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.355+0000 7f75e3745700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75dc069ef0 0x7f75dc06a390 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f75d400bb30 tx=0x7f75d400be40 comp rx=0 tx=0).stop 2023-07-07T20:49:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.356+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 shutdown_connections 2023-07-07T20:49:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.356+0000 7f75e3745700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f75c006ace0 0x7f75c006d190 secure :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f75cc001230 tx=0x7f75cc009040 comp rx=0 tx=0).stop 2023-07-07T20:49:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.356+0000 7f75e3745700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75dc069ef0 0x7f75dc06a390 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.356+0000 7f75e3745700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75c8004850 0x7f75dc1f00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.356+0000 7f75e3745700 1 --2- 172.21.15.12:0/3682966654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75dc0c3290 0x7f75dc0c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.356+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 >> 172.21.15.12:0/3682966654 conn(0x7f75dc06b920 msgr2=0x7f75dc157750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:39.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.358+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 shutdown_connections 2023-07-07T20:49:39.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.358+0000 7f75e3745700 1 -- 172.21.15.12:0/3682966654 wait complete. 2023-07-07T20:49:39.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T20:49:39.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.586+0000 7fc93e609700 1 Processor -- start 2023-07-07T20:49:39.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.586+0000 7fc93e609700 1 -- start start 2023-07-07T20:49:39.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.586+0000 7fc93e609700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc9380b1c20 0x7fc9380c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.586+0000 7fc93e609700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 0x7fc938159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.586+0000 7fc93e609700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9380caee0 con 0x7fc938159590 2023-07-07T20:49:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.586+0000 7fc93e609700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9380c8f30 con 0x7fc9380b1c20 2023-07-07T20:49:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.586+0000 7fc93e609700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93815a790 con 0x7fc938159960 2023-07-07T20:49:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc937fff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fc938159590 0x7fc9380b1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.12:59256/0 (socket says 172.21.15.12:59256) 2023-07-07T20:49:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc937fff700 1 -- 172.21.15.12:0/3342861142 learned_addr learned my addr 172.21.15.12:0/3342861142 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-07-07T20:49:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc9377fe700 1 --2- 172.21.15.12:0/3342861142 >> v2:172.21.15.160:3300/0 conn(0x7fc9380b1c20 0x7fc9380c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc93cba6700 1 --2- 172.21.15.12:0/3342861142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 0x7fc938159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc9377fe700 1 -- 172.21.15.12:0/3342861142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 msgr2=0x7fc938159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T20:49:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc9377fe700 1 --2- 172.21.15.12:0/3342861142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 0x7fc938159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc9377fe700 1 -- 172.21.15.12:0/3342861142 >> v1:172.21.15.160:6789/0 conn(0x7fc938159590 legacy=0x7fc9380b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc9377fe700 1 -- 172.21.15.12:0/3342861142 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9380c9180 con 0x7fc9380b1c20 2023-07-07T20:49:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc93cba6700 1 --2- 172.21.15.12:0/3342861142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 0x7fc938159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T20:49:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.587+0000 7fc9377fe700 1 --2- 172.21.15.12:0/3342861142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 0x7fc9380c9c60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009840 tx=0x7fc92c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=584dc660d3005c37 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.588+0000 7fc936ffd700 1 -- 172.21.15.12:0/3342861142 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c011830 con 0x7fc9380b1c20 2023-07-07T20:49:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.588+0000 7fc936ffd700 1 -- 172.21.15.12:0/3342861142 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c011990 con 0x7fc9380b1c20 2023-07-07T20:49:39.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.588+0000 7fc936ffd700 1 -- 172.21.15.12:0/3342861142 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c011d20 con 0x7fc9380b1c20 2023-07-07T20:49:39.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.588+0000 7fc93e609700 1 -- 172.21.15.12:0/3342861142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 msgr2=0x7fc9380c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.588+0000 7fc93e609700 1 --2- 172.21.15.12:0/3342861142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 0x7fc9380c9c60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009840 tx=0x7fc92c009b50 comp rx=0 tx=0).stop 2023-07-07T20:49:39.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.595+0000 7fc93e609700 1 -- 172.21.15.12:0/3342861142 shutdown_connections 2023-07-07T20:49:39.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.595+0000 7fc93e609700 1 --2- 172.21.15.12:0/3342861142 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 0x7fc938159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.595+0000 7fc93e609700 1 --2- 172.21.15.12:0/3342861142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 0x7fc9380c9c60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.595+0000 7fc93e609700 1 -- 172.21.15.12:0/3342861142 >> 172.21.15.12:0/3342861142 conn(0x7fc93806ab80 msgr2=0x7fc9380ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:39.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.596+0000 7fc93e609700 1 -- 172.21.15.12:0/3342861142 shutdown_connections 2023-07-07T20:49:39.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.596+0000 7fc93e609700 1 -- 172.21.15.12:0/3342861142 wait complete. 2023-07-07T20:49:39.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.598+0000 7fc93e609700 1 Processor -- start 2023-07-07T20:49:39.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.598+0000 7fc93e609700 1 -- start start 2023-07-07T20:49:39.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc93e609700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 0x7fc93815b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc93e609700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938159590 0x7fc9380c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc93e609700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 0x7fc9380c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc93e609700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380c4f80 con 0x7fc938159590 2023-07-07T20:49:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc93e609700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93815c900 con 0x7fc9380b1c20 2023-07-07T20:49:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc93e609700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9380c45b0 con 0x7fc938159960 2023-07-07T20:49:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc9377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938159590 0x7fc9380c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc9377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938159590 0x7fc9380c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40592/0 (socket says 172.21.15.12:40592) 2023-07-07T20:49:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc9377fe700 1 -- 172.21.15.12:0/4171504558 learned_addr learned my addr 172.21.15.12:0/4171504558 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T20:49:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc937fff700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 0x7fc93815b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc9377fe700 1 -- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 msgr2=0x7fc9380c1860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-07T20:49:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc9377fe700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 0x7fc9380c1860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc9377fe700 1 -- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 msgr2=0x7fc93815b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc9377fe700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 0x7fc93815b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.599+0000 7fc9377fe700 1 -- 172.21.15.12:0/4171504558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc930009a70 con 0x7fc938159590 2023-07-07T20:49:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.600+0000 7fc937fff700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 0x7fc93815b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T20:49:39.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.603+0000 7fc9377fe700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938159590 0x7fc9380c4a40 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0090b0 tx=0x7fc92c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:39.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.603+0000 7fc934ff9700 1 -- 172.21.15.12:0/4171504558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0036a0 con 0x7fc938159590 2023-07-07T20:49:39.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.603+0000 7fc934ff9700 1 -- 172.21.15.12:0/4171504558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c01e070 con 0x7fc938159590 2023-07-07T20:49:39.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.603+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c0094a0 con 0x7fc938159590 2023-07-07T20:49:39.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.603+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9380c3f60 con 0x7fc938159590 2023-07-07T20:49:39.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.603+0000 7fc934ff9700 1 -- 172.21.15.12:0/4171504558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c003a60 con 0x7fc938159590 2023-07-07T20:49:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.606+0000 7fc934ff9700 1 -- 172.21.15.12:0/4171504558 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc92c003bc0 con 0x7fc938159590 2023-07-07T20:49:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.606+0000 7fc934ff9700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc92406ace0 0x7fc92406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.606+0000 7fc934ff9700 1 -- 172.21.15.12:0/4171504558 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc92c08a480 con 0x7fc938159590 2023-07-07T20:49:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.606+0000 7fc937fff700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc92406ace0 0x7fc92406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.607+0000 7fc937fff700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc92406ace0 0x7fc92406d190 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc928007fd0 tx=0x7fc928009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.609+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9180052f0 con 0x7fc938159590 2023-07-07T20:49:39.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.616+0000 7fc934ff9700 1 -- 172.21.15.12:0/4171504558 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc92c055440 con 0x7fc938159590 2023-07-07T20:49:39.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.965+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc918005b20 con 0x7fc938159590 2023-07-07T20:49:39.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.966+0000 7fc934ff9700 1 -- 172.21.15.12:0/4171504558 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc92c015020 con 0x7fc938159590 2023-07-07T20:49:39.969 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-07-07T20:49:39.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.968+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc92406ace0 msgr2=0x7fc92406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.968+0000 7fc93e609700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc92406ace0 0x7fc92406d190 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc928007fd0 tx=0x7fc928009040 comp rx=0 tx=0).stop 2023-07-07T20:49:39.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.968+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938159590 msgr2=0x7fc9380c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:39.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.968+0000 7fc93e609700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938159590 0x7fc9380c4a40 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0090b0 tx=0x7fc92c004750 comp rx=0 tx=0).stop 2023-07-07T20:49:39.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.969+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 shutdown_connections 2023-07-07T20:49:39.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.969+0000 7fc93e609700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fc92406ace0 0x7fc92406d190 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.969+0000 7fc93e609700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc938159960 0x7fc9380c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.969+0000 7fc93e609700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9380b1c20 0x7fc93815b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.969+0000 7fc93e609700 1 --2- 172.21.15.12:0/4171504558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc938159590 0x7fc9380c4a40 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:39.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.969+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 >> 172.21.15.12:0/4171504558 conn(0x7fc93806ab80 msgr2=0x7fc9380b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:39.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.969+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 shutdown_connections 2023-07-07T20:49:39.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:39.969+0000 7fc93e609700 1 -- 172.21.15.12:0/4171504558 wait complete. 2023-07-07T20:49:39.990 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T20:49:40.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.217+0000 7fdef766f700 1 Processor -- start 2023-07-07T20:49:40.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.217+0000 7fdef766f700 1 -- start start 2023-07-07T20:49:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.219+0000 7fdef766f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdef00cb4f0 0x7fdef00c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.219+0000 7fdef766f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdef006c6b0 0x7fdef00b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.219+0000 7fdef766f700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdef00b2090 con 0x7fdef015c5c0 2023-07-07T20:49:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.219+0000 7fdef766f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdef006d6c0 con 0x7fdef006c6b0 2023-07-07T20:49:40.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.219+0000 7fdef766f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef006ce20 con 0x7fdef00cb4f0 2023-07-07T20:49:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.219+0000 7fdef5c0c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdef006c6b0 0x7fdef00b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.219+0000 7fdef5c0c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdef006c6b0 0x7fdef00b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:36206/0 (socket says 172.21.15.12:36206) 2023-07-07T20:49:40.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.219+0000 7fdef5c0c700 1 -- 172.21.15.12:0/2562777052 learned_addr learned my addr 172.21.15.12:0/2562777052 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T20:49:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.220+0000 7fdef5c0c700 1 -- 172.21.15.12:0/2562777052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdef00cb4f0 msgr2=0x7fdef00c9820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T20:49:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.220+0000 7fdef5c0c700 1 --2- 172.21.15.12:0/2562777052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdef00cb4f0 0x7fdef00c9820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.220+0000 7fdef5c0c700 1 -- 172.21.15.12:0/2562777052 >> v1:172.21.15.12:6789/0 conn(0x7fdef015c5c0 legacy=0x7fdef00cade0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T20:49:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.220+0000 7fdef5c0c700 1 -- 172.21.15.12:0/2562777052 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef006d100 con 0x7fdef006c6b0 2023-07-07T20:49:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.220+0000 7fdef5c0c700 1 --2- 172.21.15.12:0/2562777052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdef006c6b0 0x7fdef00b27e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009e50 tx=0x7fdee800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc0b8ac1835b57a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.220+0000 7fdee7fff700 1 -- 172.21.15.12:0/2562777052 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee800e070 con 0x7fdef006c6b0 2023-07-07T20:49:40.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.220+0000 7fdee7fff700 1 -- 172.21.15.12:0/2562777052 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee8003a20 con 0x7fdef006c6b0 2023-07-07T20:49:40.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.220+0000 7fdee7fff700 1 -- 172.21.15.12:0/2562777052 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8003dd0 con 0x7fdef006c6b0 2023-07-07T20:49:40.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.221+0000 7fdef766f700 1 -- 172.21.15.12:0/2562777052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdef006c6b0 msgr2=0x7fdef00b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:40.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.221+0000 7fdef766f700 1 --2- 172.21.15.12:0/2562777052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdef006c6b0 0x7fdef00b27e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009e50 tx=0x7fdee800b330 comp rx=0 tx=0).stop 2023-07-07T20:49:40.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.221+0000 7fdef766f700 1 -- 172.21.15.12:0/2562777052 shutdown_connections 2023-07-07T20:49:40.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.221+0000 7fdef766f700 1 --2- 172.21.15.12:0/2562777052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdef006c6b0 0x7fdef00b27e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.221+0000 7fdef766f700 1 --2- 172.21.15.12:0/2562777052 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdef00cb4f0 0x7fdef00c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.221+0000 7fdef766f700 1 -- 172.21.15.12:0/2562777052 >> 172.21.15.12:0/2562777052 conn(0x7fdef0069ef0 msgr2=0x7fdef006a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:40.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.230+0000 7fdef766f700 1 -- 172.21.15.12:0/2562777052 shutdown_connections 2023-07-07T20:49:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.239+0000 7fdef766f700 1 -- 172.21.15.12:0/2562777052 wait complete. 2023-07-07T20:49:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.241+0000 7fdef766f700 1 Processor -- start 2023-07-07T20:49:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.242+0000 7fdef766f700 1 -- start start 2023-07-07T20:49:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.243+0000 7fdef766f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdef006c6b0 0x7fdef00c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.243+0000 7fdef766f700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdef0207010 0x7fdef02026d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.243+0000 7fdef766f700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef0202c10 0x7fdef01598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.243+0000 7fdef766f700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef015c170 con 0x7fdef0202c10 2023-07-07T20:49:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.243+0000 7fdef766f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef015b930 con 0x7fdef006c6b0 2023-07-07T20:49:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.243+0000 7fdef766f700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef015bbb0 con 0x7fdef0207010 2023-07-07T20:49:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.244+0000 7fdef5c0c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef0202c10 0x7fdef01598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.244+0000 7fdef5c0c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef0202c10 0x7fdef01598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40602/0 (socket says 172.21.15.12:40602) 2023-07-07T20:49:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.244+0000 7fdef5c0c700 1 -- 172.21.15.12:0/3391492545 learned_addr learned my addr 172.21.15.12:0/3391492545 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T20:49:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.244+0000 7fdef5c0c700 1 -- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdef0207010 msgr2=0x7fdef02026d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T20:49:40.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.244+0000 7fdef5c0c700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdef0207010 0x7fdef02026d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.244+0000 7fdef5c0c700 1 -- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdef006c6b0 msgr2=0x7fdef00c7a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T20:49:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.244+0000 7fdef5c0c700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdef006c6b0 0x7fdef00c7a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.244+0000 7fdef5c0c700 1 -- 172.21.15.12:0/3391492545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8009b30 con 0x7fdef0202c10 2023-07-07T20:49:40.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.244+0000 7fdef5c0c700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef0202c10 0x7fdef01598e0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7fdee800b370 tx=0x7fdee8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:40.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.248+0000 7fdee5ffb700 1 -- 172.21.15.12:0/3391492545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee8004300 con 0x7fdef0202c10 2023-07-07T20:49:40.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.248+0000 7fdee5ffb700 1 -- 172.21.15.12:0/3391492545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee8004460 con 0x7fdef0202c10 2023-07-07T20:49:40.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.248+0000 7fdee5ffb700 1 -- 172.21.15.12:0/3391492545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee80047f0 con 0x7fdef0202c10 2023-07-07T20:49:40.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.248+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef015be90 con 0x7fdef0202c10 2023-07-07T20:49:40.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.249+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef00c5ba0 con 0x7fdef0202c10 2023-07-07T20:49:40.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.250+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef00c5dc0 con 0x7fdef0202c10 2023-07-07T20:49:40.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.251+0000 7fdee5ffb700 1 -- 172.21.15.12:0/3391492545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdee8019070 con 0x7fdef0202c10 2023-07-07T20:49:40.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.251+0000 7fdee5ffb700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdedc06ae60 0x7fdedc06d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.252+0000 7fdee5ffb700 1 -- 172.21.15.12:0/3391492545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fdee808a650 con 0x7fdef0202c10 2023-07-07T20:49:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.252+0000 7fdef540b700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdedc06ae60 0x7fdedc06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.252+0000 7fdef540b700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdedc06ae60 0x7fdedc06d310 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdef00c2090 tx=0x7fdeec006c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:40.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.259+0000 7fdee5ffb700 1 -- 172.21.15.12:0/3391492545 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdee8055590 con 0x7fdef0202c10 2023-07-07T20:49:40.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.617+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdef004ea20 con 0x7fdef0202c10 2023-07-07T20:49:40.649 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-07-07T20:49:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.638+0000 7fdee5ffb700 1 -- 172.21.15.12:0/3391492545 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdee8058bb0 con 0x7fdef0202c10 2023-07-07T20:49:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.661+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdedc06ae60 msgr2=0x7fdedc06d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.661+0000 7fdef766f700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdedc06ae60 0x7fdedc06d310 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdef00c2090 tx=0x7fdeec006c60 comp rx=0 tx=0).stop 2023-07-07T20:49:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.661+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef0202c10 msgr2=0x7fdef01598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:40.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.661+0000 7fdef766f700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef0202c10 0x7fdef01598e0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7fdee800b370 tx=0x7fdee8004ad0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.662+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 shutdown_connections 2023-07-07T20:49:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.662+0000 7fdef766f700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7fdedc06ae60 0x7fdedc06d310 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.662+0000 7fdef766f700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdef0202c10 0x7fdef01598e0 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.662+0000 7fdef766f700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdef006c6b0 0x7fdef00c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.662+0000 7fdef766f700 1 --2- 172.21.15.12:0/3391492545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdef0207010 0x7fdef02026d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.662+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 >> 172.21.15.12:0/3391492545 conn(0x7fdef0069ef0 msgr2=0x7fdef00ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:40.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.662+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 shutdown_connections 2023-07-07T20:49:40.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.663+0000 7fdef766f700 1 -- 172.21.15.12:0/3391492545 wait complete. 2023-07-07T20:49:40.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-07T20:49:40.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.896+0000 7f1b8e4a0700 1 Processor -- start 2023-07-07T20:49:40.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.896+0000 7f1b8e4a0700 1 -- start start 2023-07-07T20:49:40.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.896+0000 7f1b8e4a0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1b880cddd0 0x7f1b8815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.896+0000 7f1b8e4a0700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b880aec10 0x7f1b880714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8e4a0700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b880af090 con 0x7f1b880ae6c0 2023-07-07T20:49:40.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8e4a0700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b880cdc80 con 0x7f1b880aec10 2023-07-07T20:49:40.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8e4a0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8815d6a0 con 0x7f1b880cddd0 2023-07-07T20:49:40.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8ca3d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b880aec10 0x7f1b880714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:40.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8ca3d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b880aec10 0x7f1b880714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40610/0 (socket says 172.21.15.12:40610) 2023-07-07T20:49:40.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8ca3d700 1 -- 172.21.15.12:0/3522885350 learned_addr learned my addr 172.21.15.12:0/3522885350 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T20:49:40.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b87fff700 1 --2- 172.21.15.12:0/3522885350 >> v2:172.21.15.160:3300/0 conn(0x7f1b880cddd0 0x7f1b8815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:40.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8ca3d700 1 -- 172.21.15.12:0/3522885350 >> v2:172.21.15.160:3300/0 conn(0x7f1b880cddd0 msgr2=0x7f1b8815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T20:49:40.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8ca3d700 1 --2- 172.21.15.12:0/3522885350 >> v2:172.21.15.160:3300/0 conn(0x7f1b880cddd0 0x7f1b8815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8ca3d700 1 -- 172.21.15.12:0/3522885350 >> v1:172.21.15.12:6789/0 conn(0x7f1b880ae6c0 legacy=0x7f1b880ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T20:49:40.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8ca3d700 1 -- 172.21.15.12:0/3522885350 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88159700 con 0x7f1b880aec10 2023-07-07T20:49:40.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b8ca3d700 1 --2- 172.21.15.12:0/3522885350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b880aec10 0x7f1b880714a0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f1b880ccf20 tx=0x7f1b7800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32989ef7b97792e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:40.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.897+0000 7f1b86ffd700 1 -- 172.21.15.12:0/3522885350 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7800dc30 con 0x7f1b880aec10 2023-07-07T20:49:40.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.898+0000 7f1b86ffd700 1 -- 172.21.15.12:0/3522885350 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7800dd90 con 0x7f1b880aec10 2023-07-07T20:49:40.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.898+0000 7f1b86ffd700 1 -- 172.21.15.12:0/3522885350 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78004250 con 0x7f1b880aec10 2023-07-07T20:49:40.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.898+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/3522885350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b880aec10 msgr2=0x7f1b880714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:40.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.898+0000 7f1b8e4a0700 1 --2- 172.21.15.12:0/3522885350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b880aec10 0x7f1b880714a0 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f1b880ccf20 tx=0x7f1b7800be70 comp rx=0 tx=0).stop 2023-07-07T20:49:40.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.898+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/3522885350 shutdown_connections 2023-07-07T20:49:40.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.898+0000 7f1b8e4a0700 1 --2- 172.21.15.12:0/3522885350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b880aec10 0x7f1b880714a0 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.898+0000 7f1b8e4a0700 1 --2- 172.21.15.12:0/3522885350 >> v2:172.21.15.160:3300/0 conn(0x7f1b880cddd0 0x7f1b8815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.898+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/3522885350 >> 172.21.15.12:0/3522885350 conn(0x7f1b8806d4a0 msgr2=0x7f1b8806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:40.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.898+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/3522885350 shutdown_connections 2023-07-07T20:49:40.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.899+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/3522885350 wait complete. 2023-07-07T20:49:40.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.900+0000 7f1b8e4a0700 1 Processor -- start 2023-07-07T20:49:40.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.904+0000 7f1b8e4a0700 1 -- start start 2023-07-07T20:49:40.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b8e4a0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ae6c0 0x7f1b880ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b8e4a0700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b880aec10 0x7f1b880cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b8e4a0700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b880cddd0 0x7f1b880cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b8e4a0700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880cccb0 con 0x7f1b880cddd0 2023-07-07T20:49:40.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b8e4a0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880cb9d0 con 0x7f1b880ae6c0 2023-07-07T20:49:40.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b8e4a0700 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880ac0d0 con 0x7f1b880aec10 2023-07-07T20:49:40.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b87fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ae6c0 0x7f1b880ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:40.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b877fe700 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b880aec10 0x7f1b880cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:40.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b87fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ae6c0 0x7f1b880ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.12:36220/0 (socket says 172.21.15.12:36220) 2023-07-07T20:49:40.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b87fff700 1 -- 172.21.15.12:0/4041625874 learned_addr learned my addr 172.21.15.12:0/4041625874 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-07-07T20:49:40.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b87fff700 1 -- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b880aec10 msgr2=0x7f1b880cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:40.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b87fff700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b880aec10 0x7f1b880cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b87fff700 1 -- 172.21.15.12:0/4041625874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b880cddd0 msgr2=0x7f1b880cc770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T20:49:40.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b87fff700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b880cddd0 0x7f1b880cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:40.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.906+0000 7f1b87fff700 1 -- 172.21.15.12:0/4041625874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7800b7f0 con 0x7f1b880ae6c0 2023-07-07T20:49:40.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.907+0000 7f1b877fe700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b880aec10 0x7f1b880cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T20:49:40.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.907+0000 7f1b87fff700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ae6c0 0x7f1b880ace90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000efc0 tx=0x7f1b8000c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:40.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.907+0000 7f1b84ff9700 1 -- 172.21.15.12:0/4041625874 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000cc00 con 0x7f1b880ae6c0 2023-07-07T20:49:40.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.907+0000 7f1b84ff9700 1 -- 172.21.15.12:0/4041625874 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8000f040 con 0x7f1b880ae6c0 2023-07-07T20:49:40.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.907+0000 7f1b84ff9700 1 -- 172.21.15.12:0/4041625874 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80014480 con 0x7f1b880ae6c0 2023-07-07T20:49:40.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.907+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b880ac3b0 con 0x7f1b880ae6c0 2023-07-07T20:49:40.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.907+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b880ac970 con 0x7f1b880ae6c0 2023-07-07T20:49:40.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.908+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8806f120 con 0x7f1b880ae6c0 2023-07-07T20:49:40.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.909+0000 7f1b84ff9700 1 -- 172.21.15.12:0/4041625874 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b800145e0 con 0x7f1b880ae6c0 2023-07-07T20:49:40.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.909+0000 7f1b84ff9700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b7406ace0 0x7f1b7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T20:49:40.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.910+0000 7f1b84ff9700 1 -- 172.21.15.12:0/4041625874 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f1b80089f70 con 0x7f1b880ae6c0 2023-07-07T20:49:40.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.910+0000 7f1b877fe700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b7406ace0 0x7f1b7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T20:49:40.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.910+0000 7f1b877fe700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b7406ace0 0x7f1b7406d190 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1b880cab90 tx=0x7f1b7c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T20:49:40.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:40.917+0000 7f1b84ff9700 1 -- 172.21.15.12:0/4041625874 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b800bc310 con 0x7f1b880ae6c0 2023-07-07T20:49:41.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.254+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1b8806ff40 con 0x7f1b880ae6c0 2023-07-07T20:49:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.255+0000 7f1b84ff9700 1 -- 172.21.15.12:0/4041625874 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v48) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1b800588a0 con 0x7f1b880ae6c0 2023-07-07T20:49:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b7406ace0 msgr2=0x7f1b7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b7406ace0 0x7f1b7406d190 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1b880cab90 tx=0x7f1b7c0090e0 comp rx=0 tx=0).stop 2023-07-07T20:49:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ae6c0 msgr2=0x7f1b880ace90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T20:49:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ae6c0 0x7f1b880ace90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000efc0 tx=0x7f1b8000c0c0 comp rx=0 tx=0).stop 2023-07-07T20:49:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 shutdown_connections 2023-07-07T20:49:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:6832/4080099133,v1:172.21.15.160:6833/4080099133] conn(0x7f1b7406ace0 0x7f1b7406d190 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b880cddd0 0x7f1b880cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ae6c0 0x7f1b880ace90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 --2- 172.21.15.12:0/4041625874 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b880aec10 0x7f1b880cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T20:49:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 >> 172.21.15.12:0/4041625874 conn(0x7f1b8806d4a0 msgr2=0x7f1b88152980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T20:49:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 shutdown_connections 2023-07-07T20:49:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-07-07T20:49:41.259+0000 7f1b8e4a0700 1 -- 172.21.15.12:0/4041625874 wait complete. 2023-07-07T20:49:41.264 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2023-07-07T20:49:41.281 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-07T20:49:41.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T20:49:41.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-07T20:49:41.391 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T20:49:41.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T20:49:41.391 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-07T20:49:41.883 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-07-07T20:49:41.883 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T20:49:41.932 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=43,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12795 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.12:6789:/test /tmp/tmp.LDqKVxgZKjtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=6f09c1a9-a759-4e94-bed7-68b16c28b7f9,acl 0 0 172.21.15.12:6789:/scratch /tmp/tmp.nhgnHEvCfwscratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=6f09c1a9-a759-4e94-bed7-68b16c28b7f9,acl 0 0 2023-07-07T20:49:41.932 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-07-07T20:49:41.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T20:49:41.933 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-07T20:49:41.973 INFO:teuthology.orchestra.run.smithi012.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-07T20:49:41.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T20:49:41.974 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T20:49:41.974 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T20:49:42.250 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-07T20:49:42.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T20:49:42.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T20:49:42.251 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-07T20:49:42.380 INFO:teuthology.orchestra.run.smithi160.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-07T20:49:42.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T20:49:42.381 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-07-07T20:49:42.381 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T20:49:42.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284272k,nr_inodes=4071068,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19596 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-07T20:49:42.408 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2023-07-07T20:49:42.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T20:49:42.409 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-07T20:49:42.483 INFO:teuthology.orchestra.run.smithi160.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-07T20:49:42.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T20:49:44.090 INFO:tasks.ceph.osd.1:Sent signal 15 2023-07-07T20:49:44.091 INFO:tasks.ceph.osd.2:Sent signal 15 2023-07-07T20:49:44.091 INFO:tasks.ceph.osd.3:Sent signal 15 2023-07-07T20:49:44.091 INFO:tasks.ceph.osd.4:Sent signal 15 2023-07-07T20:49:44.091 INFO:tasks.ceph.osd.5:Sent signal 15 2023-07-07T20:49:44.092 INFO:tasks.ceph.osd.6:Sent signal 15 2023-07-07T20:49:44.092 INFO:tasks.ceph.osd.7:Sent signal 15 2023-07-07T20:49:44.092 INFO:tasks.ceph.mds.a:Sent signal 15 2023-07-07T20:49:44.093 INFO:tasks.ceph.mds.c:Sent signal 15 2023-07-07T20:49:44.093 INFO:tasks.ceph.mds.b:Sent signal 15 2023-07-07T20:49:44.093 INFO:tasks.ceph.mds.d:Sent signal 15 2023-07-07T20:49:44.093 INFO:tasks.ceph.mon.a:Sent signal 15 2023-07-07T20:49:44.094 INFO:tasks.ceph.mon.b:Sent signal 15 2023-07-07T20:49:44.094 INFO:tasks.ceph.mon.c:Sent signal 15 2023-07-07T20:49:44.094 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-07-07T20:49:44.095 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-07-07T20:49:44.095 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T20:49:44.089+0000 7f93a9f18700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 101370) UID: 0 2023-07-07T20:49:44.095 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T20:49:44.089+0000 7f93a9f18700 -1 osd.4 48 *** Got signal Terminated *** 2023-07-07T20:49:44.096 INFO:tasks.ceph.osd.4.smithi160.stderr:2023-07-07T20:49:44.089+0000 7f93a9f18700 -1 osd.4 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-07T20:49:44.096 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T20:49:44.089+0000 7f39bedbd700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 101376) UID: 0 2023-07-07T20:49:44.096 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T20:49:44.089+0000 7f39bedbd700 -1 osd.5 48 *** Got signal Terminated *** 2023-07-07T20:49:44.096 INFO:tasks.ceph.osd.5.smithi160.stderr:2023-07-07T20:49:44.089+0000 7f39bedbd700 -1 osd.5 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-07T20:49:44.097 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T20:49:44.090+0000 7f00d8e6d700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 101375) UID: 0 2023-07-07T20:49:44.097 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T20:49:44.090+0000 7f00d8e6d700 -1 osd.6 48 *** Got signal Terminated *** 2023-07-07T20:49:44.097 INFO:tasks.ceph.osd.6.smithi160.stderr:2023-07-07T20:49:44.090+0000 7f00d8e6d700 -1 osd.6 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-07T20:49:44.098 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T20:49:44.090+0000 7fa834dc8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 101378) UID: 0 2023-07-07T20:49:44.098 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T20:49:44.090+0000 7fa834dc8700 -1 osd.7 48 *** Got signal Terminated *** 2023-07-07T20:49:44.098 INFO:tasks.ceph.osd.7.smithi160.stderr:2023-07-07T20:49:44.090+0000 7fa834dc8700 -1 osd.7 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-07T20:49:44.098 INFO:tasks.ceph.mds.b.smithi160.stderr:2023-07-07T20:49:44.091+0000 7f174a8e8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 108363) UID: 0 2023-07-07T20:49:44.098 INFO:tasks.ceph.mds.b.smithi160.stderr:2023-07-07T20:49:44.091+0000 7f174a8e8700 -1 mds.b *** got signal Terminated *** 2023-07-07T20:49:44.099 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-07-07T20:49:44.091+0000 7fe77975c700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 108364) UID: 0 2023-07-07T20:49:44.099 INFO:tasks.ceph.mds.d.smithi160.stderr:2023-07-07T20:49:44.091+0000 7fe77975c700 -1 mds.d *** got signal Terminated *** 2023-07-07T20:49:44.099 INFO:tasks.ceph.mon.b.smithi160.stderr:2023-07-07T20:49:44.092+0000 7f034b3e3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 100719) UID: 0 2023-07-07T20:49:44.099 INFO:tasks.ceph.mon.b.smithi160.stderr:2023-07-07T20:49:44.092+0000 7f034b3e3700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-07-07T20:49:44.100 INFO:tasks.ceph.mon.c.smithi160.stderr:2023-07-07T20:49:44.092+0000 7fa19a068700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 100722) UID: 0 2023-07-07T20:49:44.100 INFO:tasks.ceph.mon.c.smithi160.stderr:2023-07-07T20:49:44.092+0000 7fa19a068700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-07-07T20:49:44.100 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T20:49:44.093+0000 7f356724e700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 100725) UID: 0 2023-07-07T20:49:44.100 INFO:tasks.ceph.mgr.x.smithi160.stderr:2023-07-07T20:49:44.093+0000 7f356724e700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-07-07T20:49:44.101 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-07-07T20:49:44.092+0000 7f9d6acc1700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 130921) UID: 0 2023-07-07T20:49:44.101 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-07-07T20:49:44.092+0000 7f9d6acc1700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-07T20:49:44.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T20:49:44.092+0000 7fb626ecc700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 131259) UID: 0 2023-07-07T20:49:44.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T20:49:44.092+0000 7fb626ecc700 -1 osd.1 48 *** Got signal Terminated *** 2023-07-07T20:49:44.102 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T20:49:44.092+0000 7efe5fde0700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 131269) UID: 0 2023-07-07T20:49:44.102 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T20:49:44.092+0000 7efe5fde0700 -1 osd.3 48 *** Got signal Terminated *** 2023-07-07T20:49:44.102 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-07-07T20:49:44.092+0000 7efe5fde0700 -1 osd.3 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-07T20:49:44.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-07-07T20:49:44.092+0000 7fb626ecc700 -1 osd.1 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-07T20:49:44.103 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T20:49:44.092+0000 7f23f6e45700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 146905) UID: 0 2023-07-07T20:49:44.103 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-07-07T20:49:44.092+0000 7f23f6e45700 -1 mds.c *** got signal Terminated *** 2023-07-07T20:49:44.103 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T20:49:44.092+0000 7f5317f46700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 131258) UID: 0 2023-07-07T20:49:44.104 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T20:49:44.092+0000 7f5317f46700 -1 osd.2 48 *** Got signal Terminated *** 2023-07-07T20:49:44.104 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-07-07T20:49:44.092+0000 7f5317f46700 -1 osd.2 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-07T20:49:44.104 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T20:49:44.095+0000 7ff6efcfe700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 146904) UID: 0 2023-07-07T20:49:44.104 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-07-07T20:49:44.095+0000 7ff6efcfe700 -1 mds.a *** got signal Terminated *** 2023-07-07T20:49:44.295 INFO:tasks.ceph.mgr.y.smithi012.stderr:daemon-helper: command crashed with signal 15 2023-07-07T20:50:07.239 INFO:teuthology.orchestra.run.smithi012.stderr:ceph-osd: no process found 2023-07-07T20:55:16.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:55:16.407 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:55:46.548 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:55:46.551 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:56:16.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:56:16.696 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:56:46.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:56:46.792 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:57:16.918 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:57:16.921 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:57:47.048 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:57:47.051 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:58:17.169 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:58:17.171 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:58:47.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:58:47.301 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:59:17.444 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:59:17.447 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:59:47.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T20:59:47.585 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:00:17.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:00:17.730 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:00:47.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:00:47.868 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:01:18.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:01:18.013 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:01:48.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:01:48.076 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:02:18.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:02:18.206 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:02:48.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:02:48.335 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:03:18.452 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:03:18.455 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:03:48.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:03:48.610 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:04:18.711 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:04:18.713 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:04:48.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:04:48.861 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:05:19.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:05:19.013 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:05:49.174 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:05:49.177 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:06:19.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:06:19.331 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:06:49.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:06:49.436 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:07:19.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:07:19.573 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:07:49.724 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:07:49.727 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:08:19.861 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:08:19.864 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:08:50.007 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:08:50.011 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:09:20.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:09:20.157 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:09:50.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:09:50.302 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:10:20.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:10:20.448 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:10:50.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:10:50.585 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:11:20.711 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:11:20.715 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:11:50.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:11:50.785 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:12:20.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:12:20.931 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:12:51.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:12:51.060 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:13:21.204 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:13:21.207 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:13:51.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:13:51.327 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:14:21.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:14:21.482 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:14:51.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:14:51.602 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:15:21.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:15:21.732 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:15:51.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:15:51.892 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:16:22.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:16:22.016 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:16:52.133 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:16:52.136 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:17:22.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:17:22.257 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:17:52.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:17:52.411 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:18:22.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:18:22.557 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:18:52.700 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:18:52.703 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:19:22.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:19:22.842 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:19:52.983 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:19:52.986 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:20:23.129 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:20:23.132 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:20:53.267 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:20:53.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:21:23.404 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:21:23.407 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:21:53.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:21:53.537 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:22:23.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:22:23.674 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:22:53.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:22:53.786 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:23:23.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:23:23.941 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:23:54.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:23:54.070 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:24:24.196 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:24:24.199 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:24:54.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:24:54.336 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:25:24.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:25:24.482 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:25:54.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:25:54.636 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:26:24.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:26:24.766 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:26:54.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:26:54.904 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:27:25.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:27:25.058 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:27:55.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:27:55.204 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:28:25.346 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:28:25.349 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:28:55.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:28:55.487 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:29:25.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:29:25.616 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:29:55.759 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:29:55.762 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:30:25.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:30:25.891 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:30:56.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:30:56.037 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:31:26.205 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:31:26.208 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:31:56.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:31:56.337 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:32:26.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:32:26.466 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:32:56.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:32:56.554 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:33:26.696 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:33:26.699 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:33:56.776 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:33:56.779 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:34:26.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:34:26.908 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:34:57.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:34:57.037 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:35:27.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:35:27.175 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:35:57.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:35:57.313 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:36:27.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:36:27.475 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:36:57.594 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:36:57.596 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:37:27.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:37:27.760 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:37:57.885 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:37:57.888 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:38:28.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:38:28.025 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:38:58.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:38:58.171 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:39:28.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:39:28.300 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:39:58.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:39:58.421 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:40:28.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:40:28.559 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:40:58.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:40:58.712 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:41:28.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:41:28.792 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:41:58.927 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:41:58.930 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:42:29.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:42:29.068 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:42:59.185 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:42:59.189 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:43:29.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:43:29.319 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:43:59.453 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:43:59.456 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:44:29.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:44:29.592 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:44:59.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:44:59.730 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:45:29.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:45:29.867 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:46:00.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:46:00.029 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:46:30.189 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:46:30.192 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:47:00.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:47:00.262 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:47:30.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:47:30.418 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:48:00.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:48:00.538 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:48:30.674 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:48:30.676 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:49:00.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:49:00.822 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:49:30.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:49:30.959 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:50:01.102 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:50:01.105 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:50:31.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:50:31.243 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:51:01.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:51:01.381 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:51:31.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:51:31.501 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:52:01.661 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:52:01.664 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:52:31.799 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:52:31.802 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:53:01.936 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:53:01.938 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:53:32.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:53:32.076 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:54:02.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:54:02.214 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:54:32.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:54:32.369 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:55:02.511 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:55:02.514 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:55:32.665 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:55:32.667 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:56:02.803 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:56:02.806 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:56:32.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:56:32.926 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:57:03.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:57:03.064 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:57:33.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:57:33.185 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:58:03.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:58:03.315 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:58:33.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:58:33.452 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:59:03.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:59:03.577 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:59:33.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T21:59:33.702 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:00:03.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:00:03.847 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:00:33.982 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:00:33.985 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:01:04.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:01:04.139 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:01:34.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:01:34.285 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:02:04.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:02:04.422 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:02:34.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:02:34.560 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:03:04.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:03:04.681 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:03:34.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:03:34.839 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:04:04.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:04:04.974 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:04:35.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:04:35.112 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:05:05.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:05:05.249 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:05:35.375 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:05:35.378 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:06:05.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:06:05.515 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:06:35.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:06:35.627 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:07:05.754 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:07:05.757 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:07:35.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:07:35.887 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:08:06.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:08:06.015 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:08:36.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:08:36.145 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:09:06.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:09:06.265 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:09:36.400 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:09:36.403 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:10:06.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:10:06.541 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:10:36.658 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:10:36.661 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:11:06.812 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:11:06.815 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:11:36.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:11:36.945 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:12:07.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:12:07.083 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:12:37.217 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:12:37.221 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:13:07.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:13:07.341 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:13:37.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:13:37.470 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:14:07.580 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:14:07.583 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:14:37.643 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:14:37.646 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:15:07.806 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:15:07.809 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:15:37.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:15:37.970 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:16:08.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:16:08.124 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:16:38.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:16:38.254 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:17:08.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:17:08.375 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:17:38.509 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:17:38.512 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:18:08.663 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:18:08.666 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:18:38.801 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:18:38.804 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:19:08.922 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:19:08.925 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:19:39.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:19:39.071 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:20:09.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:20:09.200 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:20:39.360 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:20:39.363 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:21:09.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:21:09.550 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:21:39.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:21:39.695 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:22:09.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:22:09.842 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:22:39.976 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:22:39.979 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:23:10.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:23:10.133 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:23:40.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:23:40.279 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:24:10.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:24:10.409 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:24:40.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:24:40.538 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:25:10.656 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:25:10.659 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:25:40.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:25:40.798 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:26:10.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:26:10.936 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:26:41.086 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:26:41.089 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:27:11.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:27:11.219 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:27:41.362 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:27:41.365 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:28:11.507 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:28:11.511 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:28:41.628 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:28:41.631 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:29:11.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:29:11.777 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:29:41.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:29:41.923 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:30:11.991 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:30:11.995 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:30:42.140 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:30:42.143 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:31:12.274 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:31:12.277 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:31:42.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:31:42.432 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:32:12.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:32:12.577 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:32:42.712 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:32:42.715 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:33:12.849 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:33:12.852 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:33:42.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:33:42.981 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:34:13.133 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:34:13.136 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:34:43.257 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:34:43.260 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:35:13.416 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:35:13.419 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:35:43.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:35:43.556 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:36:13.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:36:13.702 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:36:43.775 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:36:43.778 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:37:13.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:37:13.936 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:37:44.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:37:44.074 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:38:14.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:38:14.219 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:38:44.355 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:38:44.357 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:39:14.509 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:39:14.512 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:39:44.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:39:44.640 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:40:14.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:40:14.786 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:40:44.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:40:44.940 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:41:15.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:41:15.111 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:41:45.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:41:45.224 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:42:15.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:42:15.354 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:42:45.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:42:45.466 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:43:15.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:43:15.611 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:43:45.755 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:43:45.758 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:44:15.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:44:15.878 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:44:46.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:44:46.015 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:45:16.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:45:16.137 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:45:46.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:45:46.274 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:46:16.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:46:16.436 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:46:46.588 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:46:46.591 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:47:16.701 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:47:16.703 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:47:46.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:47:46.850 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:48:16.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:48:16.987 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:48:47.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:48:47.124 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:49:17.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:49:17.262 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:49:47.389 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:49:47.392 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:50:17.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:50:17.520 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:50:47.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:50:47.650 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:51:17.775 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:51:17.778 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:51:47.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:51:47.908 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:52:18.076 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:52:18.079 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:52:48.205 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:52:48.208 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:53:18.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:53:18.354 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:53:48.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:53:48.499 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:54:18.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:54:18.629 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:54:48.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:54:48.775 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:55:18.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:55:18.905 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:55:49.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:55:49.042 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:56:19.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:56:19.187 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:56:49.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:56:49.276 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:57:19.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:57:19.396 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:57:49.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:57:49.542 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:58:19.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:58:19.679 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:58:49.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:58:49.820 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:59:19.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:59:19.971 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:59:50.105 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T22:59:50.109 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:00:20.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:00:20.247 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:00:50.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:00:50.384 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:01:20.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:01:20.530 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:01:50.764 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:01:50.767 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:02:20.927 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:02:20.930 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:02:51.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:02:51.075 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:03:21.202 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:03:21.205 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:03:51.340 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:03:51.343 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:04:21.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:04:21.480 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:04:51.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:04:51.625 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:05:21.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:05:21.772 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:05:51.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:05:51.901 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:06:22.043 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:06:22.046 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:06:52.164 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:06:52.167 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:07:22.285 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:07:22.288 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:07:52.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:07:52.409 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:08:22.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:08:22.538 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:08:52.689 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:08:52.692 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:09:22.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:09:22.830 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:09:52.990 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:09:52.993 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:10:23.118 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:10:23.121 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:10:53.248 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:10:53.251 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:11:23.427 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:11:23.430 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:11:53.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:11:53.559 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:12:23.696 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:12:23.698 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:12:53.850 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:12:53.853 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:13:23.988 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:13:23.990 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:13:54.159 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:13:54.162 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:14:24.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:14:24.307 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:14:54.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:14:54.453 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:15:24.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:15:24.573 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:15:54.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:15:54.695 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:16:24.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:16:24.865 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:16:55.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:16:55.020 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:17:25.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:17:25.158 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:17:55.291 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:17:55.294 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:18:25.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:18:25.449 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:18:55.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:18:55.546 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:19:25.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:19:25.675 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:19:55.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:19:55.828 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:20:25.947 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:20:25.950 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:20:56.083 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:20:56.086 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:21:26.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:21:26.258 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:21:56.376 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:21:56.379 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:22:26.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:22:26.500 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:22:56.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:22:56.637 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:23:26.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:23:26.766 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:23:56.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:23:56.913 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:24:27.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:24:27.042 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:24:57.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:24:57.178 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:25:27.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:25:27.308 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:25:57.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:25:57.429 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:26:27.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:26:27.609 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:26:57.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:26:57.755 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:27:27.914 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:27:27.917 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:27:58.043 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:27:58.046 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:28:28.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:28:28.191 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:28:58.351 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:28:58.354 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:29:28.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:29:28.484 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:29:58.643 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:29:58.646 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:30:28.772 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:30:28.775 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:30:58.893 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:30:58.897 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:31:28.964 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:31:28.966 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:31:59.120 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:31:59.123 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:32:29.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:32:29.259 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:32:59.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:32:59.380 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:33:29.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:33:29.501 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:33:59.627 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:33:59.630 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:34:29.764 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:34:29.767 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:34:59.902 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:34:59.904 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:35:30.064 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:35:30.068 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:36:00.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:36:00.204 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:36:30.340 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:36:30.342 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:37:00.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:37:00.411 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:37:30.532 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:37:30.534 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:38:00.669 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:38:00.672 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:38:30.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:38:30.836 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:39:00.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:39:00.964 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:39:31.117 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:39:31.119 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:40:01.261 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:40:01.264 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:40:31.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:40:31.410 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:41:01.594 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:41:01.597 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:41:31.756 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:41:31.759 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:42:01.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:42:01.906 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:42:32.048 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:42:32.051 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:43:02.178 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:43:02.181 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:43:32.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:43:32.327 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:44:02.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:44:02.481 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:44:32.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:44:32.619 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:45:02.744 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:45:02.747 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:45:32.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:45:32.914 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:46:03.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:46:03.064 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:46:33.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:46:33.227 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:47:03.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:47:03.357 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:47:33.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:47:33.493 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:48:03.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:48:03.641 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:48:33.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:48:33.761 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:49:03.904 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:49:03.907 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:49:34.049 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:49:34.052 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:50:04.204 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:50:04.207 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:50:34.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:50:34.361 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:51:04.503 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:51:04.506 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:51:34.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:51:34.636 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:52:04.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:52:04.790 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:52:34.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:52:34.937 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:53:05.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:53:05.073 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:53:35.199 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:53:35.202 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:54:05.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:54:05.352 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:54:35.499 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:54:35.502 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:55:05.631 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:55:05.634 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:55:35.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:55:35.777 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:56:05.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:56:05.915 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:56:36.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:56:36.070 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:57:06.196 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:57:06.199 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:57:36.355 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:57:36.358 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:58:06.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:58:06.482 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:58:36.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:58:36.619 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:59:06.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:59:06.765 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:59:36.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T23:59:36.911 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:00:07.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:00:07.057 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:00:37.225 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:00:37.229 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:01:07.389 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:01:07.392 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:01:37.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:01:37.546 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:02:07.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:02:07.695 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:02:37.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:02:37.831 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:03:07.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:03:07.959 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:03:38.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:03:38.080 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:04:08.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:04:08.226 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:04:38.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:04:38.371 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:05:08.515 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:05:08.518 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:05:38.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:05:38.655 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:06:08.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:06:08.776 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:06:38.936 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:06:38.939 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:07:09.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:07:09.103 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:07:39.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:07:39.248 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:08:09.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:08:09.410 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:08:39.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:08:39.539 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:09:09.666 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:09:09.669 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:09:39.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:09:39.781 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:10:09.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:10:09.919 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:10:40.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:10:40.065 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:11:10.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:11:10.185 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:11:40.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:11:40.357 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:12:10.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:12:10.454 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:12:40.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:12:40.625 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:13:10.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:13:10.752 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:13:40.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:13:40.898 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:14:11.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:14:11.028 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:14:41.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:14:41.181 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:15:11.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:15:11.346 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:15:41.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:15:41.482 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:16:11.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:16:11.636 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:16:41.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:16:41.756 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:17:11.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:17:11.886 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:17:42.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:17:42.015 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:18:12.157 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:18:12.160 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:18:42.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:18:42.290 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:19:12.424 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:19:12.426 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:19:42.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:19:42.557 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:20:12.691 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:20:12.694 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:20:42.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:20:42.840 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:21:12.991 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:21:12.993 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:21:43.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:21:43.149 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:22:13.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:22:13.303 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:22:43.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:22:43.449 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:23:13.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:23:13.611 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:23:43.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:23:43.731 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:24:13.841 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:24:13.844 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:24:43.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:24:43.973 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:25:14.117 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:25:14.120 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:25:44.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:25:44.290 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:26:14.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:26:14.435 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:26:44.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:26:44.515 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:27:14.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:27:14.652 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:27:44.770 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:27:44.773 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:28:14.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:28:14.936 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:28:45.004 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:28:45.007 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:29:15.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:29:15.153 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:29:45.279 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:29:45.282 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:30:15.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:30:15.436 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:30:45.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:30:45.590 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:31:15.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:31:15.720 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:31:45.854 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:31:45.857 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:32:16.000 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:32:16.003 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:32:46.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:32:46.149 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:33:16.309 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:33:16.312 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:33:46.455 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:33:46.458 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:34:16.530 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:34:16.533 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:34:46.680 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:34:46.683 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:35:16.800 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:35:16.804 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:35:46.980 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:35:46.983 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:36:17.117 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:36:17.120 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:36:47.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:36:47.284 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:37:17.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:37:17.431 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:37:47.554 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:37:47.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:38:17.718 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:38:17.722 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:38:47.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:38:47.832 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:39:17.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:39:17.970 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:39:48.117 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:39:48.129 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:40:18.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:40:18.287 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:40:48.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:40:48.433 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:41:18.559 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:41:18.562 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:41:48.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:41:48.710 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:42:18.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:42:18.845 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:42:48.965 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:42:48.970 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:43:19.114 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:43:19.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:43:49.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:43:49.255 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:44:19.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:44:19.410 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:44:49.539 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:44:49.547 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:45:19.677 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:45:19.684 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:45:49.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:45:49.827 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:46:19.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:46:19.981 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:46:50.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:46:50.075 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:47:20.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:47:20.217 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:47:50.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:47:50.360 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:48:20.471 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:48:20.476 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:48:50.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:48:50.634 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:49:20.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:49:20.772 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:49:50.922 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:49:50.925 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:50:21.082 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:50:21.086 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:50:51.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:50:51.217 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:51:21.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:51:21.372 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:51:51.514 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:51:51.518 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:52:21.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:52:21.671 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:52:51.806 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:52:51.809 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:53:21.951 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:53:21.955 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:53:52.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:53:52.100 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:54:22.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:54:22.247 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:54:52.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:54:52.401 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:55:22.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:55:22.522 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:55:52.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:55:52.667 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:56:22.801 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:56:22.804 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:56:52.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:56:52.951 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:57:23.076 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:57:23.080 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:57:53.231 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:57:53.235 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:58:23.362 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:58:23.365 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:58:53.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:58:53.501 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:59:23.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:59:23.655 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:59:53.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T00:59:53.802 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:00:23.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:00:23.947 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:00:54.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:00:54.111 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:01:24.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:01:24.248 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:01:54.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:01:54.421 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:02:24.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:02:24.556 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:02:54.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:02:54.703 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:03:24.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:03:24.848 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:03:54.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:03:54.977 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:04:25.112 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:04:25.116 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:04:55.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:04:55.259 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:05:25.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:05:25.339 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:05:55.486 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:05:55.493 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:06:25.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:06:25.630 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:06:55.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:06:55.770 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:07:25.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:07:25.907 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:07:56.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:07:56.021 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:08:26.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:08:26.153 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:08:56.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:08:56.305 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:09:26.444 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:09:26.450 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:09:56.578 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:09:56.581 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:10:26.736 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:10:26.739 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:10:56.874 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:10:56.877 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:11:27.020 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:11:27.023 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:11:57.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:11:57.169 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:12:27.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:12:27.333 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:12:57.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:12:57.494 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:13:27.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:13:27.616 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:13:57.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:13:57.753 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:14:27.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:14:27.874 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:14:58.000 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:14:58.004 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:15:28.170 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:15:28.173 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:15:58.316 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:15:58.319 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:16:28.464 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:16:28.467 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:16:58.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:16:58.605 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:17:28.762 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:17:28.768 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:17:58.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:17:58.941 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:18:29.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:18:29.091 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:18:59.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:18:59.244 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:19:29.396 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:19:29.399 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:19:59.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:19:59.545 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:20:29.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:20:29.708 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:20:59.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:20:59.837 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:21:29.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:21:30.000 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:22:00.152 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:22:00.157 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:22:30.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:22:30.275 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:23:00.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:23:00.429 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:23:30.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:23:30.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:24:00.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:24:00.695 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:24:30.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:24:30.833 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:25:00.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:25:00.961 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:25:31.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:25:31.116 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:26:01.242 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:26:01.245 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:26:31.379 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:26:31.383 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:27:01.526 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:27:01.531 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:27:31.655 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:27:31.661 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:28:01.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:28:01.813 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:28:31.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:28:31.941 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:29:02.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:29:02.078 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:29:32.213 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:29:32.216 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:30:02.350 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:30:02.353 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:30:32.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:30:32.516 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:31:02.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:31:02.645 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:31:32.780 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:31:32.783 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:32:02.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:32:02.937 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:32:33.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:32:33.075 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:33:03.200 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:33:03.203 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:33:33.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:33:33.302 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:34:03.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:34:03.454 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:34:33.597 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:34:33.600 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:35:03.726 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:35:03.729 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:35:33.872 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:35:33.875 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:36:04.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:36:04.020 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:36:34.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:36:34.149 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:37:04.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:37:04.271 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:37:34.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:37:34.417 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:38:04.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:38:04.539 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:38:34.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:38:34.675 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:39:04.826 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:39:04.830 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:39:34.963 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:39:34.967 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:40:05.110 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:40:05.114 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:40:35.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:40:35.249 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:41:05.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:41:05.424 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:41:35.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:41:35.557 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:42:05.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:42:05.705 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:42:35.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:42:35.834 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:43:05.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:43:05.971 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:43:36.114 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:43:36.118 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:44:06.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:44:06.247 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:44:36.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:44:36.400 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:45:06.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:45:06.565 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:45:36.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:45:36.725 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:46:06.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:46:06.880 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:46:37.007 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:46:37.012 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:47:07.161 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:47:07.164 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:47:37.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:47:37.284 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:48:07.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:48:07.405 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:48:37.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:48:37.559 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:49:07.708 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:49:07.714 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:49:37.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:49:37.869 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:50:07.976 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:50:07.979 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:50:38.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:50:38.102 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:51:08.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:51:08.234 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:51:38.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:51:38.356 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:52:08.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:52:08.498 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:52:38.653 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:52:38.656 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:53:08.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:53:08.802 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:53:38.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:53:38.948 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:54:09.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:54:09.097 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:54:39.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:54:39.243 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:55:09.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:55:09.406 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:55:39.548 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:55:39.552 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:56:09.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:56:09.622 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:56:39.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:56:39.751 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:57:09.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:57:09.897 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:57:40.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:57:40.035 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:58:10.169 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:58:10.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:58:40.315 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:58:40.318 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:59:10.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:59:10.481 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:59:40.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T01:59:40.611 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:00:10.744 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:00:10.748 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:00:40.874 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:00:40.877 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:01:11.019 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:01:11.022 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:01:41.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:01:41.176 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:02:11.303 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:02:11.306 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:02:41.457 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:02:41.459 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:03:11.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:03:11.591 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:03:41.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:03:41.744 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:04:11.914 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:04:11.917 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:04:42.041 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:04:42.045 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:05:12.170 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:05:12.174 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:05:42.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:05:42.304 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:06:12.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:06:12.452 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:06:42.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:06:42.593 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:07:12.737 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:07:12.740 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:07:42.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:07:42.894 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:08:13.003 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:08:13.006 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:08:43.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:08:43.151 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:09:13.303 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:09:13.307 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:09:43.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:09:43.436 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:10:13.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:10:13.572 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:10:43.718 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:10:43.725 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:11:13.889 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:11:13.892 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:11:43.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:11:43.974 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:12:14.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:12:14.100 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:12:44.250 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:12:44.253 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:13:14.396 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:13:14.399 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:13:44.559 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:13:44.562 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:14:14.696 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:14:14.699 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:14:44.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:14:44.820 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:15:14.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:15:14.974 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:15:45.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:15:45.111 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:16:15.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:16:15.240 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:16:45.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:16:45.369 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:17:15.471 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:17:15.474 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:17:45.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:17:45.640 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:18:15.713 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:18:15.716 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:18:45.877 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:18:45.880 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:19:16.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:19:16.015 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:19:46.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:19:46.171 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:20:16.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:20:16.323 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:20:46.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:20:46.478 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:21:16.622 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:21:16.626 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:21:46.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:21:46.753 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:22:16.879 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:22:16.882 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:22:46.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:22:46.995 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:23:17.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:23:17.144 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:23:47.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:23:47.279 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:24:17.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:24:17.417 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:24:47.493 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:24:47.496 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:25:17.631 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:25:17.634 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:25:47.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:25:47.838 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:26:17.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:26:17.969 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:26:48.110 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:26:48.113 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:27:18.265 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:27:18.269 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:27:48.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:27:48.413 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:28:18.566 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:28:18.571 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:28:48.702 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:28:48.706 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:29:18.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:29:18.837 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:29:48.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:29:48.981 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:30:19.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:30:19.119 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:30:49.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:30:49.263 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:31:19.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:31:19.410 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:31:49.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:31:49.487 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:32:19.565 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:32:19.569 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:32:49.719 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:32:49.722 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:33:19.875 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:33:19.878 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:33:50.002 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:33:50.013 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:34:20.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:34:20.160 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:34:50.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:34:50.275 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:35:20.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:35:20.410 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:35:50.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:35:50.556 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:36:20.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:36:20.676 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:36:50.755 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:36:50.758 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:37:20.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:37:20.911 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:37:51.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:37:51.041 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:38:21.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:38:21.171 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:38:51.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:38:51.307 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:39:21.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:39:21.444 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:39:51.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:39:52.054 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:40:22.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:40:22.178 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:40:52.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:40:52.308 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:41:22.450 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:41:22.453 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:41:52.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:41:52.523 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:42:22.675 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:42:22.678 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:42:52.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:42:52.824 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:43:22.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:43:22.970 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:43:53.130 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:43:53.136 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:44:23.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:44:23.295 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:44:53.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:44:53.433 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:45:23.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:45:23.570 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:45:53.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:45:53.732 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:46:23.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:46:23.888 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:46:54.030 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:46:54.033 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:47:24.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:47:24.178 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:47:54.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:47:54.309 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:48:24.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:48:24.429 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:48:54.588 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:48:54.592 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:49:24.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:49:24.720 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:49:54.867 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:49:54.870 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:50:25.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:50:25.004 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:50:55.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:50:55.159 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:51:25.326 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:51:25.330 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:51:55.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:51:55.459 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:52:25.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:52:25.606 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:52:55.739 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:52:55.743 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:53:25.893 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:53:25.898 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:53:56.030 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:53:56.037 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:54:26.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:54:26.146 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:54:56.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:54:56.283 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:55:26.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:55:26.414 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:55:56.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:55:56.572 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:56:26.711 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:56:26.775 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:56:56.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:56:56.909 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:57:27.060 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:57:27.064 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:57:57.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:57:57.201 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:58:27.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:58:27.364 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:58:57.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:58:57.509 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:59:27.643 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:59:27.647 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:59:57.806 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T02:59:57.810 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:00:27.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:00:27.938 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:00:58.064 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:00:58.067 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:01:28.202 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:01:28.206 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:01:58.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:01:58.374 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:02:28.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:02:28.530 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:02:58.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:02:58.667 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:03:28.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:03:28.791 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:03:58.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:03:58.939 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:04:29.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:04:29.081 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:04:59.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:04:59.219 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:05:29.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:05:29.354 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:05:59.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:05:59.484 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:06:29.618 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:06:29.622 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:06:59.756 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:06:59.759 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:07:29.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:07:29.922 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:08:00.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:08:00.060 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:08:30.185 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:08:30.189 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:09:00.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:09:00.326 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:09:30.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:09:30.464 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:10:00.597 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:10:00.601 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:10:30.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:10:30.756 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:11:00.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:11:00.887 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:11:31.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:11:31.021 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:12:01.165 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:12:01.168 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:12:31.311 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:12:31.314 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:13:01.457 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:13:01.460 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:13:31.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:13:31.606 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:14:01.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:14:01.760 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:14:31.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:14:31.828 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:15:01.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:15:01.969 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:15:32.111 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:15:32.114 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:16:02.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:16:02.252 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:16:32.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:16:32.390 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:17:02.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:17:02.459 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:17:32.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:17:32.606 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:18:02.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:18:02.744 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:18:32.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:18:32.891 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:19:03.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:19:03.027 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:19:33.171 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:19:33.176 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:20:03.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:20:03.339 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:20:33.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:20:33.503 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:21:03.633 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:21:03.637 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:21:33.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:21:33.790 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:22:03.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:22:03.914 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:22:34.046 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:22:34.050 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:23:04.191 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:23:04.194 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:23:34.320 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:23:34.323 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:24:04.466 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:24:04.470 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:24:34.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:24:34.616 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:25:04.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:25:04.736 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:25:34.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:25:34.866 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:26:05.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:26:05.016 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:26:35.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:26:35.090 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:27:05.250 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:27:05.254 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:27:35.396 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:27:35.401 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:28:05.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:28:05.537 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:28:35.679 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:28:35.682 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:29:05.834 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:29:05.837 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:29:35.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:29:35.957 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:30:06.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:30:06.096 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:30:36.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:30:36.215 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:31:06.392 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:31:07.783 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:31:37.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:31:37.915 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:32:08.042 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:32:08.051 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:32:38.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:32:38.199 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:33:08.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:33:08.345 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:33:38.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:33:38.516 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:34:08.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:34:08.670 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:34:38.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:34:38.816 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:35:08.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:35:08.945 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:35:39.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:35:39.075 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:36:09.225 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:36:09.229 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:36:39.346 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:36:39.351 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:37:09.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:37:09.495 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:37:39.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:37:39.633 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:38:09.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:38:09.771 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:38:39.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:38:39.936 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:39:10.066 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:39:10.070 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:39:40.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:39:40.254 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:40:10.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:40:10.374 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:40:40.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:40:40.515 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:41:10.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:41:10.671 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:41:40.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:41:40.816 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:42:10.934 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:42:10.937 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:42:41.075 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:42:41.079 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:43:11.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:43:11.189 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:43:41.327 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:43:41.331 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:44:11.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:44:11.464 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:44:41.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:44:41.619 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:45:11.744 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:45:11.747 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:45:41.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:45:41.817 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:46:11.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:46:11.981 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:46:42.107 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:46:42.110 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:47:12.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:47:12.239 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:47:42.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:47:42.387 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:48:12.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:48:12.466 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:48:42.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:48:42.592 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:49:12.728 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:49:12.732 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:49:42.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:49:42.868 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:50:13.002 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:50:13.005 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:50:43.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:50:43.144 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:51:13.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:51:13.272 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:51:43.398 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:51:43.401 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:52:13.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:52:13.523 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:52:43.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:52:43.710 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:53:13.846 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:53:13.848 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:53:43.990 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:53:43.993 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:54:14.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:54:14.134 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:54:44.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:54:44.252 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:55:14.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:55:14.398 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:55:44.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:55:44.519 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:56:14.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:56:14.655 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:56:44.724 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:56:44.726 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:57:14.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:57:14.847 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:57:45.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:57:45.017 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:58:15.144 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:58:15.148 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:58:45.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:58:45.301 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:59:15.427 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:59:15.430 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:59:45.565 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T03:59:45.568 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:00:15.719 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:00:15.722 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:00:45.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:00:45.886 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:01:16.019 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:01:16.022 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:01:46.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:01:46.161 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:02:16.303 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:02:16.307 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:02:46.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:02:46.485 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:03:16.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:03:16.639 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:03:46.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:03:46.793 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:04:16.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:04:16.947 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:04:47.081 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:04:47.084 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:05:17.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:05:17.198 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:05:47.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:05:47.335 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:06:17.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:06:17.463 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:06:47.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:06:47.601 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:07:17.744 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:07:17.747 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:07:47.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:07:47.918 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:08:18.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:08:18.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:08:48.182 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:08:48.185 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:09:18.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:09:18.298 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:09:48.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:09:48.444 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:10:18.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:10:18.623 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:10:48.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:10:48.769 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:11:18.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:11:18.914 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:11:49.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:11:49.018 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:12:19.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:12:19.139 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:12:49.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:12:49.253 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:13:19.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:13:19.373 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:13:49.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:13:49.494 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:14:19.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:14:19.640 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:14:49.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:14:49.777 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:15:19.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:15:19.938 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:15:50.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:15:50.103 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:16:20.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:16:20.265 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:16:50.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:16:50.336 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:17:20.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:17:20.482 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:17:50.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:17:50.595 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:18:20.737 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:18:20.740 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:18:50.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:18:50.886 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:19:21.028 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:19:21.031 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:19:51.158 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:19:51.161 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:20:21.261 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:20:21.264 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:20:51.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:20:51.401 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:21:21.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:21:21.556 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:21:51.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:21:51.719 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:22:21.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:22:21.865 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:22:52.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:22:52.011 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:23:22.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:23:22.098 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:23:52.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:23:52.247 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:24:22.379 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:24:22.382 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:24:52.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:24:52.528 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:25:22.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:25:22.674 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:25:52.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:25:52.810 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:26:22.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:26:22.940 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:26:53.096 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:26:53.099 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:27:23.250 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:27:23.253 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:27:53.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:27:53.402 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:28:23.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:28:23.532 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:28:53.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:28:53.685 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:29:23.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:29:23.833 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:29:53.974 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:29:53.977 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:30:24.111 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:30:24.114 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:30:54.233 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:30:54.236 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:31:24.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:31:24.391 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:31:54.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:31:54.520 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:32:24.645 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:32:24.649 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:32:54.775 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:32:54.778 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:33:24.895 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:33:24.898 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:33:55.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:33:55.011 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:34:25.120 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:34:25.123 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:34:55.250 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:34:55.252 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:35:25.362 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:35:25.365 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:35:55.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:35:55.486 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:36:25.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:36:25.659 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:36:55.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:36:55.787 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:37:25.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:37:25.924 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:37:56.009 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:37:56.012 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:38:26.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:38:26.158 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:38:56.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:38:56.279 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:39:26.396 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:39:26.400 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:39:56.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:39:56.545 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:40:26.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:40:26.657 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:40:56.776 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:40:56.778 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:41:26.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:41:26.924 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:41:57.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:41:57.070 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:42:27.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:42:27.232 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:42:57.392 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:42:57.395 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:43:27.546 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:43:27.549 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:43:57.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:43:57.695 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:44:27.846 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:44:27.849 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:44:58.009 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:44:58.012 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:45:28.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:45:28.141 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:45:58.267 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:45:58.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:46:28.413 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:46:28.416 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:46:58.568 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:46:58.572 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:47:28.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:47:28.725 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:47:58.868 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:47:58.871 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:48:29.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:48:29.025 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:48:59.159 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:48:59.163 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:49:29.319 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:49:29.322 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:49:59.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:49:59.471 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:50:29.621 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:50:29.624 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:50:59.750 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:50:59.753 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:51:29.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:51:29.899 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:52:00.051 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:52:00.054 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:52:30.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:52:30.226 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:53:00.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:53:00.380 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:53:30.514 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:53:30.517 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:54:00.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:54:00.664 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:54:30.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:54:30.801 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:55:00.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:55:00.955 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:55:31.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:55:31.092 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:56:01.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:56:01.254 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:56:31.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:56:31.383 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:57:01.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:57:01.513 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:57:31.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:57:31.667 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:58:01.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:58:01.813 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:58:31.964 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:58:31.966 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:59:02.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:59:02.104 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:59:32.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T04:59:32.258 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:00:02.427 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:00:02.430 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:00:32.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:00:32.584 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:01:02.726 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:01:02.729 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:01:32.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:01:32.867 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:02:02.927 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:02:02.929 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:02:33.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:02:33.068 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:03:03.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:03:03.213 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:03:33.340 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:03:33.342 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:04:03.502 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:04:03.504 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:04:33.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:04:33.643 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:05:03.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:05:03.780 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:05:33.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:05:33.917 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:06:04.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:06:04.056 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:06:34.189 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:06:34.192 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:07:04.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:07:04.347 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:07:34.474 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:07:34.477 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:08:04.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:08:04.622 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:08:34.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:08:34.734 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:09:04.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:09:04.890 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:09:35.022 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:09:35.025 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:10:05.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:10:05.139 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:10:35.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:10:35.284 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:11:05.410 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:11:05.413 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:11:35.504 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:11:35.507 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:12:05.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:12:05.639 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:12:35.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:12:35.793 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:13:05.936 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:13:05.940 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:13:36.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:13:36.093 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:14:06.219 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:14:06.222 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:14:36.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:14:36.351 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:15:06.478 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:15:06.481 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:15:36.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:15:36.601 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:16:06.738 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:16:06.741 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:16:36.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:16:36.884 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:17:07.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:17:07.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:17:37.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:17:37.193 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:18:07.327 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:18:07.330 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:18:37.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:18:37.493 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:19:07.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:19:07.639 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:19:37.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:19:37.792 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:20:07.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:20:07.915 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:20:38.066 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:20:38.069 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:21:08.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:21:08.198 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:21:38.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:21:38.327 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:22:08.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:22:08.447 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:22:38.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:22:38.594 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:23:08.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:23:08.748 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:23:38.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:23:38.861 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:24:09.020 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:24:09.023 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:24:39.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:24:39.144 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:25:09.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:25:09.297 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:25:39.423 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:25:39.427 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:26:09.553 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:26:09.556 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:26:39.690 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:26:39.693 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:27:09.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:27:09.848 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:27:39.991 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:27:39.994 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:28:10.145 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:28:10.148 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:28:40.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:28:40.278 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:29:10.421 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:29:10.425 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:29:40.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:29:40.586 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:30:10.721 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:30:10.723 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:30:40.861 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:30:40.864 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:31:10.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:31:10.940 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:31:41.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:31:41.095 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:32:11.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:32:11.248 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:32:41.383 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:32:41.386 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:33:11.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:33:11.540 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:33:41.675 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:33:41.678 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:34:11.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:34:11.749 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:34:41.899 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:34:41.903 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:35:12.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:35:12.032 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:35:42.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:35:42.170 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:36:12.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:36:12.307 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:36:42.450 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:36:42.452 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:37:12.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:37:12.615 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:37:42.724 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:37:42.727 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:38:12.887 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:38:12.890 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:38:42.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:38:42.969 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:39:13.122 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:39:13.125 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:39:43.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:39:43.269 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:40:13.413 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:40:13.416 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:40:43.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:40:43.553 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:41:13.679 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:41:13.682 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:41:43.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:41:43.752 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:42:13.912 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:42:13.915 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:42:44.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:42:44.037 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:43:14.196 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:43:14.199 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:43:44.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:43:44.345 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:44:14.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:44:14.483 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:44:44.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:44:44.645 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:45:14.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:45:14.784 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:45:44.909 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:45:44.912 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:46:15.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:46:15.041 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:46:45.159 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:46:45.162 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:47:15.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:47:15.300 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:47:45.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:47:45.429 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:48:15.572 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:48:15.575 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:48:45.700 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:48:45.703 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:49:15.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:49:15.841 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:49:46.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:49:46.004 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:50:16.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:50:16.150 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:50:46.276 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:50:46.279 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:51:16.405 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:51:16.407 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:51:46.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:51:46.537 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:52:16.663 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:52:16.666 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:52:46.800 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:52:46.803 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:53:16.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:53:16.958 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:53:47.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:53:47.086 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:54:17.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:54:17.224 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:54:47.367 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:54:47.370 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:55:17.438 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:55:17.441 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:55:47.508 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:55:47.511 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:56:17.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:56:17.649 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:56:47.793 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:56:47.796 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:57:17.905 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:57:17.908 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:57:48.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:57:48.030 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:58:18.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:58:18.184 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:58:48.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:58:48.304 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:59:18.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:59:18.459 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:59:48.577 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T05:59:48.580 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:00:18.730 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:00:18.733 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:00:48.869 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:00:48.872 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:01:19.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:01:19.017 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:01:49.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:01:49.096 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:02:19.248 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:02:19.251 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-08T06:02:46.508 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-08T06:02:46.579 DEBUG:teuthology.task.console_log:Killing console logger for smithi012 2023-07-08T06:02:46.579 DEBUG:teuthology.task.console_log:Killing console logger for smithi160 2023-07-08T06:02:46.580 DEBUG:teuthology.exit:Finished running handlers